-- Logs begin at Mon 2022-07-04 03:08:38 UTC, end at Mon 2022-07-04 04:33:30 UTC. -- Jul 04 03:56:49.041143 dv-cinder-742162-5-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 04 03:56:49.050613 dv-cinder-742162-5-smb devstack@keystone.service[80353]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 04 03:56:49.052627 dv-cinder-742162-5-smb devstack@keystone.service[80353]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 4 03:56:49 2022] *** Jul 04 03:56:49.052627 dv-cinder-742162-5-smb devstack@keystone.service[80353]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 04 03:56:49.052627 dv-cinder-742162-5-smb devstack@keystone.service[80353]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 04 03:56:49.052627 dv-cinder-742162-5-smb devstack@keystone.service[80353]: nodename: dv-cinder-742162-5-smb Jul 04 03:56:49.052627 dv-cinder-742162-5-smb devstack@keystone.service[80353]: machine: x86_64 Jul 04 03:56:49.052627 dv-cinder-742162-5-smb devstack@keystone.service[80353]: clock source: unix Jul 04 03:56:49.052627 dv-cinder-742162-5-smb devstack@keystone.service[80353]: pcre jit disabled Jul 04 03:56:49.052627 dv-cinder-742162-5-smb devstack@keystone.service[80353]: detected number of CPU cores: 4 Jul 04 03:56:49.052627 dv-cinder-742162-5-smb devstack@keystone.service[80353]: current working directory: / Jul 04 03:56:49.052627 dv-cinder-742162-5-smb devstack@keystone.service[80353]: detected binary path: /usr/bin/uwsgi-core Jul 04 03:56:49.052627 dv-cinder-742162-5-smb devstack@keystone.service[80353]: your processes number limit is 47680 Jul 04 03:56:49.052627 dv-cinder-742162-5-smb devstack@keystone.service[80353]: your memory page size is 4096 bytes Jul 04 03:56:49.052627 dv-cinder-742162-5-smb devstack@keystone.service[80353]: detected max file descriptor number: 2048 Jul 04 03:56:49.052627 dv-cinder-742162-5-smb devstack@keystone.service[80353]: lock engine: pthread robust mutexes Jul 04 03:56:49.053377 dv-cinder-742162-5-smb devstack@keystone.service[80353]: thunder lock: enabled Jul 04 03:56:49.053377 dv-cinder-742162-5-smb devstack@keystone.service[80353]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 04 03:56:49.053377 dv-cinder-742162-5-smb devstack@keystone.service[80353]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 04 03:56:49.099781 dv-cinder-742162-5-smb devstack@keystone.service[80353]: Python main interpreter initialized at 0x55bfc92329c0 Jul 04 03:56:49.099781 dv-cinder-742162-5-smb devstack@keystone.service[80353]: python threads support enabled Jul 04 03:56:49.099781 dv-cinder-742162-5-smb devstack@keystone.service[80353]: your server socket listen backlog is limited to 100 connections Jul 04 03:56:49.099781 dv-cinder-742162-5-smb devstack@keystone.service[80353]: your mercy for graceful operations on workers is 90 seconds Jul 04 03:56:49.100131 dv-cinder-742162-5-smb devstack@keystone.service[80353]: mapped 403077 bytes (393 KB) for 2 cores Jul 04 03:56:49.100207 dv-cinder-742162-5-smb devstack@keystone.service[80353]: *** Operational MODE: preforking *** Jul 04 03:56:49.100458 dv-cinder-742162-5-smb devstack@keystone.service[80353]: *** uWSGI is running in multiple interpreter mode *** Jul 04 03:56:49.100458 dv-cinder-742162-5-smb devstack@keystone.service[80353]: spawned uWSGI master process (pid: 80353) Jul 04 03:56:49.100665 dv-cinder-742162-5-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 04 03:56:49.101782 dv-cinder-742162-5-smb devstack@keystone.service[80353]: spawned uWSGI worker 1 (pid: 80362, cores: 1) Jul 04 03:56:49.101782 dv-cinder-742162-5-smb devstack@keystone.service[80353]: spawned uWSGI worker 2 (pid: 80363, cores: 1) Jul 04 03:56:49.101782 dv-cinder-742162-5-smb devstack@keystone.service[80353]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 04 03:56:54.467440 dv-cinder-742162-5-smb devstack@keystone.service[80363]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 03:56:54.467440 dv-cinder-742162-5-smb devstack@keystone.service[80363]: from cryptography.utils import int_from_bytes Jul 04 03:56:54.468338 dv-cinder-742162-5-smb devstack@keystone.service[80363]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 03:56:54.468338 dv-cinder-742162-5-smb devstack@keystone.service[80363]: from cryptography.utils import int_from_bytes Jul 04 03:56:54.470135 dv-cinder-742162-5-smb devstack@keystone.service[80362]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 03:56:54.470135 dv-cinder-742162-5-smb devstack@keystone.service[80362]: from cryptography.utils import int_from_bytes Jul 04 03:56:54.470679 dv-cinder-742162-5-smb devstack@keystone.service[80362]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 03:56:54.470679 dv-cinder-742162-5-smb devstack@keystone.service[80362]: from cryptography.utils import int_from_bytes Jul 04 03:56:54.518007 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 04 03:56:54.518243 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 04 03:56:54.518475 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] command line args: [] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 04 03:56:54.518747 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 04 03:56:54.518883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ================================================================================ {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 04 03:56:54.519170 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] admin_token = **** {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.519419 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] config_dir = [] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.519550 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 04 03:56:54.519631 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.519694 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 04 03:56:54.519752 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] config_source = [] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.519902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] command line args: [] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 04 03:56:54.520047 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] debug = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.520128 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.520340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 04 03:56:54.520340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ================================================================================ {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 04 03:56:54.520459 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.520603 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] admin_token = **** {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.520679 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.520834 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] config_dir = [] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.520941 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.521005 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.521082 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.521148 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] config_source = [] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.521339 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] list_limit = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.521443 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] debug = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.521518 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] log_config_append = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.521584 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.521682 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.521751 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.521809 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] log_dir = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.521953 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.522070 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] log_file = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.522195 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.522265 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.522457 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.522554 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.522696 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] list_limit = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.522803 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.522873 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] log_config_append = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.522939 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.523071 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.523224 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.523317 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] log_dir = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.523392 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.523481 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] log_file = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.523560 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.523635 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.523712 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.523862 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.523972 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.524097 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.524192 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.524380 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.524465 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.524590 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.524667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.524789 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.524867 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.524982 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.525064 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.525204 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.525350 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.525434 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.525674 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.525833 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.525958 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.526042 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] publish_errors = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.526122 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.526231 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.526403 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.526494 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.526643 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.526764 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.526890 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.526973 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.527111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.527359 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] standard_threads = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.527449 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.527556 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] publish_errors = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.527644 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.527800 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.527890 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.527965 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.528078 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.528160 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] use_journal = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.528232 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.528412 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] use_json = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.528492 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.528564 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] use_stderr = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.528634 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] use_syslog = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.528710 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.528851 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.528940 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] standard_threads = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.529106 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.529214 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.529346 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.529435 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.529518 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.529596 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.529668 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] use_journal = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.529832 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.529916 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] use_json = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.529989 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] use_stderr = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.530073 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.530183 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] use_syslog = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.530329 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.530419 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 03:56:54.530585 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.530668 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.530818 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.530901 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.531065 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.531156 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.531310 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.531393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.531558 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.531641 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.531794 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.531876 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.532040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.532129 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.532278 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.532368 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.532506 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.532590 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.532750 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.532830 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.532985 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.533065 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.533237 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.533315 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.533488 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.533577 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.533733 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.533808 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.533955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.534046 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.534226 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.534321 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.534470 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.534582 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.534732 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.534837 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.534994 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.535072 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.535249 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.535336 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.535493 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.535571 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.535738 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.535814 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.535975 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.536113 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.536224 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.536374 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.536472 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.536631 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.536718 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.536868 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.536946 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.537106 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.537187 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.537342 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.537422 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.537586 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.537665 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.537837 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.537913 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.538068 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.538148 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.538327 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.538405 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.538560 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.538639 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.538788 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.538866 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.539016 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.539093 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.539244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.539328 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.539480 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.539556 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.539778 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.540032 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.540134 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.540272 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.540379 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.540499 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.540579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.540733 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.540813 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.540968 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.541055 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.541202 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.541281 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.541436 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.541519 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.541686 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.541772 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.541917 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.541994 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.542166 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.542248 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.542404 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.542495 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.542637 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.542715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.542872 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.542950 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.543246 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.543386 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.543487 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.543581 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.543677 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.543771 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.543875 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.543984 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.544080 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.544174 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.544253 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.544381 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.544470 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.544554 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.544692 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.544772 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.544899 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.544977 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.545122 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.545205 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.545356 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.545435 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.545601 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.545689 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.545845 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.545923 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.546094 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.546207 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.546355 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.546434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.546598 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.546677 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.546834 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.546922 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.547073 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.547148 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.547322 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.547409 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.547559 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.547645 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.547792 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.547879 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.548036 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.548115 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.548273 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.548362 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.548511 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.548589 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.548746 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.548831 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.548980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.549060 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.549213 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.549300 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.549459 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.549544 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.549698 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.549777 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.549937 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.550014 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.550185 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.550309 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.550435 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.550516 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.550670 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.550755 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.550907 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.550987 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.551140 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.551216 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.551357 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.551436 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.551585 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.551664 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.551812 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.551902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.552048 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.552129 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.552275 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.552362 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.552513 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.552592 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.552759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.552838 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.552994 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.553081 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.553227 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.553313 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.553470 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.553550 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.553703 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.553783 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.553947 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.554027 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.554219 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.554306 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] auth.external = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.554463 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.554542 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.554711 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.554803 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.554971 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.555051 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.555199 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] auth.password = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.555278 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.555460 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] auth.token = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.555636 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.555732 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.555820 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] auth.external = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.555947 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.556028 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.556193 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.556345 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.556427 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.556583 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.556675 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.556820 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] auth.password = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.556900 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.557054 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] auth.token = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.557134 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.557301 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.557385 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] credential.caching = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.557545 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.557625 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.557788 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.557868 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.558021 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.558101 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.558281 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.558364 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.558531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.558611 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.558768 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.558850 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.559012 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] credential.caching = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.559092 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.559265 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.559355 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.559500 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.559581 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.559751 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.559832 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.559989 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.560068 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.560239 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.560327 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.560483 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.560572 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.560738 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.560818 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.560992 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.561074 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.561230 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] federation.caching = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.561318 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.561468 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.561550 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.561713 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.561794 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.561959 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.562039 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.562216 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.562302 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.562459 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.562543 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.562694 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.562774 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.562946 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.563026 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] federation.caching = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.563182 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.563263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.563441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.563523 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.563680 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.563761 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.563913 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.563993 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.564150 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] identity.caching = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.564229 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.564390 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.564471 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.564635 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.564716 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.564874 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.564954 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.565112 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.565270 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.565348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.565420 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.565576 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.565663 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.565811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.565901 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity.caching = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.566059 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.566140 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.566332 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.566415 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.566562 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.566656 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.566792 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.566872 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.567020 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.567100 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.567267 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.567356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.567506 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.567586 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.567757 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.567843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.568010 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.568097 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.568248 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.568330 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.568533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.568632 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.568719 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.568802 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.568959 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.569040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.569186 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.569266 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.569423 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.569512 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.569653 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.569733 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.569889 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.569969 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.570129 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.570275 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.570392 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.570473 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.570639 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.570718 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.570867 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.570956 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.571113 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.571193 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.571405 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.571485 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.571640 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.571729 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.571883 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.571962 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.572124 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.572202 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.572353 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.572442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.572588 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.572669 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.572815 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.572895 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.573050 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.573140 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.573285 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.573365 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.573523 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.573602 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.573756 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.573845 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.573991 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.574070 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.574257 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.574341 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.574493 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.574587 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.574720 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.574799 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.574948 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.575028 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.575194 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.575282 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.575437 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.575517 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.575667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.575746 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.575904 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.575992 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.576140 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.576220 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.576375 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.576454 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.576606 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.576693 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.576856 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.576937 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.577085 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.577163 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.577330 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.577411 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.577569 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.577648 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.577811 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.577890 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.578043 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.578123 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.578307 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.578388 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.578550 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.578630 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.578787 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.578870 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.579022 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.579103 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.579251 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.579331 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.579496 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.579577 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.579736 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.579814 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.579971 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.580050 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.580210 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.580299 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.580449 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.580528 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.580674 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.580752 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.580910 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.580991 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.581144 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.581222 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.581377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.581458 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.581611 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.581693 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.581842 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.581921 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.582087 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.582196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.582346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.582428 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.582579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.582658 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.582826 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.582905 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.583050 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.583131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.583291 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.583370 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.583523 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.583602 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.583763 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.583892 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.584038 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.584174 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.584303 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.584431 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.584566 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.584693 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.584819 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.584942 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.585067 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.585193 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.585326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] resource.caching = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.585452 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.585589 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.585717 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.585843 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.585975 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.586110 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.586216 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.586303 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.586379 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.586379 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.586510 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.586591 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.586666 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.586806 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] resource.caching = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.586887 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.587051 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.587129 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.587288 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.587369 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.587525 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] role.caching = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.587605 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.587774 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.587852 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] role.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.588004 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.588080 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.588235 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.588315 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.588485 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.588565 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.588732 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.588813 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.588976 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.589055 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.589215 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] role.caching = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.589294 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.589456 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.589537 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] role.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.589690 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.589769 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.589933 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.590012 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.590199 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.590286 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.590430 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.590511 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.590674 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.590767 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.590920 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.591000 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.591162 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.591242 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.591411 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.591550 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.591661 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.591784 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.591898 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.592032 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.592150 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.592279 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.592401 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.592524 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.592653 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.592775 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.592904 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.592993 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.593247 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.593326 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.593495 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.593575 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.593732 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.593821 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.593962 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.594043 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.594218 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.594303 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.594451 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.594545 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.594701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.594781 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.594954 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.595034 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.595200 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.595289 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.595438 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.595519 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.595673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.595753 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.595901 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.595985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.596134 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.596214 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] token.caching = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.596368 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.596447 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.596615 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.596697 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.596850 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.596930 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.597103 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.597183 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.597344 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.597426 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.597576 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.597655 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.597814 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.597893 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] token.caching = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.598052 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.598132 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.598319 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.598399 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.598558 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.598638 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.598796 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.598878 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.599031 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.599111 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.599274 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.599356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.599519 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.599600 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.599745 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.599831 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.599986 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.600066 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.600227 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.600308 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.600472 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.600552 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] database.connection = **** {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.600716 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.600807 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.600966 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.601047 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.601203 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.601289 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.601438 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.601517 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.601670 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.601749 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.601904 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.601986 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.602138 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.602258 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.connection = **** {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.602394 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.602555 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.602692 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.602783 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.602929 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.603010 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.603172 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.603252 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.603407 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.603495 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.603651 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.603731 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.603885 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.603965 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.604126 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.604215 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.604355 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.604435 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.604595 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.604675 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.604830 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.604918 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.604994 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 04 03:56:54.605095 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.605347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.605594 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.605841 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.606077 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.606347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.606590 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 03:56:54.606764 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 04 03:56:54.635270 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.635811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.636035 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.636800 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.637038 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.637268 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.644322 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.645687 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.672393 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.672669 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.673892 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.674137 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.817615 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.818329 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.866471 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.866636 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.866709 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.866798 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.929834 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.930065 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.930314 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.930449 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.930544 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.930711 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.930794 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.930857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.930928 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.930991 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.931238 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.931472 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.955464 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.955669 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.955788 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.955880 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.956021 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.956106 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.956252 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.956332 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.956476 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.956558 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.956702 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.956834 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.956923 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.957142 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.968932 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.969181 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.981578 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.981831 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.982062 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.982217 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.982290 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.982367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.982512 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.982655 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.982726 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.982803 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.982896 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.982983 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.983167 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:54.983390 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 04 03:56:55.000277 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.000469 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 04 03:56:55.000831 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.000954 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.001043 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 04 03:56:55.001169 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 04 03:56:55.001259 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.001516 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.001638 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.001706 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 04 03:56:55.001782 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.001983 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.002114 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.002252 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.002535 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.002793 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.013056 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.013329 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.013598 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.013876 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.014022 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.014170 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.014476 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.014762 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.022049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 03:56:55.022970 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 03:56:55.025355 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 03:56:55.025630 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.025910 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.026178 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.026352 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 03:56:55.026465 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.026624 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.026753 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.026914 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.027042 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.027205 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.027333 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.027483 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.027608 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.027680 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.027742 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.027980 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.028113 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.028223 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.028522 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.028783 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.029048 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.054096 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.055302 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.055760 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 03:56:55.056038 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.056988 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 03:56:55.057274 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.061343 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 03:56:55.061617 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.062004 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.062611 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 03:56:55.062891 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.063292 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.069233 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 03:56:55.069455 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.070551 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 03:56:55.070836 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.073900 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 03:56:55.074177 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.074483 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.074760 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.075029 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.075294 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.075420 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 03:56:55.075531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.075625 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.075819 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.075961 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.076150 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.076431 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.076704 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.076955 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.077227 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.094189 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.094471 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.095757 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.096038 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.098987 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 03:56:55.100649 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 03:56:55.102643 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.102934 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.104443 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.104741 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.108129 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 03:56:55.109832 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 03:56:55.111733 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 03:56:55.113478 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 03:56:55.115323 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.115631 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.115929 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.116220 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.116493 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.116768 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.117108 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.117412 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.117711 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.118007 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.118336 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.118618 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.135967 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 03:56:55.136249 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.136511 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.136774 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.137918 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 03:56:55.138204 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.138499 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.138774 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.144558 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.146266 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.146538 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.146703 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.148340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.148617 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.149697 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 03:56:55.149981 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.150278 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.150555 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.150839 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.151911 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 03:56:55.152205 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.152489 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.152773 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.153058 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.166840 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 03:56:55.167207 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.167529 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.168002 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.168473 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.168939 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 03:56:55.169229 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.169545 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.169808 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.170089 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.170886 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.171376 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.171787 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.172071 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.189891 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 03:56:55.190211 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 03:56:55.193189 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 03:56:55.193458 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 03:56:55.196587 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.196826 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.198352 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.198602 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.200001 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 03:56:55.200228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 03:56:55.200355 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.200513 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.200642 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.200809 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.207832 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.208045 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.209447 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 03:56:55.209613 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 03:56:55.212709 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.212879 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.212976 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.213190 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.213389 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.213535 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.213674 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.213832 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.222806 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 03:56:55.222933 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 03:56:55.223071 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.223173 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.223313 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.223393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.231244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 03:56:55.231371 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 04 03:56:55.231513 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.231603 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.231752 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.231843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.232047 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.232173 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.232323 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.232407 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.232666 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.232793 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.232931 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.233027 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.233155 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.233235 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.233465 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.233651 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.233737 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.233809 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.233995 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.234126 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.234281 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.234365 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.234537 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.234625 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.234794 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.234880 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 04 03:56:55.272401 dv-cinder-742162-5-smb devstack@keystone.service[80363]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bfc92329c0 pid: 80363 (default app) Jul 04 03:56:55.272631 dv-cinder-742162-5-smb devstack@keystone.service[80362]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bfc92329c0 pid: 80362 (default app) Jul 04 03:56:55.275868 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163979bd-ac16-442f-b7c1-c110805542ce None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:56:55.276157 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163979bd-ac16-442f-b7c1-c110805542ce None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:56:55.276435 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163979bd-ac16-442f-b7c1-c110805542ce None None] PATH_INFO: `/v3` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:56:55.280711 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 791 bytes} [Mon Jul 4 03:56:55 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:02.872658 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca163e39-5cba-400d-86f8-7005e8b9b2d5 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:02.873257 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca163e39-5cba-400d-86f8-7005e8b9b2d5 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:02.874304 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca163e39-5cba-400d-86f8-7005e8b9b2d5 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:02.881943 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1/2] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:02 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 03:57:02.890379 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75eb05b-2111-400a-a34f-28f271f1e9f3 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:02.890838 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75eb05b-2111-400a-a34f-28f271f1e9f3 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:02.890984 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75eb05b-2111-400a-a34f-28f271f1e9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:02.969815 dv-cinder-742162-5-smb devstack@keystone.service[80363]: INFO dbcounter [None req-c75eb05b-2111-400a-a34f-28f271f1e9f3 None None] Registered counter for database keystone Jul 04 03:57:02.994395 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG oslo_db.sqlalchemy.engines [None req-c75eb05b-2111-400a-a34f-28f271f1e9f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80363) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 03:57:03.005893 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writer thread running {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 03:57:03.185287 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG passlib.handlers.bcrypt [None req-c75eb05b-2111-400a-a34f-28f271f1e9f3 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80363) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 04 03:57:03.185710 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG passlib.handlers.bcrypt [None req-c75eb05b-2111-400a-a34f-28f271f1e9f3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80363) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 04 03:57:03.241851 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c75eb05b-2111-400a-a34f-28f271f1e9f3 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:03.244050 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c75eb05b-2111-400a-a34f-28f271f1e9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:03.378931 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 2/3] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 490 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 04 03:57:03.595371 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca163e39-5cba-400d-86f8-7005e8b9b2d5 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:03.671817 dv-cinder-742162-5-smb devstack@keystone.service[80362]: INFO dbcounter [None req-ca163e39-5cba-400d-86f8-7005e8b9b2d5 None None] Registered counter for database keystone Jul 04 03:57:03.693555 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG oslo_db.sqlalchemy.engines [None req-ca163e39-5cba-400d-86f8-7005e8b9b2d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80362) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 03:57:03.702309 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writer thread running {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 03:57:03.819060 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca163e39-5cba-400d-86f8-7005e8b9b2d5 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:03.824550 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3f572-e1e9-48ca-9c0f-9d28213dc7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:03.825210 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3f572-e1e9-48ca-9c0f-9d28213dc7cc admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:03.825496 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3f572-e1e9-48ca-9c0f-9d28213dc7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:03.825770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3f572-e1e9-48ca-9c0f-9d28213dc7cc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:03.834872 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3f572-e1e9-48ca-9c0f-9d28213dc7cc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:03.885634 dv-cinder-742162-5-smb devstack@keystone.service[80362]: WARNING keystone.common.rbac_enforcer.enforcer [None req-25e3f572-e1e9-48ca-9c0f-9d28213dc7cc admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 04 03:57:03.886556 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3f572-e1e9-48ca-9c0f-9d28213dc7cc admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:03.896506 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 2/4] 10.222.0.49 () {58 vars in 1324 bytes} [Mon Jul 4 03:57:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 03:57:03.903402 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75eb05b-2111-400a-a34f-28f271f1e9f3 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:03.918881 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75eb05b-2111-400a-a34f-28f271f1e9f3 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:03.924501 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d522ac9-f433-41d0-b6f3-9c22eada1b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:03.925618 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d522ac9-f433-41d0-b6f3-9c22eada1b61 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:03.925898 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d522ac9-f433-41d0-b6f3-9c22eada1b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:03.926206 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d522ac9-f433-41d0-b6f3-9c22eada1b61 admin admin] PATH_INFO: `/v3/projects/a178190dbd1b4a75a7550013812afce1` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:03.930485 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d522ac9-f433-41d0-b6f3-9c22eada1b61 admin admin] RBAC: Authorizing `identity:get_project(project_id=a178190dbd1b4a75a7550013812afce1)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:03.979796 dv-cinder-742162-5-smb devstack@keystone.service[80363]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5d522ac9-f433-41d0-b6f3-9c22eada1b61 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 04 03:57:03.980135 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d522ac9-f433-41d0-b6f3-9c22eada1b61 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:03.984827 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 3/5] 10.222.0.49 () {56 vars in 1207 bytes} [Mon Jul 4 03:57:03 2022] GET /identity/v3/projects/a178190dbd1b4a75a7550013812afce1 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:57:05.959515 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990f25c-4a9c-41ca-92c4-61c7e9c0020b None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:05.960347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990f25c-4a9c-41ca-92c4-61c7e9c0020b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:05.960479 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990f25c-4a9c-41ca-92c4-61c7e9c0020b None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:05.967195 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 3/6] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:05 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:05.973082 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19a779-e0ae-4e4f-b768-07c1fd4bcac7 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:05.973513 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19a779-e0ae-4e4f-b768-07c1fd4bcac7 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:05.973606 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19a779-e0ae-4e4f-b768-07c1fd4bcac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:05.993325 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-3b19a779-e0ae-4e4f-b768-07c1fd4bcac7 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:05.994914 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3b19a779-e0ae-4e4f-b768-07c1fd4bcac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:06.004352 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 4/7] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 04 03:57:06.027721 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990f25c-4a9c-41ca-92c4-61c7e9c0020b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:06.049128 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990f25c-4a9c-41ca-92c4-61c7e9c0020b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:06.056935 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef6e7d-d76c-4b8f-a82e-48d7049279af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:06.057582 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef6e7d-d76c-4b8f-a82e-48d7049279af admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:06.057874 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef6e7d-d76c-4b8f-a82e-48d7049279af admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:06.058187 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef6e7d-d76c-4b8f-a82e-48d7049279af admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:06.066393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef6e7d-d76c-4b8f-a82e-48d7049279af admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:06.068353 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef6e7d-d76c-4b8f-a82e-48d7049279af admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:06.077472 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 4/8] 10.222.0.49 () {58 vars in 1324 bytes} [Mon Jul 4 03:57:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 03:57:06.083039 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19a779-e0ae-4e4f-b768-07c1fd4bcac7 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:06.093394 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19a779-e0ae-4e4f-b768-07c1fd4bcac7 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:06.099204 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993597c6-4a54-4a5c-9deb-457ac94c06f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:06.100088 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993597c6-4a54-4a5c-9deb-457ac94c06f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:06.100377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993597c6-4a54-4a5c-9deb-457ac94c06f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:06.100657 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993597c6-4a54-4a5c-9deb-457ac94c06f9 admin admin] PATH_INFO: `/v3/users/e4dc423a8fa8454bad29c9624cf55962` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:06.102335 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993597c6-4a54-4a5c-9deb-457ac94c06f9 admin admin] RBAC: Authorizing `identity:get_user(user_id=e4dc423a8fa8454bad29c9624cf55962)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:06.104320 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993597c6-4a54-4a5c-9deb-457ac94c06f9 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:06.105973 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 5/9] 10.222.0.49 () {56 vars in 1198 bytes} [Mon Jul 4 03:57:06 2022] GET /identity/v3/users/e4dc423a8fa8454bad29c9624cf55962 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:08.180364 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daf7be-8349-4f3d-b0e2-20f18404c965 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:08.180911 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daf7be-8349-4f3d-b0e2-20f18404c965 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:08.180911 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daf7be-8349-4f3d-b0e2-20f18404c965 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:08.182456 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 5/10] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:08.187315 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356cb571-73bc-4ea4-bc8f-feba32c652b5 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:08.187766 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356cb571-73bc-4ea4-bc8f-feba32c652b5 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:08.187850 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985aaa3d-e00e-428d-9dff-fc2fefe461b1 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:08.187928 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356cb571-73bc-4ea4-bc8f-feba32c652b5 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:08.188004 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985aaa3d-e00e-428d-9dff-fc2fefe461b1 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:08.188302 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985aaa3d-e00e-428d-9dff-fc2fefe461b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:08.189251 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 6/11] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:08.194114 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13733825-a238-44f7-af2e-b388374ec83f None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:08.194453 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13733825-a238-44f7-af2e-b388374ec83f None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:08.194751 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13733825-a238-44f7-af2e-b388374ec83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:08.212659 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-13733825-a238-44f7-af2e-b388374ec83f None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:08.213856 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-13733825-a238-44f7-af2e-b388374ec83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:08.228426 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG passlib.handlers.bcrypt [None req-985aaa3d-e00e-428d-9dff-fc2fefe461b1 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80362) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 04 03:57:08.228806 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG passlib.handlers.bcrypt [None req-985aaa3d-e00e-428d-9dff-fc2fefe461b1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80362) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 04 03:57:08.273932 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-985aaa3d-e00e-428d-9dff-fc2fefe461b1 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:08.275608 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-985aaa3d-e00e-428d-9dff-fc2fefe461b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:08.298474 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 7/12] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:08.321679 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13733825-a238-44f7-af2e-b388374ec83f None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:08.345833 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:08.377411 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 6/13] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 03:57:08.401030 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985aaa3d-e00e-428d-9dff-fc2fefe461b1 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:08.426592 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13733825-a238-44f7-af2e-b388374ec83f None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:08.462494 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef7f66-7dc0-4cfd-9c92-783f0418f641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:08.463158 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef7f66-7dc0-4cfd-9c92-783f0418f641 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:08.463456 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef7f66-7dc0-4cfd-9c92-783f0418f641 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:08.463745 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef7f66-7dc0-4cfd-9c92-783f0418f641 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:08.501933 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985aaa3d-e00e-428d-9dff-fc2fefe461b1 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:08.504326 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:08.531082 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef7f66-7dc0-4cfd-9c92-783f0418f641 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:08.532602 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef7f66-7dc0-4cfd-9c92-783f0418f641 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:08.540254 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846c3f2-36e0-49a1-8a36-2d6c6f26be27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:08.541317 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846c3f2-36e0-49a1-8a36-2d6c6f26be27 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:08.541610 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846c3f2-36e0-49a1-8a36-2d6c6f26be27 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:08.541895 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846c3f2-36e0-49a1-8a36-2d6c6f26be27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:08.553657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846c3f2-36e0-49a1-8a36-2d6c6f26be27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:57:08.555415 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:08.565009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-0846c3f2-36e0-49a1-8a36-2d6c6f26be27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:57:08.565009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:08.565009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:08.565009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:08.565009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:08.565009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:08.565009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:08.565009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:08.565009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:08.565009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:08.565009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:08.565009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:08.565009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:57:08.565009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:57:08.565009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:57:08.565009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:57:08.565957 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:57:08.565957 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:57:08.565957 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:57:08.565957 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:57:08.565957 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:08.565957 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:08.565957 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:08.565957 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:08.565957 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:08.565957 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:08.565957 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:08.565957 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:08.565957 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:08.565957 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:08.565957 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:08.565957 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:08.567002 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:08.567002 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:08.567002 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:08.567002 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:08.567002 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:57:08.567002 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:57:08.567002 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:57:08.567002 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:57:08.567002 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:57:08.567002 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:57:08.567002 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:57:08.567002 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:57:08.567002 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 7/14] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Jul 4 03:57:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:57:08.572363 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846c3f2-36e0-49a1-8a36-2d6c6f26be27 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:08.632028 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 8/15] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:57:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 04 03:57:08.638608 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef7f66-7dc0-4cfd-9c92-783f0418f641 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:08.675715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846c3f2-36e0-49a1-8a36-2d6c6f26be27 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:08.709312 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701626f-fac2-4d40-9444-389395a78564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:08.710016 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701626f-fac2-4d40-9444-389395a78564 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:08.710368 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701626f-fac2-4d40-9444-389395a78564 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:08.710684 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701626f-fac2-4d40-9444-389395a78564 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:08.711471 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701626f-fac2-4d40-9444-389395a78564 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:08.711805 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701626f-fac2-4d40-9444-389395a78564 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:08.713309 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701626f-fac2-4d40-9444-389395a78564 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:08.725388 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 8/16] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:57:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:08.731410 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701626f-fac2-4d40-9444-389395a78564 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:08.737270 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef7f66-7dc0-4cfd-9c92-783f0418f641 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:08.761346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:08.761929 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:08.774225 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe682d-e0f1-40eb-99b2-3efdf283ffe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:08.775046 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe682d-e0f1-40eb-99b2-3efdf283ffe1 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:08.775336 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe682d-e0f1-40eb-99b2-3efdf283ffe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:08.775617 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe682d-e0f1-40eb-99b2-3efdf283ffe1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:08.785932 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe682d-e0f1-40eb-99b2-3efdf283ffe1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:08.787485 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe682d-e0f1-40eb-99b2-3efdf283ffe1 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:08.808464 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-aebe682d-e0f1-40eb-99b2-3efdf283ffe1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:57:08.808464 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:08.808464 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:08.808464 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:08.808464 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:08.808464 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:08.808464 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:08.808464 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:08.808464 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:08.808464 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:08.808464 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:08.808464 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:08.808464 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:57:08.808464 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:57:08.808464 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:57:08.809401 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:57:08.809401 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:08.809401 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:08.809401 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:08.809401 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:08.809401 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:08.809401 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:08.809401 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:08.809401 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:08.809401 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:08.809401 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:08.809401 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:08.809401 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:08.809401 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:08.809401 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:08.809401 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:08.809401 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:08.810246 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:57:08.810246 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:57:08.810246 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:57:08.810246 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:57:08.810246 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 9/17] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:57:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:57:08.815659 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe682d-e0f1-40eb-99b2-3efdf283ffe1 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:08.836025 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701626f-fac2-4d40-9444-389395a78564 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:08.873080 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb2a01-9685-4c12-a50b-cf607910f010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:08.873961 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb2a01-9685-4c12-a50b-cf607910f010 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:08.874274 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb2a01-9685-4c12-a50b-cf607910f010 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:08.874548 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb2a01-9685-4c12-a50b-cf607910f010 None admin] PATH_INFO: `/v3/users/e4dc423a8fa8454bad29c9624cf55962` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:08.876174 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb2a01-9685-4c12-a50b-cf607910f010 None admin] RBAC: Authorizing `identity:get_user(user_id=e4dc423a8fa8454bad29c9624cf55962)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:08.877651 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb2a01-9685-4c12-a50b-cf607910f010 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:08.879346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 9/18] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:57:08 2022] GET /identity/v3/users/e4dc423a8fa8454bad29c9624cf55962 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:57:08.884830 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb2a01-9685-4c12-a50b-cf607910f010 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:08.916541 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe682d-e0f1-40eb-99b2-3efdf283ffe1 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:08.952570 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf29d1-cb6e-455e-8ce7-a05afe1b43ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:08.953246 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf29d1-cb6e-455e-8ce7-a05afe1b43ba None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:08.953540 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf29d1-cb6e-455e-8ce7-a05afe1b43ba None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:08.953826 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf29d1-cb6e-455e-8ce7-a05afe1b43ba None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:08.954598 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf29d1-cb6e-455e-8ce7-a05afe1b43ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:08.954917 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf29d1-cb6e-455e-8ce7-a05afe1b43ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:08.956337 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf29d1-cb6e-455e-8ce7-a05afe1b43ba None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:08.973583 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 10/19] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:08.977575 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:08.985168 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb2a01-9685-4c12-a50b-cf607910f010 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:09.023537 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6fc92-46a0-436c-89ea-16b0dd675e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:09.024244 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6fc92-46a0-436c-89ea-16b0dd675e6a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:09.024580 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6fc92-46a0-436c-89ea-16b0dd675e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:09.024881 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6fc92-46a0-436c-89ea-16b0dd675e6a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:09.026201 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a6fc92-46a0-436c-89ea-16b0dd675e6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:09.027752 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a6fc92-46a0-436c-89ea-16b0dd675e6a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:09.029444 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 10/20] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:57:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:09.035573 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf29d1-cb6e-455e-8ce7-a05afe1b43ba None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:09.071452 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:09.142591 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf29d1-cb6e-455e-8ce7-a05afe1b43ba None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:09.180693 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f63d9e0-f23b-450d-9990-0006f775489c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:09.181383 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63d9e0-f23b-450d-9990-0006f775489c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:09.181669 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63d9e0-f23b-450d-9990-0006f775489c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:09.181956 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63d9e0-f23b-450d-9990-0006f775489c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:09.183054 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f63d9e0-f23b-450d-9990-0006f775489c None admin] RBAC: Adding query filter params (role.id=2eee98054d42475bb7e22a8487ab235e, scope.domain.id=default, user.id=e4dc423a8fa8454bad29c9624cf55962) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:09.183356 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f63d9e0-f23b-450d-9990-0006f775489c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:09.184845 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f63d9e0-f23b-450d-9990-0006f775489c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:09.192224 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 11/21] 10.222.0.49 () {56 vars in 1322 bytes} [Mon Jul 4 03:57:09 2022] GET /identity/v3/role_assignments?user.id=e4dc423a8fa8454bad29c9624cf55962&scope.domain.id=default&role.id=2eee98054d42475bb7e22a8487ab235e => generated 233 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:11.225570 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181df4db-8b98-4649-8151-5fae3c2fecda None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:11.226439 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181df4db-8b98-4649-8151-5fae3c2fecda None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:11.226858 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181df4db-8b98-4649-8151-5fae3c2fecda None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:11.228467 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 11/22] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:11.233865 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946bd9e-dd2d-40c7-97f6-a2d62a361184 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:11.234645 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946bd9e-dd2d-40c7-97f6-a2d62a361184 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:11.235088 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946bd9e-dd2d-40c7-97f6-a2d62a361184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:11.254400 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-d946bd9e-dd2d-40c7-97f6-a2d62a361184 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:11.255832 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d946bd9e-dd2d-40c7-97f6-a2d62a361184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:11.343954 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 12/23] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:11.387835 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181df4db-8b98-4649-8151-5fae3c2fecda None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:11.496597 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181df4db-8b98-4649-8151-5fae3c2fecda None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:11.532227 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2cf5a2-ddfb-4f97-944f-ffb18ec8da4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:11.533296 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2cf5a2-ddfb-4f97-944f-ffb18ec8da4f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:11.533727 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2cf5a2-ddfb-4f97-944f-ffb18ec8da4f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:11.534138 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2cf5a2-ddfb-4f97-944f-ffb18ec8da4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:11.553337 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2cf5a2-ddfb-4f97-944f-ffb18ec8da4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:11.555211 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2cf5a2-ddfb-4f97-944f-ffb18ec8da4f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:11.574321 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-bf2cf5a2-ddfb-4f97-944f-ffb18ec8da4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:57:11.574321 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:11.574321 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:11.574321 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:11.574321 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:11.574321 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:11.574321 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:11.574321 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:11.574321 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:11.574321 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:11.574321 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:11.574321 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:11.574321 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:57:11.574321 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:57:11.574321 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:57:11.575312 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:57:11.575312 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:11.575312 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:11.575312 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:11.575312 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:11.575312 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:11.575312 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:11.575312 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:11.575312 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:11.575312 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:11.575312 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:11.575312 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:11.575312 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:11.575312 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:11.575312 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:11.575312 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:11.575312 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:11.576322 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:57:11.576322 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:57:11.576322 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:57:11.576322 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:57:11.577871 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 12/24] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:57:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:57:11.583791 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946bd9e-dd2d-40c7-97f6-a2d62a361184 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:11.613338 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57517a3c-c46a-4904-93ea-7aa57b9a6dbc None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:11.613882 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57517a3c-c46a-4904-93ea-7aa57b9a6dbc None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:11.614384 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57517a3c-c46a-4904-93ea-7aa57b9a6dbc None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:11.615896 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 13/25] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 03:57:11.623550 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:11.631001 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8bc53-b0a5-4b48-b206-5a8c62ba1681 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:11.631496 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8bc53-b0a5-4b48-b206-5a8c62ba1681 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:11.631916 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8bc53-b0a5-4b48-b206-5a8c62ba1681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:11.655653 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-5cd8bc53-b0a5-4b48-b206-5a8c62ba1681 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:11.657153 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-5cd8bc53-b0a5-4b48-b206-5a8c62ba1681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:11.679672 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:11.713774 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946bd9e-dd2d-40c7-97f6-a2d62a361184 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:11.773552 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8389e86-936e-416a-9730-a5ad13759087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:11.774519 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8389e86-936e-416a-9730-a5ad13759087 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:11.774968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8389e86-936e-416a-9730-a5ad13759087 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:11.775551 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8389e86-936e-416a-9730-a5ad13759087 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:11.777323 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8389e86-936e-416a-9730-a5ad13759087 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:11.778444 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8389e86-936e-416a-9730-a5ad13759087 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:11.780192 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8389e86-936e-416a-9730-a5ad13759087 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:11.799474 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 14/26] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:11.801283 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01269f-358c-46e8-adaf-e7681db9c26b None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:11.801735 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01269f-358c-46e8-adaf-e7681db9c26b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:11.802435 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01269f-358c-46e8-adaf-e7681db9c26b None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:11.806018 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 13/27] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:57:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:11.810424 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 15/28] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:11 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:11.811489 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01269f-358c-46e8-adaf-e7681db9c26b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:11.814065 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b568b4-7397-4169-a5ae-b72e44cb29ef None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:11.816187 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b568b4-7397-4169-a5ae-b72e44cb29ef None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:11.816635 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b568b4-7397-4169-a5ae-b72e44cb29ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:11.844518 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c2b568b4-7397-4169-a5ae-b72e44cb29ef None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:11.845731 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c2b568b4-7397-4169-a5ae-b72e44cb29ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:11.953290 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 14/29] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:11.958470 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b568b4-7397-4169-a5ae-b72e44cb29ef None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:12.007068 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:12.027327 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01269f-358c-46e8-adaf-e7681db9c26b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:12.101944 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f546c72e-2095-4df0-a271-79965d4b210d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:12.102702 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546c72e-2095-4df0-a271-79965d4b210d None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:12.104183 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546c72e-2095-4df0-a271-79965d4b210d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:12.104478 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546c72e-2095-4df0-a271-79965d4b210d None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:12.105216 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f546c72e-2095-4df0-a271-79965d4b210d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:12.106726 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f546c72e-2095-4df0-a271-79965d4b210d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:12.147870 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:12.178670 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b568b4-7397-4169-a5ae-b72e44cb29ef None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:12.243400 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fbd154-c0f9-4742-9cc3-6e032280868c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:12.245016 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbd154-c0f9-4742-9cc3-6e032280868c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:12.245518 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbd154-c0f9-4742-9cc3-6e032280868c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:12.245982 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbd154-c0f9-4742-9cc3-6e032280868c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:12.258180 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fbd154-c0f9-4742-9cc3-6e032280868c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:57:12.267977 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-c0fbd154-c0f9-4742-9cc3-6e032280868c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:57:12.267977 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:12.267977 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:12.267977 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:12.267977 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:12.267977 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:12.267977 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:12.267977 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:12.267977 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:12.267977 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:12.267977 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:12.267977 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:12.267977 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:57:12.267977 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:57:12.267977 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:57:12.267977 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:57:12.268866 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:57:12.268866 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:57:12.268866 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:57:12.268866 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:57:12.268866 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:12.268866 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:12.268866 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:12.268866 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:12.268866 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:12.268866 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:12.268866 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:12.268866 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:12.268866 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:12.268866 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:12.268866 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:12.268866 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:12.269687 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:12.269687 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:12.269687 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:12.269687 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:12.269687 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:57:12.269687 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:57:12.269687 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:57:12.269687 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:57:12.269687 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:57:12.269687 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:57:12.269687 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:57:12.269687 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:57:12.272668 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 15/30] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Jul 4 03:57:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:57:12.274259 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357c1ff-a697-460f-b46a-2e5272ba47fb None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:12.274819 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357c1ff-a697-460f-b46a-2e5272ba47fb None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:12.275320 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357c1ff-a697-460f-b46a-2e5272ba47fb None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:12.277022 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 16/31] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:12.277958 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357c1ff-a697-460f-b46a-2e5272ba47fb None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:12.385810 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 16/32] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Jul 4 03:57:11 2022] POST /identity/v3/projects => generated 301 bytes in 574 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 03:57:12.392019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b556311-4b04-42a1-a503-6ff03644910b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:12.392342 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b556311-4b04-42a1-a503-6ff03644910b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:12.392651 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b556311-4b04-42a1-a503-6ff03644910b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:12.394800 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:12.419070 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357c1ff-a697-460f-b46a-2e5272ba47fb None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:12.448273 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-7b556311-4b04-42a1-a503-6ff03644910b None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:12.458193 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7b556311-4b04-42a1-a503-6ff03644910b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:12.469907 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cef096-c97e-4e6e-bb3c-22ff7851d0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:12.471002 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cef096-c97e-4e6e-bb3c-22ff7851d0a7 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:12.471479 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cef096-c97e-4e6e-bb3c-22ff7851d0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:12.471945 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cef096-c97e-4e6e-bb3c-22ff7851d0a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:12.472902 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cef096-c97e-4e6e-bb3c-22ff7851d0a7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:12.483439 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cef096-c97e-4e6e-bb3c-22ff7851d0a7 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:12.613726 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 17/33] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:12.615009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b556311-4b04-42a1-a503-6ff03644910b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:12.678178 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 17/34] 10.222.0.49 () {60 vars in 1131 bytes} [Mon Jul 4 03:57:12 2022] POST /identity/v3/roles => generated 219 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 03:57:12.679061 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cef096-c97e-4e6e-bb3c-22ff7851d0a7 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:12.745692 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b556311-4b04-42a1-a503-6ff03644910b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:12.781600 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:12.794734 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f3833-1e7e-47f2-8b96-103a9133f624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:12.795774 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f3833-1e7e-47f2-8b96-103a9133f624 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:12.796254 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f3833-1e7e-47f2-8b96-103a9133f624 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:12.796745 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f3833-1e7e-47f2-8b96-103a9133f624 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:12.798615 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f3833-1e7e-47f2-8b96-103a9133f624 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:12.799276 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f3833-1e7e-47f2-8b96-103a9133f624 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:12.802065 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f3833-1e7e-47f2-8b96-103a9133f624 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:12.814552 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 18/35] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:57:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:12.816336 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456e8de-527d-4cc6-80de-4d000274f1c3 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:12.816832 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456e8de-527d-4cc6-80de-4d000274f1c3 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:12.818023 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456e8de-527d-4cc6-80de-4d000274f1c3 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:12.821108 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 19/36] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:12.822505 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456e8de-527d-4cc6-80de-4d000274f1c3 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:12.867225 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cef096-c97e-4e6e-bb3c-22ff7851d0a7 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:12.912679 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f3ad8-da04-4758-8fd9-78b0c7a4b103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:12.913920 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f3ad8-da04-4758-8fd9-78b0c7a4b103 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:12.914245 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f3ad8-da04-4758-8fd9-78b0c7a4b103 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:12.914529 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f3ad8-da04-4758-8fd9-78b0c7a4b103 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:12.916181 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f3ad8-da04-4758-8fd9-78b0c7a4b103 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:12.917768 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f3ad8-da04-4758-8fd9-78b0c7a4b103 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:12.930459 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:12.939342 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 18/37] 10.222.0.49 () {60 vars in 1131 bytes} [Mon Jul 4 03:57:12 2022] POST /identity/v3/roles => generated 225 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 03:57:12.941500 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb270034-15d4-4394-8266-5ffd19e18ccd None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:12.942266 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb270034-15d4-4394-8266-5ffd19e18ccd None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:12.942835 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb270034-15d4-4394-8266-5ffd19e18ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:12.953336 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456e8de-527d-4cc6-80de-4d000274f1c3 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:12.967298 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-cb270034-15d4-4394-8266-5ffd19e18ccd None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:12.969108 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-cb270034-15d4-4394-8266-5ffd19e18ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:13.001385 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7402b4-fa66-48bc-92ef-ecec9c990562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:13.002355 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7402b4-fa66-48bc-92ef-ecec9c990562 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:13.002647 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7402b4-fa66-48bc-92ef-ecec9c990562 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:13.002932 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7402b4-fa66-48bc-92ef-ecec9c990562 None admin] PATH_INFO: `/v3/users/e4dc423a8fa8454bad29c9624cf55962` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:13.004266 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7402b4-fa66-48bc-92ef-ecec9c990562 None admin] RBAC: Authorizing `identity:get_user(user_id=e4dc423a8fa8454bad29c9624cf55962)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:13.005799 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7402b4-fa66-48bc-92ef-ecec9c990562 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:13.007774 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 20/38] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:57:12 2022] GET /identity/v3/users/e4dc423a8fa8454bad29c9624cf55962 => generated 247 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:13.012271 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ae5af-66c9-4b9a-b646-0219cf839567 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:13.013220 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ae5af-66c9-4b9a-b646-0219cf839567 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:13.014761 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ae5af-66c9-4b9a-b646-0219cf839567 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:13.016565 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 21/39] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:13.017734 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ae5af-66c9-4b9a-b646-0219cf839567 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:13.049394 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 19/40] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:13.050556 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75bb12-362e-46ad-a4f5-3b7f257bbdc0 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:13.050852 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75bb12-362e-46ad-a4f5-3b7f257bbdc0 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:13.051134 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75bb12-362e-46ad-a4f5-3b7f257bbdc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:13.069571 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-bd75bb12-362e-46ad-a4f5-3b7f257bbdc0 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:13.071121 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-bd75bb12-362e-46ad-a4f5-3b7f257bbdc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:13.102695 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:13.154478 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 20/41] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:13.160579 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ae5af-66c9-4b9a-b646-0219cf839567 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:13.163064 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75bb12-362e-46ad-a4f5-3b7f257bbdc0 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:13.196699 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c2a8b-2b58-48ac-9f45-49cfe98bc008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:13.197519 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c2a8b-2b58-48ac-9f45-49cfe98bc008 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:13.197814 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c2a8b-2b58-48ac-9f45-49cfe98bc008 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:13.198119 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c2a8b-2b58-48ac-9f45-49cfe98bc008 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:13.199365 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c2a8b-2b58-48ac-9f45-49cfe98bc008 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:13.200874 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c2a8b-2b58-48ac-9f45-49cfe98bc008 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:13.202609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 22/42] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:57:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:13.203452 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c2a8b-2b58-48ac-9f45-49cfe98bc008 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:13.311441 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c2a8b-2b58-48ac-9f45-49cfe98bc008 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:13.338411 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:13.340931 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:13.350708 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b23a8-88fe-4462-8a4a-c424ccfb528d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:13.351532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b23a8-88fe-4462-8a4a-c424ccfb528d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:13.351824 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b23a8-88fe-4462-8a4a-c424ccfb528d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:13.352111 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b23a8-88fe-4462-8a4a-c424ccfb528d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:13.353381 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b23a8-88fe-4462-8a4a-c424ccfb528d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:13.354931 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b23a8-88fe-4462-8a4a-c424ccfb528d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:13.356625 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 23/43] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:57:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:13.357380 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b23a8-88fe-4462-8a4a-c424ccfb528d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:13.390429 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75bb12-362e-46ad-a4f5-3b7f257bbdc0 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:13.427446 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640448e-0c1a-4a03-ad54-2c8f9fd5010e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:13.428133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640448e-0c1a-4a03-ad54-2c8f9fd5010e None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:13.428425 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640448e-0c1a-4a03-ad54-2c8f9fd5010e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:13.428708 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640448e-0c1a-4a03-ad54-2c8f9fd5010e None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:13.429474 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640448e-0c1a-4a03-ad54-2c8f9fd5010e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:13.431012 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640448e-0c1a-4a03-ad54-2c8f9fd5010e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:13.444696 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 21/44] 10.222.0.49 () {60 vars in 1131 bytes} [Mon Jul 4 03:57:13 2022] POST /identity/v3/roles => generated 223 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 03:57:13.445512 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640448e-0c1a-4a03-ad54-2c8f9fd5010e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:13.460297 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b23a8-88fe-4462-8a4a-c424ccfb528d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:13.499683 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb0e6d-9c58-479e-ba2d-e1198a8a3c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:13.500861 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb0e6d-9c58-479e-ba2d-e1198a8a3c20 None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:13.501214 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb0e6d-9c58-479e-ba2d-e1198a8a3c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:13.501601 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb0e6d-9c58-479e-ba2d-e1198a8a3c20 None admin] PATH_INFO: `/v3/domains/default/users/e4dc423a8fa8454bad29c9624cf55962/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:13.504312 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb0e6d-9c58-479e-ba2d-e1198a8a3c20 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=e4dc423a8fa8454bad29c9624cf55962, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:13.506327 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb0e6d-9c58-479e-ba2d-e1198a8a3c20 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:13.534190 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 24/45] 10.222.0.49 () {58 vars in 1361 bytes} [Mon Jul 4 03:57:13 2022] PUT /identity/v3/domains/default/users/e4dc423a8fa8454bad29c9624cf55962/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 03:57:13.577687 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640448e-0c1a-4a03-ad54-2c8f9fd5010e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:13.603415 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:13.636498 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da8d86-6b80-421f-a842-7ec0b8b8dbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:13.637225 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da8d86-6b80-421f-a842-7ec0b8b8dbfe None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:13.637514 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da8d86-6b80-421f-a842-7ec0b8b8dbfe None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:13.637796 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da8d86-6b80-421f-a842-7ec0b8b8dbfe None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:13.638577 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da8d86-6b80-421f-a842-7ec0b8b8dbfe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:13.640162 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da8d86-6b80-421f-a842-7ec0b8b8dbfe None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:13.672533 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 22/46] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Jul 4 03:57:13 2022] POST /identity/v3/projects => generated 312 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 03:57:15.532120 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0dec7-e13f-40ef-a326-0ba6b902b247 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:15.532668 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0dec7-e13f-40ef-a326-0ba6b902b247 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:15.532668 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0dec7-e13f-40ef-a326-0ba6b902b247 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:15.534036 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 25/47] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:15.539580 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4af69-6674-4ff4-a679-9387c895fc4a None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:15.540108 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4af69-6674-4ff4-a679-9387c895fc4a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:15.540206 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4af69-6674-4ff4-a679-9387c895fc4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:15.557423 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-33a4af69-6674-4ff4-a679-9387c895fc4a None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:15.558655 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-33a4af69-6674-4ff4-a679-9387c895fc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:15.628409 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 23/48] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:15.653525 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0dec7-e13f-40ef-a326-0ba6b902b247 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:15.686167 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f88c3-2406-48f9-86b7-8267ff5f2a72 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:15.686484 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f88c3-2406-48f9-86b7-8267ff5f2a72 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:15.686769 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f88c3-2406-48f9-86b7-8267ff5f2a72 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:15.688181 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 24/49] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:15.693007 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308e3e7-26d2-4ec2-895e-5bf5df23f996 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:15.693302 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308e3e7-26d2-4ec2-895e-5bf5df23f996 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:15.693582 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308e3e7-26d2-4ec2-895e-5bf5df23f996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:15.710803 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:15.711145 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-2308e3e7-26d2-4ec2-895e-5bf5df23f996 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:15.712323 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-2308e3e7-26d2-4ec2-895e-5bf5df23f996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:15.761893 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0dec7-e13f-40ef-a326-0ba6b902b247 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:15.782755 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 25/50] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:15.794667 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97344d51-409a-4bff-a70d-b0d7b5f1cdbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:15.795466 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97344d51-409a-4bff-a70d-b0d7b5f1cdbb None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:15.795754 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97344d51-409a-4bff-a70d-b0d7b5f1cdbb None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:15.796036 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97344d51-409a-4bff-a70d-b0d7b5f1cdbb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:15.805552 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308e3e7-26d2-4ec2-895e-5bf5df23f996 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:15.806343 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97344d51-409a-4bff-a70d-b0d7b5f1cdbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:57:15.813985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-97344d51-409a-4bff-a70d-b0d7b5f1cdbb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:57:15.813985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:15.813985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:15.813985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:15.813985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:15.813985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:15.813985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:15.813985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:15.813985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:15.813985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:15.813985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:15.813985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:15.813985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:57:15.813985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:57:15.813985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:57:15.813985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:57:15.814984 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:57:15.814984 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:57:15.814984 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:57:15.814984 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:57:15.814984 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:15.814984 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:15.814984 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:15.814984 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:15.814984 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:15.814984 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:15.814984 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:15.814984 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:15.814984 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:15.814984 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:15.814984 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:15.814984 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:15.815718 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:15.815718 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:15.815718 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:15.815718 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:15.815718 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:57:15.815718 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:57:15.815718 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:57:15.815718 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:57:15.815718 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:57:15.815718 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:57:15.815718 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:57:15.815718 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:57:15.815718 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 26/51] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Jul 4 03:57:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:57:15.820957 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97344d51-409a-4bff-a70d-b0d7b5f1cdbb None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:15.835979 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:15.906633 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308e3e7-26d2-4ec2-895e-5bf5df23f996 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:15.919181 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97344d51-409a-4bff-a70d-b0d7b5f1cdbb None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:15.942422 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c6442-b082-4018-94fa-7ff6c592a42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:15.943263 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c6442-b082-4018-94fa-7ff6c592a42f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:15.943892 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c6442-b082-4018-94fa-7ff6c592a42f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:15.943892 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c6442-b082-4018-94fa-7ff6c592a42f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:15.945188 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c6442-b082-4018-94fa-7ff6c592a42f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:15.946993 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c6442-b082-4018-94fa-7ff6c592a42f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:15.948553 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 26/52] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:57:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:57:15.954795 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c6442-b082-4018-94fa-7ff6c592a42f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:16.039778 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:16.062658 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:16.063987 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb77154-993e-4388-b8b7-de6f8bad7cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:16.064791 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb77154-993e-4388-b8b7-de6f8bad7cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:16.065138 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb77154-993e-4388-b8b7-de6f8bad7cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:16.065428 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb77154-993e-4388-b8b7-de6f8bad7cf1 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:16.066195 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb77154-993e-4388-b8b7-de6f8bad7cf1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:16.066531 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb77154-993e-4388-b8b7-de6f8bad7cf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:16.066717 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c6442-b082-4018-94fa-7ff6c592a42f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:16.068043 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb77154-993e-4388-b8b7-de6f8bad7cf1 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:16.076688 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 27/53] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:57:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:57:16.081974 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb77154-993e-4388-b8b7-de6f8bad7cf1 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:16.101418 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5332c6-3375-49db-9464-4cf2c01003ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:16.102092 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5332c6-3375-49db-9464-4cf2c01003ad None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:16.102415 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5332c6-3375-49db-9464-4cf2c01003ad None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:16.102937 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5332c6-3375-49db-9464-4cf2c01003ad None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:16.103704 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5332c6-3375-49db-9464-4cf2c01003ad None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:16.105269 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5332c6-3375-49db-9464-4cf2c01003ad None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:16.130326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 27/54] 10.222.0.49 () {60 vars in 1140 bytes} [Mon Jul 4 03:57:15 2022] POST /identity/v3/projects => generated 298 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 03:57:16.189698 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb77154-993e-4388-b8b7-de6f8bad7cf1 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:16.229173 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a87afa-3039-4c0d-97f6-c95780a66ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:16.230078 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a87afa-3039-4c0d-97f6-c95780a66ebe None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:16.230414 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a87afa-3039-4c0d-97f6-c95780a66ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:16.230705 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a87afa-3039-4c0d-97f6-c95780a66ebe None admin] PATH_INFO: `/v3/users/e4dc423a8fa8454bad29c9624cf55962` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:16.231993 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a87afa-3039-4c0d-97f6-c95780a66ebe None admin] RBAC: Authorizing `identity:get_user(user_id=e4dc423a8fa8454bad29c9624cf55962)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:16.233493 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a87afa-3039-4c0d-97f6-c95780a66ebe None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:16.235268 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 28/55] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:57:16 2022] GET /identity/v3/users/e4dc423a8fa8454bad29c9624cf55962 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:57:16.241230 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5332c6-3375-49db-9464-4cf2c01003ad None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:16.355228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5332c6-3375-49db-9464-4cf2c01003ad None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:16.390580 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996662db-c16d-4b3d-acea-368d95919f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:16.391391 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996662db-c16d-4b3d-acea-368d95919f76 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:16.391678 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996662db-c16d-4b3d-acea-368d95919f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:16.391963 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996662db-c16d-4b3d-acea-368d95919f76 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:16.393187 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996662db-c16d-4b3d-acea-368d95919f76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:16.394690 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996662db-c16d-4b3d-acea-368d95919f76 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:16.396329 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 28/56] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:57:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:16.402219 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a87afa-3039-4c0d-97f6-c95780a66ebe None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:16.447280 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:16.506796 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a87afa-3039-4c0d-97f6-c95780a66ebe None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:16.543591 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038233a-7ef6-414a-913e-0278cbbf773f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:16.544258 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038233a-7ef6-414a-913e-0278cbbf773f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:16.544531 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038233a-7ef6-414a-913e-0278cbbf773f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:16.544819 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038233a-7ef6-414a-913e-0278cbbf773f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:16.545674 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038233a-7ef6-414a-913e-0278cbbf773f None admin] RBAC: Adding query filter params (role.id=2eee98054d42475bb7e22a8487ab235e, scope.domain.id=default, user.id=e4dc423a8fa8454bad29c9624cf55962) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:16.546003 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038233a-7ef6-414a-913e-0278cbbf773f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:16.547539 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038233a-7ef6-414a-913e-0278cbbf773f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:16.556197 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 29/57] 10.222.0.49 () {56 vars in 1322 bytes} [Mon Jul 4 03:57:16 2022] GET /identity/v3/role_assignments?user.id=e4dc423a8fa8454bad29c9624cf55962&scope.domain.id=default&role.id=2eee98054d42475bb7e22a8487ab235e => generated 530 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:18.225777 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8a6b0-e5c1-430f-9a91-657b093bc36a None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:18.226310 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8a6b0-e5c1-430f-9a91-657b093bc36a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:18.226310 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8a6b0-e5c1-430f-9a91-657b093bc36a None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:18.227713 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 29/58] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:18.234029 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b9739-a6c2-42c1-bf2c-c893a869068a None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:18.234778 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b9739-a6c2-42c1-bf2c-c893a869068a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:18.235034 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b9739-a6c2-42c1-bf2c-c893a869068a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:18.257245 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-cc3b9739-a6c2-42c1-bf2c-c893a869068a None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:18.258479 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-cc3b9739-a6c2-42c1-bf2c-c893a869068a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:18.336431 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 30/59] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:18.371262 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8a6b0-e5c1-430f-9a91-657b093bc36a None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:18.394798 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:18.488521 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8a6b0-e5c1-430f-9a91-657b093bc36a None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:18.524056 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2a4ca-7f6c-458a-93cb-fb13bbf76366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:18.524875 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2a4ca-7f6c-458a-93cb-fb13bbf76366 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:18.525159 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2a4ca-7f6c-458a-93cb-fb13bbf76366 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:18.525446 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2a4ca-7f6c-458a-93cb-fb13bbf76366 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:18.526787 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c2a4ca-7f6c-458a-93cb-fb13bbf76366 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:18.528264 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c2a4ca-7f6c-458a-93cb-fb13bbf76366 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:18.529892 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 30/60] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:57:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:18.537911 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b9739-a6c2-42c1-bf2c-c893a869068a None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:18.575869 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:18.651907 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b9739-a6c2-42c1-bf2c-c893a869068a None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:18.687880 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533dcf2-7d02-43f9-930a-5d554b9d5088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:18.688552 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533dcf2-7d02-43f9-930a-5d554b9d5088 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:18.688842 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533dcf2-7d02-43f9-930a-5d554b9d5088 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:18.689127 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533dcf2-7d02-43f9-930a-5d554b9d5088 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:18.689857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533dcf2-7d02-43f9-930a-5d554b9d5088 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:18.691372 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533dcf2-7d02-43f9-930a-5d554b9d5088 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:18.723796 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 31/61] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Jul 4 03:57:18 2022] POST /identity/v3/users => generated 275 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 03:57:21.777370 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4657916-e56d-459f-96fc-7025c9c31186 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:21.777887 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4657916-e56d-459f-96fc-7025c9c31186 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:21.777995 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4657916-e56d-459f-96fc-7025c9c31186 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:21.779580 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 31/62] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:21.784774 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572ad05-35a9-4b5b-8954-6fce1008e71e None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:21.785533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572ad05-35a9-4b5b-8954-6fce1008e71e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:21.785962 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572ad05-35a9-4b5b-8954-6fce1008e71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:21.805890 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-b572ad05-35a9-4b5b-8954-6fce1008e71e None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:21.807348 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b572ad05-35a9-4b5b-8954-6fce1008e71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:21.899626 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 32/63] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 03:57:21.903286 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc5f99-983e-4d6f-8fea-c2f9aaf57f2e None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:21.903809 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc5f99-983e-4d6f-8fea-c2f9aaf57f2e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:21.904311 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc5f99-983e-4d6f-8fea-c2f9aaf57f2e None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:21.905891 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 32/64] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:21.911341 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cadbf0-a975-4982-8676-c998b81d0ae6 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:21.911642 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cadbf0-a975-4982-8676-c998b81d0ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:21.911931 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cadbf0-a975-4982-8676-c998b81d0ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:21.923843 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc5f99-983e-4d6f-8fea-c2f9aaf57f2e None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:21.937725 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-63cadbf0-a975-4982-8676-c998b81d0ae6 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:21.939000 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-63cadbf0-a975-4982-8676-c998b81d0ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:21.988110 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:22.059692 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc5f99-983e-4d6f-8fea-c2f9aaf57f2e None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:22.060872 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 33/65] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:22.062270 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7553b53-31d9-487f-8dd6-0cd3cdce9c57 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:22.062578 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7553b53-31d9-487f-8dd6-0cd3cdce9c57 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:22.062679 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:22.062865 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7553b53-31d9-487f-8dd6-0cd3cdce9c57 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:22.064836 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 34/66] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:22.069867 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc6c4c-5221-4a7d-a348-e8085f2e4259 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:22.070194 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc6c4c-5221-4a7d-a348-e8085f2e4259 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:22.070468 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc6c4c-5221-4a7d-a348-e8085f2e4259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:22.093475 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-39cc6c4c-5221-4a7d-a348-e8085f2e4259 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:22.095088 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-39cc6c4c-5221-4a7d-a348-e8085f2e4259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:22.117284 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ee970-cedf-4c38-9503-edd2bd9b4d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:22.118140 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ee970-cedf-4c38-9503-edd2bd9b4d34 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:22.118450 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ee970-cedf-4c38-9503-edd2bd9b4d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:22.118728 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ee970-cedf-4c38-9503-edd2bd9b4d34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:22.132969 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ee970-cedf-4c38-9503-edd2bd9b4d34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:57:22.142930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-1e4ee970-cedf-4c38-9503-edd2bd9b4d34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:57:22.142930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:22.142930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:22.142930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:22.142930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:22.142930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:22.142930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:22.142930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:22.142930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:22.142930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:22.142930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:22.142930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:22.142930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:57:22.142930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:57:22.142930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:57:22.142930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:57:22.143884 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:57:22.143884 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:57:22.143884 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:57:22.143884 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:57:22.143884 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:22.143884 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:22.143884 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:22.143884 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:22.143884 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:22.143884 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:22.143884 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:22.143884 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:22.143884 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:22.143884 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:22.143884 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:22.143884 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:22.144649 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:22.144649 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:22.144649 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:22.144649 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:22.144649 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:57:22.144649 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:57:22.144649 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:57:22.144649 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:57:22.144649 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:57:22.144649 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:57:22.144649 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:57:22.144649 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:57:22.144649 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 33/67] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Jul 4 03:57:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:57:22.145288 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ee970-cedf-4c38-9503-edd2bd9b4d34 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:22.176725 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 35/68] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 03:57:22.178537 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc6c4c-5221-4a7d-a348-e8085f2e4259 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:22.271777 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ee970-cedf-4c38-9503-edd2bd9b4d34 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:22.278629 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:22.304104 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc6c4c-5221-4a7d-a348-e8085f2e4259 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:22.316778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24891231-0027-4912-9475-362624ae6efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:22.317527 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24891231-0027-4912-9475-362624ae6efe None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:22.318212 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24891231-0027-4912-9475-362624ae6efe None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:22.318505 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24891231-0027-4912-9475-362624ae6efe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:22.331560 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24891231-0027-4912-9475-362624ae6efe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:57:22.342504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-24891231-0027-4912-9475-362624ae6efe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 03:57:22.342504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:22.342504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:22.342504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:22.342504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:22.342504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:22.342504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:22.342504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:22.342504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:22.342504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:22.342504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:22.342504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:22.342504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:57:22.342504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:57:22.342504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:57:22.342504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:57:22.343382 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:57:22.343382 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:57:22.343382 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:57:22.343382 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:57:22.343382 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:22.343382 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:22.343382 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:22.343382 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:22.343382 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:22.343382 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:22.343382 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:22.343382 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:22.343382 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:22.343382 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:22.343382 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:22.343382 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:22.344138 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:22.344138 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:22.344138 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:22.344138 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:22.344138 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:57:22.344138 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:57:22.344138 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:57:22.344138 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:57:22.344138 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:57:22.344138 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:57:22.344138 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 03:57:22.344138 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:57:22.346235 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 34/69] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:57:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:57:22.347304 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24891231-0027-4912-9475-362624ae6efe None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:22.349300 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ad93e-2d78-4c7b-8091-14e4912dbb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:22.349993 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ad93e-2d78-4c7b-8091-14e4912dbb2f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:22.350324 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ad93e-2d78-4c7b-8091-14e4912dbb2f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:22.350611 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ad93e-2d78-4c7b-8091-14e4912dbb2f None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:22.351396 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ad93e-2d78-4c7b-8091-14e4912dbb2f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:22.351713 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ad93e-2d78-4c7b-8091-14e4912dbb2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:22.353228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ad93e-2d78-4c7b-8091-14e4912dbb2f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:22.362291 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:22.364318 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 36/70] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:57:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:22.365761 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ad93e-2d78-4c7b-8091-14e4912dbb2f None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:22.471689 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ad93e-2d78-4c7b-8091-14e4912dbb2f None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:22.492356 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24891231-0027-4912-9475-362624ae6efe None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:22.507298 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa3d1a-d41e-4835-b82a-dd4c9afd609c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:22.507978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa3d1a-d41e-4835-b82a-dd4c9afd609c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:22.508270 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa3d1a-d41e-4835-b82a-dd4c9afd609c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:22.508556 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa3d1a-d41e-4835-b82a-dd4c9afd609c None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:22.509376 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa3d1a-d41e-4835-b82a-dd4c9afd609c None admin] RBAC: Adding query filter params (name=member) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:22.509692 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa3d1a-d41e-4835-b82a-dd4c9afd609c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:22.511452 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa3d1a-d41e-4835-b82a-dd4c9afd609c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:22.519758 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 37/71] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Jul 4 03:57:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:22.520548 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa3d1a-d41e-4835-b82a-dd4c9afd609c None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:22.529453 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:22.534829 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7bd603-b199-47b9-b98f-4ac184d7bed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:22.535716 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7bd603-b199-47b9-b98f-4ac184d7bed2 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:22.536010 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7bd603-b199-47b9-b98f-4ac184d7bed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:22.536296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7bd603-b199-47b9-b98f-4ac184d7bed2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:22.546685 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7bd603-b199-47b9-b98f-4ac184d7bed2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:57:22.554744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-7e7bd603-b199-47b9-b98f-4ac184d7bed2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 03:57:22.554744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:22.554744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:22.554744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:22.554744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:22.554744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:22.554744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:22.554744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:22.554744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:22.554744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:22.554744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:22.554744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:22.554744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:57:22.554744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:57:22.554744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:57:22.554744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:57:22.555673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:57:22.555673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:57:22.555673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:57:22.555673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:57:22.555673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:22.555673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:22.555673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:22.555673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:22.555673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:22.555673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:22.555673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:22.555673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:22.555673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:22.555673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:22.555673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:22.555673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:22.556443 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:22.556443 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:22.556443 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:22.556443 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:22.556443 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:57:22.556443 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:57:22.556443 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:57:22.556443 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:57:22.556443 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:57:22.556443 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:57:22.556443 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 03:57:22.556443 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:57:22.556443 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 35/72] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Jul 4 03:57:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:57:22.557865 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbed943-2b07-4758-92d1-e70adb04a26f None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:22.557865 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbed943-2b07-4758-92d1-e70adb04a26f None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:22.557865 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbed943-2b07-4758-92d1-e70adb04a26f None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:22.559336 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 36/73] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:22.562593 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a12ff-6a9a-4823-a8bb-11f61baa196b None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:22.562593 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a12ff-6a9a-4823-a8bb-11f61baa196b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:22.562593 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a12ff-6a9a-4823-a8bb-11f61baa196b None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:22.562593 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 37/74] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:22.562881 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a12ff-6a9a-4823-a8bb-11f61baa196b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:22.622423 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa3d1a-d41e-4835-b82a-dd4c9afd609c None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:22.630140 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:22.655593 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf050953-4856-48b4-b864-e2f8c5b5c962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:22.656479 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf050953-4856-48b4-b864-e2f8c5b5c962 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:22.656767 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf050953-4856-48b4-b864-e2f8c5b5c962 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:22.657040 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf050953-4856-48b4-b864-e2f8c5b5c962 None admin] PATH_INFO: `/v3/users/e4dc423a8fa8454bad29c9624cf55962` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:22.658356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf050953-4856-48b4-b864-e2f8c5b5c962 None admin] RBAC: Authorizing `identity:get_user(user_id=e4dc423a8fa8454bad29c9624cf55962)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:22.659833 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf050953-4856-48b4-b864-e2f8c5b5c962 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:22.661475 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 38/75] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:57:22 2022] GET /identity/v3/users/e4dc423a8fa8454bad29c9624cf55962 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:22.662276 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf050953-4856-48b4-b864-e2f8c5b5c962 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:22.667572 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a12ff-6a9a-4823-a8bb-11f61baa196b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:22.700514 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249df58d-5494-4794-b2ad-7c7770f25f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:22.701401 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249df58d-5494-4794-b2ad-7c7770f25f09 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:22.701684 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249df58d-5494-4794-b2ad-7c7770f25f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:22.701964 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249df58d-5494-4794-b2ad-7c7770f25f09 None admin] PATH_INFO: `/v3/users/3c37bbe571ec415c9de778d6219de1a0` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:22.715178 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249df58d-5494-4794-b2ad-7c7770f25f09 None admin] RBAC: Authorizing `identity:get_user(user_id=3c37bbe571ec415c9de778d6219de1a0)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:22.716741 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249df58d-5494-4794-b2ad-7c7770f25f09 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:22.718550 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 38/76] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:57:22 2022] GET /identity/v3/users/3c37bbe571ec415c9de778d6219de1a0 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:22.719722 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223fc025-5649-4a9d-94ec-83d150183995 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:22.720033 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223fc025-5649-4a9d-94ec-83d150183995 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:22.720305 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223fc025-5649-4a9d-94ec-83d150183995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:22.735939 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-223fc025-5649-4a9d-94ec-83d150183995 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:22.737126 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-223fc025-5649-4a9d-94ec-83d150183995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:22.738405 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:22.763330 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf050953-4856-48b4-b864-e2f8c5b5c962 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:22.796154 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e2451-fee1-4599-b24b-38e497bd0b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:22.796826 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e2451-fee1-4599-b24b-38e497bd0b63 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:22.797372 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e2451-fee1-4599-b24b-38e497bd0b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:22.797372 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e2451-fee1-4599-b24b-38e497bd0b63 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:22.798181 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e2451-fee1-4599-b24b-38e497bd0b63 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:22.798493 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e2451-fee1-4599-b24b-38e497bd0b63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:22.799897 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e2451-fee1-4599-b24b-38e497bd0b63 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:22.804402 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 39/77] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:22.805773 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfba5e-add4-42d6-add1-2dda2c48d086 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:22.806074 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfba5e-add4-42d6-add1-2dda2c48d086 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:22.806468 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfba5e-add4-42d6-add1-2dda2c48d086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:22.808376 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 39/78] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:57:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:22.809307 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e2451-fee1-4599-b24b-38e497bd0b63 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:22.833006 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-cecfba5e-add4-42d6-add1-2dda2c48d086 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:22.834246 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-cecfba5e-add4-42d6-add1-2dda2c48d086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:22.883424 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:22.902124 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 40/79] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:22.905054 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecfba5e-add4-42d6-add1-2dda2c48d086 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:22.914651 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e2451-fee1-4599-b24b-38e497bd0b63 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:22.949988 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a052f-e17f-4bca-abd4-d4983a20e476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:22.950684 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a052f-e17f-4bca-abd4-d4983a20e476 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:22.950972 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a052f-e17f-4bca-abd4-d4983a20e476 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:22.951279 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a052f-e17f-4bca-abd4-d4983a20e476 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:22.954789 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:23.000083 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecfba5e-add4-42d6-add1-2dda2c48d086 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:23.022599 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a052f-e17f-4bca-abd4-d4983a20e476 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:23.024083 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a052f-e17f-4bca-abd4-d4983a20e476 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:23.034259 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de2597-fcb8-4f6e-9d32-5690b7c7b237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:23.034931 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de2597-fcb8-4f6e-9d32-5690b7c7b237 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:23.035217 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de2597-fcb8-4f6e-9d32-5690b7c7b237 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:23.035501 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de2597-fcb8-4f6e-9d32-5690b7c7b237 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:23.087315 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:23.104078 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95de2597-fcb8-4f6e-9d32-5690b7c7b237 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:23.105618 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95de2597-fcb8-4f6e-9d32-5690b7c7b237 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:23.123519 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 40/80] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:57:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 03:57:23.124386 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a052f-e17f-4bca-abd4-d4983a20e476 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:23.157655 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:23.205488 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 41/81] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:57:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 03:57:23.206381 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de2597-fcb8-4f6e-9d32-5690b7c7b237 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:23.220677 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a052f-e17f-4bca-abd4-d4983a20e476 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:23.254291 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1c536-1622-4505-9efa-e63b18136d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:23.255177 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1c536-1622-4505-9efa-e63b18136d12 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:23.255471 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1c536-1622-4505-9efa-e63b18136d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:23.255758 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1c536-1622-4505-9efa-e63b18136d12 None admin] PATH_INFO: `/v3/users/3c37bbe571ec415c9de778d6219de1a0` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:23.257011 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f1c536-1622-4505-9efa-e63b18136d12 None admin] RBAC: Authorizing `identity:get_user(user_id=3c37bbe571ec415c9de778d6219de1a0)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:23.258544 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f1c536-1622-4505-9efa-e63b18136d12 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:23.260235 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 41/82] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:57:23 2022] GET /identity/v3/users/3c37bbe571ec415c9de778d6219de1a0 => generated 275 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:23.261013 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1c536-1622-4505-9efa-e63b18136d12 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:23.292709 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:23.309460 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de2597-fcb8-4f6e-9d32-5690b7c7b237 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:23.342521 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe798dc-68d3-4bac-9fcc-289a503ce282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:23.343335 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe798dc-68d3-4bac-9fcc-289a503ce282 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:23.343626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe798dc-68d3-4bac-9fcc-289a503ce282 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:23.343911 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe798dc-68d3-4bac-9fcc-289a503ce282 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:23.353921 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe798dc-68d3-4bac-9fcc-289a503ce282 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:57:23.358199 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1c536-1622-4505-9efa-e63b18136d12 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:23.360453 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:23.361715 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-2fe798dc-68d3-4bac-9fcc-289a503ce282 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 03:57:23.361715 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:23.361715 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:23.361715 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:23.361715 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:23.361715 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:23.361715 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:23.361715 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:23.361715 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:23.361715 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:23.361715 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:23.361715 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:23.361715 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:57:23.361715 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:57:23.361715 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:57:23.361715 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:57:23.362777 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:57:23.362777 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:57:23.362777 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:57:23.362777 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:57:23.362777 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:23.362777 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:23.362777 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:23.362777 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:23.362777 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:23.362777 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:23.362777 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:23.362777 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:23.362777 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:23.362777 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:23.362777 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:23.362777 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:23.363688 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:23.363688 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:23.363688 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:23.363688 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:23.363688 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:57:23.363688 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:57:23.363688 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:57:23.363688 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:57:23.363688 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:57:23.363688 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:57:23.363688 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 03:57:23.363688 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:57:23.363688 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 42/83] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:57:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:57:23.364495 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe798dc-68d3-4bac-9fcc-289a503ce282 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:23.395574 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0377c33-80c9-4374-8bae-e93150545b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:23.396373 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0377c33-80c9-4374-8bae-e93150545b5e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:23.396665 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0377c33-80c9-4374-8bae-e93150545b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:23.396943 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0377c33-80c9-4374-8bae-e93150545b5e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:23.398104 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0377c33-80c9-4374-8bae-e93150545b5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:23.399667 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0377c33-80c9-4374-8bae-e93150545b5e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:23.401287 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 42/84] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:57:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:23.402049 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0377c33-80c9-4374-8bae-e93150545b5e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:23.465122 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe798dc-68d3-4bac-9fcc-289a503ce282 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:23.501120 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0377c33-80c9-4374-8bae-e93150545b5e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:23.501319 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5889773-0003-4a31-a91b-c060699643af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:23.502224 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5889773-0003-4a31-a91b-c060699643af None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:23.502535 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5889773-0003-4a31-a91b-c060699643af None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:23.502813 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5889773-0003-4a31-a91b-c060699643af None admin] PATH_INFO: `/v3/projects/f5159196cf6c47c79e3bf91601a42a40` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:23.504019 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5889773-0003-4a31-a91b-c060699643af None admin] RBAC: Authorizing `identity:get_project(project_id=f5159196cf6c47c79e3bf91601a42a40)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:23.505504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5889773-0003-4a31-a91b-c060699643af None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:23.507262 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 43/85] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:57:23 2022] GET /identity/v3/projects/f5159196cf6c47c79e3bf91601a42a40 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:23.508032 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5889773-0003-4a31-a91b-c060699643af None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:23.523598 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:23.540043 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5daec0-c278-4bd8-912f-b239a62aacb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:23.540924 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5daec0-c278-4bd8-912f-b239a62aacb8 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:23.541219 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5daec0-c278-4bd8-912f-b239a62aacb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:23.541504 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5daec0-c278-4bd8-912f-b239a62aacb8 None admin] PATH_INFO: `/v3/projects/f5159196cf6c47c79e3bf91601a42a40` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:23.542728 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5daec0-c278-4bd8-912f-b239a62aacb8 None admin] RBAC: Authorizing `identity:get_project(project_id=f5159196cf6c47c79e3bf91601a42a40)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:23.544199 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5daec0-c278-4bd8-912f-b239a62aacb8 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:23.545932 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 43/86] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:57:23 2022] GET /identity/v3/projects/f5159196cf6c47c79e3bf91601a42a40 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:23.546743 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5daec0-c278-4bd8-912f-b239a62aacb8 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:23.587528 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:23.612005 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5889773-0003-4a31-a91b-c060699643af None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:23.644015 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5daec0-c278-4bd8-912f-b239a62aacb8 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:23.646997 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c3d7c-a32c-43b4-a102-f924df3c24fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:23.647650 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c3d7c-a32c-43b4-a102-f924df3c24fc None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:23.647940 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c3d7c-a32c-43b4-a102-f924df3c24fc None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:23.648223 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c3d7c-a32c-43b4-a102-f924df3c24fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:23.677965 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88002cdb-6ccc-40d3-91ff-c6520ae33118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:23.678666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88002cdb-6ccc-40d3-91ff-c6520ae33118 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:23.678958 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88002cdb-6ccc-40d3-91ff-c6520ae33118 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:23.679248 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88002cdb-6ccc-40d3-91ff-c6520ae33118 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:23.680014 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88002cdb-6ccc-40d3-91ff-c6520ae33118 None admin] RBAC: Adding query filter params (name=member) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:23.680334 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88002cdb-6ccc-40d3-91ff-c6520ae33118 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:23.681769 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88002cdb-6ccc-40d3-91ff-c6520ae33118 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:23.689871 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 44/87] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Jul 4 03:57:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:23.690521 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88002cdb-6ccc-40d3-91ff-c6520ae33118 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:23.720223 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c3d7c-a32c-43b4-a102-f924df3c24fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:23.721675 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c3d7c-a32c-43b4-a102-f924df3c24fc None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:23.735457 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:23.789301 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88002cdb-6ccc-40d3-91ff-c6520ae33118 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:23.791246 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:23.819657 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 44/88] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:57:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 03:57:23.820504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c3d7c-a32c-43b4-a102-f924df3c24fc None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:23.824288 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82252f7b-7874-4b1c-9d08-150653397128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:23.824902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82252f7b-7874-4b1c-9d08-150653397128 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:23.825190 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82252f7b-7874-4b1c-9d08-150653397128 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:23.825470 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82252f7b-7874-4b1c-9d08-150653397128 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:23.826235 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82252f7b-7874-4b1c-9d08-150653397128 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:23.827698 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82252f7b-7874-4b1c-9d08-150653397128 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:23.848183 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 45/89] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Jul 4 03:57:23 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 03:57:23.848991 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82252f7b-7874-4b1c-9d08-150653397128 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:23.930809 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c3d7c-a32c-43b4-a102-f924df3c24fc None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:23.946056 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:23.970109 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e90e9-e9b9-42bf-a028-874bfb59c616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:23.970930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e90e9-e9b9-42bf-a028-874bfb59c616 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:23.971262 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e90e9-e9b9-42bf-a028-874bfb59c616 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:23.971550 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e90e9-e9b9-42bf-a028-874bfb59c616 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:23.972477 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218e90e9-e9b9-42bf-a028-874bfb59c616 None admin] RBAC: Adding query filter params (role.id=2eee98054d42475bb7e22a8487ab235e, scope.project.id=f5159196cf6c47c79e3bf91601a42a40, user.id=e4dc423a8fa8454bad29c9624cf55962) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:23.972847 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218e90e9-e9b9-42bf-a028-874bfb59c616 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:23.974406 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218e90e9-e9b9-42bf-a028-874bfb59c616 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:23.977107 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82252f7b-7874-4b1c-9d08-150653397128 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:23.990215 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 45/90] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:57:23 2022] GET /identity/v3/role_assignments?user.id=e4dc423a8fa8454bad29c9624cf55962&scope.project.id=f5159196cf6c47c79e3bf91601a42a40&role.id=2eee98054d42475bb7e22a8487ab235e => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:23.990215 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e90e9-e9b9-42bf-a028-874bfb59c616 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:24.034969 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b81b2-f957-4577-8e86-38bc80d8cdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:24.035670 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b81b2-f957-4577-8e86-38bc80d8cdce None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:24.035961 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b81b2-f957-4577-8e86-38bc80d8cdce None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:24.036247 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b81b2-f957-4577-8e86-38bc80d8cdce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:24.037122 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b81b2-f957-4577-8e86-38bc80d8cdce None admin] RBAC: Adding query filter params (role.id=8d92e2d53a9441a9b6ddaaad264ac4c9, scope.project.id=f5159196cf6c47c79e3bf91601a42a40, user.id=3c37bbe571ec415c9de778d6219de1a0) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:24.037445 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b81b2-f957-4577-8e86-38bc80d8cdce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:24.039255 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b81b2-f957-4577-8e86-38bc80d8cdce None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:24.048318 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 46/91] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:57:23 2022] GET /identity/v3/role_assignments?user.id=3c37bbe571ec415c9de778d6219de1a0&scope.project.id=f5159196cf6c47c79e3bf91601a42a40&role.id=8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:24.049071 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b81b2-f957-4577-8e86-38bc80d8cdce None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:24.084401 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:24.179991 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e90e9-e9b9-42bf-a028-874bfb59c616 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:24.205379 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b81b2-f957-4577-8e86-38bc80d8cdce None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:24.229824 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3748721-286f-4bf4-8f48-28ad964d339f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:24.231275 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3748721-286f-4bf4-8f48-28ad964d339f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:24.231757 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3748721-286f-4bf4-8f48-28ad964d339f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:24.232217 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3748721-286f-4bf4-8f48-28ad964d339f None admin] PATH_INFO: `/v3/users/3c37bbe571ec415c9de778d6219de1a0` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:24.236269 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3748721-286f-4bf4-8f48-28ad964d339f None admin] RBAC: Authorizing `identity:get_user(user_id=3c37bbe571ec415c9de778d6219de1a0)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:24.238360 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3748721-286f-4bf4-8f48-28ad964d339f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:24.241729 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 46/92] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:57:23 2022] GET /identity/v3/users/3c37bbe571ec415c9de778d6219de1a0 => generated 275 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:24.247703 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3748721-286f-4bf4-8f48-28ad964d339f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:24.258980 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea39ff-2841-4810-9f30-a125f97665d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:24.260016 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea39ff-2841-4810-9f30-a125f97665d5 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:24.260312 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea39ff-2841-4810-9f30-a125f97665d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:24.261356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea39ff-2841-4810-9f30-a125f97665d5 None admin] PATH_INFO: `/v3/projects/f5159196cf6c47c79e3bf91601a42a40` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:24.263147 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea39ff-2841-4810-9f30-a125f97665d5 None admin] RBAC: Authorizing `identity:get_project(project_id=f5159196cf6c47c79e3bf91601a42a40)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:24.264926 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea39ff-2841-4810-9f30-a125f97665d5 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:24.268888 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 47/93] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:57:24 2022] GET /identity/v3/projects/f5159196cf6c47c79e3bf91601a42a40 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:24.274547 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea39ff-2841-4810-9f30-a125f97665d5 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:24.313856 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:24.385888 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:24.391737 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3748721-286f-4bf4-8f48-28ad964d339f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:24.398778 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea39ff-2841-4810-9f30-a125f97665d5 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:24.436734 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276922e-14e7-4a56-a905-f133d2f59e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:24.437412 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276922e-14e7-4a56-a905-f133d2f59e7b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:24.437756 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276922e-14e7-4a56-a905-f133d2f59e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:24.438050 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276922e-14e7-4a56-a905-f133d2f59e7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:24.440870 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47681a-9eda-4d58-bbda-8acca150240d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:24.441694 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47681a-9eda-4d58-bbda-8acca150240d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:24.442145 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47681a-9eda-4d58-bbda-8acca150240d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:24.442644 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47681a-9eda-4d58-bbda-8acca150240d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:24.443752 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df47681a-9eda-4d58-bbda-8acca150240d None admin] RBAC: Adding query filter params (role.id=a34eb11c5d95402e94c1bc45e635e387, scope.project.id=f5159196cf6c47c79e3bf91601a42a40, user.id=3c37bbe571ec415c9de778d6219de1a0) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:24.444216 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df47681a-9eda-4d58-bbda-8acca150240d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:24.445825 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df47681a-9eda-4d58-bbda-8acca150240d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:24.452354 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 48/94] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:57:24 2022] GET /identity/v3/role_assignments?user.id=3c37bbe571ec415c9de778d6219de1a0&scope.project.id=f5159196cf6c47c79e3bf91601a42a40&role.id=a34eb11c5d95402e94c1bc45e635e387 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:57:24.516779 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0276922e-14e7-4a56-a905-f133d2f59e7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:24.518254 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0276922e-14e7-4a56-a905-f133d2f59e7b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:24.567605 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:24.628360 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 47/95] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:57:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 03:57:24.634139 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47681a-9eda-4d58-bbda-8acca150240d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:24.787852 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47681a-9eda-4d58-bbda-8acca150240d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:24.831300 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28be2d4-bcb8-4397-af71-bf113ca4b81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:24.832181 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28be2d4-bcb8-4397-af71-bf113ca4b81a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:24.832473 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28be2d4-bcb8-4397-af71-bf113ca4b81a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:24.832768 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28be2d4-bcb8-4397-af71-bf113ca4b81a None admin] PATH_INFO: `/v3/projects/d98e5e34095b408fa14e8136a08866bb` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:24.838972 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28be2d4-bcb8-4397-af71-bf113ca4b81a None admin] RBAC: Authorizing `identity:get_project(project_id=d98e5e34095b408fa14e8136a08866bb)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:24.840489 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28be2d4-bcb8-4397-af71-bf113ca4b81a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:24.842631 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 49/96] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:57:24 2022] GET /identity/v3/projects/d98e5e34095b408fa14e8136a08866bb => generated 312 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:24.848512 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276922e-14e7-4a56-a905-f133d2f59e7b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:24.986008 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276922e-14e7-4a56-a905-f133d2f59e7b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:25.040188 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266fc6b-1af1-48b9-81a3-f39eca0c82f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:25.040796 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266fc6b-1af1-48b9-81a3-f39eca0c82f0 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:25.041087 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266fc6b-1af1-48b9-81a3-f39eca0c82f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:25.041368 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266fc6b-1af1-48b9-81a3-f39eca0c82f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:25.042243 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266fc6b-1af1-48b9-81a3-f39eca0c82f0 None admin] RBAC: Adding query filter params (role.id=8d92e2d53a9441a9b6ddaaad264ac4c9, scope.project.id=d98e5e34095b408fa14e8136a08866bb, user.id=3c37bbe571ec415c9de778d6219de1a0) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:25.042569 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266fc6b-1af1-48b9-81a3-f39eca0c82f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:25.044059 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266fc6b-1af1-48b9-81a3-f39eca0c82f0 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:25.050263 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 48/97] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:57:24 2022] GET /identity/v3/role_assignments?user.id=3c37bbe571ec415c9de778d6219de1a0&scope.project.id=d98e5e34095b408fa14e8136a08866bb&role.id=8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:26.714699 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66493d7a-e8a7-4dd7-b819-0ba89c000c91 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:26.715258 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66493d7a-e8a7-4dd7-b819-0ba89c000c91 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:26.715258 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66493d7a-e8a7-4dd7-b819-0ba89c000c91 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:26.716783 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 50/98] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:26.722617 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422af76-af74-4c08-b5c9-5d2b8cc3ec14 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:26.723487 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422af76-af74-4c08-b5c9-5d2b8cc3ec14 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:26.723968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422af76-af74-4c08-b5c9-5d2b8cc3ec14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:26.741386 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-4422af76-af74-4c08-b5c9-5d2b8cc3ec14 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:26.743104 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4422af76-af74-4c08-b5c9-5d2b8cc3ec14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:26.745376 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:26.817764 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5faffd1-4259-448e-8081-520385af8a34 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:26.818448 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5faffd1-4259-448e-8081-520385af8a34 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:26.819056 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5faffd1-4259-448e-8081-520385af8a34 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:26.820652 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 51/99] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:26.826332 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ed186-cb05-4d6a-98ad-27e65b7e7ddf None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:26.826907 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ed186-cb05-4d6a-98ad-27e65b7e7ddf None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:26.827389 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ed186-cb05-4d6a-98ad-27e65b7e7ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:26.835236 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 49/100] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:26.851164 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-5e2ed186-cb05-4d6a-98ad-27e65b7e7ddf None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:26.852693 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-5e2ed186-cb05-4d6a-98ad-27e65b7e7ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:26.858675 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422af76-af74-4c08-b5c9-5d2b8cc3ec14 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:26.890529 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:26.973602 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 52/101] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 03:57:26.987252 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2109b4-ef7b-47d1-a5f8-0f67aef97571 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:26.987549 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2109b4-ef7b-47d1-a5f8-0f67aef97571 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:26.987841 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2109b4-ef7b-47d1-a5f8-0f67aef97571 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:26.989382 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 53/102] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:26.999546 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f7c40-7f16-403c-904c-845bf4f9fd88 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:26.999831 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f7c40-7f16-403c-904c-845bf4f9fd88 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:27.000119 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f7c40-7f16-403c-904c-845bf4f9fd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:27.036523 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-000f7c40-7f16-403c-904c-845bf4f9fd88 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:27.037723 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-000f7c40-7f16-403c-904c-845bf4f9fd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:27.061234 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422af76-af74-4c08-b5c9-5d2b8cc3ec14 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:27.124901 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68cc1e7-1d5d-48b3-9073-06664eb1fb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:27.125721 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cc1e7-1d5d-48b3-9073-06664eb1fb0f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:27.126010 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cc1e7-1d5d-48b3-9073-06664eb1fb0f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:27.126321 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cc1e7-1d5d-48b3-9073-06664eb1fb0f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:27.144298 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:27.150517 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68cc1e7-1d5d-48b3-9073-06664eb1fb0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:57:27.165221 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-b68cc1e7-1d5d-48b3-9073-06664eb1fb0f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 03:57:27.165221 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:27.165221 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:27.165221 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:27.165221 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:27.165221 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:27.165221 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:27.165221 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:27.165221 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:27.165221 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:27.165221 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:27.165221 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:27.165221 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:57:27.165221 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:57:27.165221 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:57:27.165221 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:57:27.166279 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:57:27.166279 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:57:27.166279 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:57:27.166279 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:57:27.166279 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:27.166279 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:27.166279 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:27.166279 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:27.166279 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:27.166279 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:27.166279 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:27.166279 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:27.166279 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:27.166279 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:27.166279 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:27.166279 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:27.167038 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:27.167038 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:27.167038 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:27.167038 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:27.167038 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:57:27.167038 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:57:27.167038 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:57:27.167038 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:57:27.167038 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:57:27.167038 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:57:27.167038 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 03:57:27.167038 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:57:27.168121 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 50/103] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:57:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:57:27.170670 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68cc1e7-1d5d-48b3-9073-06664eb1fb0f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:27.175227 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 54/104] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 03:57:27.176210 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f7c40-7f16-403c-904c-845bf4f9fd88 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:27.297164 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68cc1e7-1d5d-48b3-9073-06664eb1fb0f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:27.337769 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdef22a-74a5-4b8c-85f7-8af1482da32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:27.341135 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdef22a-74a5-4b8c-85f7-8af1482da32a None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:27.341439 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdef22a-74a5-4b8c-85f7-8af1482da32a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:27.341728 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdef22a-74a5-4b8c-85f7-8af1482da32a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:27.355534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdef22a-74a5-4b8c-85f7-8af1482da32a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:57:27.364932 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-8bdef22a-74a5-4b8c-85f7-8af1482da32a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 03:57:27.364932 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:27.364932 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:27.364932 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:27.364932 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:27.364932 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:27.364932 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:27.364932 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:27.364932 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:27.364932 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:27.364932 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:27.364932 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:27.364932 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:57:27.364932 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:57:27.364932 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:57:27.364932 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:57:27.365794 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:57:27.365794 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:57:27.365794 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:57:27.365794 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:57:27.365794 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:27.365794 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:27.365794 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:27.365794 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:27.365794 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:27.365794 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:27.365794 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:27.365794 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:27.365794 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:27.365794 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:27.365794 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:27.365794 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:27.371881 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:27.371881 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:27.371881 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:27.371881 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:27.371881 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:57:27.371881 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:57:27.371881 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:57:27.371881 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:57:27.371881 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:57:27.371881 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:57:27.371881 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 03:57:27.371881 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:57:27.371881 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 51/105] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:57:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:57:27.371881 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdef22a-74a5-4b8c-85f7-8af1482da32a None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:27.374647 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:27.391457 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f7c40-7f16-403c-904c-845bf4f9fd88 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:27.439150 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00237f-a4d6-4f9c-b4b4-fe2ca36d9c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:27.439837 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00237f-a4d6-4f9c-b4b4-fe2ca36d9c28 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:27.440206 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00237f-a4d6-4f9c-b4b4-fe2ca36d9c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:27.440522 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00237f-a4d6-4f9c-b4b4-fe2ca36d9c28 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:27.441139 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:27.442911 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00237f-a4d6-4f9c-b4b4-fe2ca36d9c28 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:27.443243 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00237f-a4d6-4f9c-b4b4-fe2ca36d9c28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:27.445289 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00237f-a4d6-4f9c-b4b4-fe2ca36d9c28 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:27.457795 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 55/106] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Jul 4 03:57:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:27.459213 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d711568-2109-4f8f-ad74-2c3aa03e205b None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:27.459579 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d711568-2109-4f8f-ad74-2c3aa03e205b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:27.459935 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d711568-2109-4f8f-ad74-2c3aa03e205b None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:27.461266 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 56/107] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:27.465348 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d711568-2109-4f8f-ad74-2c3aa03e205b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:27.494340 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdef22a-74a5-4b8c-85f7-8af1482da32a None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:27.535128 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c47f4-6302-42ab-a72d-f96a85dc5caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:27.536038 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c47f4-6302-42ab-a72d-f96a85dc5caa None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:27.536332 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c47f4-6302-42ab-a72d-f96a85dc5caa None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:27.536618 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c47f4-6302-42ab-a72d-f96a85dc5caa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:27.549328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c47f4-6302-42ab-a72d-f96a85dc5caa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:57:27.557077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-f44c47f4-6302-42ab-a72d-f96a85dc5caa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:57:27.557077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:27.557077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:27.557077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:27.557077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:27.557077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:27.557077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:27.557077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:27.557077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:27.557077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:27.557077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:27.557077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:27.557077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:57:27.557077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:57:27.557077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:57:27.557077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:57:27.557984 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:57:27.557984 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:57:27.557984 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:57:27.557984 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:57:27.557984 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:27.557984 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:27.557984 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:27.557984 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:27.557984 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:27.557984 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:27.557984 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:27.557984 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:27.557984 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:27.557984 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:27.557984 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:27.557984 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:27.559013 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:27.559013 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:27.559013 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:27.559013 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:27.559013 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:57:27.559013 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:57:27.559013 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:57:27.559013 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:57:27.559013 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:57:27.559013 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:57:27.559013 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:57:27.559013 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:57:27.559013 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 52/108] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Jul 4 03:57:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:57:27.559633 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c47f4-6302-42ab-a72d-f96a85dc5caa None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:27.590763 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d711568-2109-4f8f-ad74-2c3aa03e205b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:27.628293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21e417-43ce-4c01-9461-ad69f88cb960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:27.628981 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21e417-43ce-4c01-9461-ad69f88cb960 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:27.629275 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21e417-43ce-4c01-9461-ad69f88cb960 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:27.629560 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21e417-43ce-4c01-9461-ad69f88cb960 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:27.630364 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21e417-43ce-4c01-9461-ad69f88cb960 None admin] RBAC: Adding query filter params (name=member) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:27.630742 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21e417-43ce-4c01-9461-ad69f88cb960 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:27.632404 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21e417-43ce-4c01-9461-ad69f88cb960 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:27.641946 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 57/109] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Jul 4 03:57:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:27.643032 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc759e4-c33e-4b9e-8fb4-47b744b13031 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:27.643338 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc759e4-c33e-4b9e-8fb4-47b744b13031 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:27.643627 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc759e4-c33e-4b9e-8fb4-47b744b13031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:27.655374 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:27.660869 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-7fc759e4-c33e-4b9e-8fb4-47b744b13031 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:27.662826 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7fc759e4-c33e-4b9e-8fb4-47b744b13031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:27.670613 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c47f4-6302-42ab-a72d-f96a85dc5caa None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:27.688173 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:27.705128 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e83389-2328-4ef1-b6e7-e90d54d85168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:27.706023 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e83389-2328-4ef1-b6e7-e90d54d85168 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:27.706343 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e83389-2328-4ef1-b6e7-e90d54d85168 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:27.706654 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e83389-2328-4ef1-b6e7-e90d54d85168 None admin] PATH_INFO: `/v3/users/93fd9e230e4d4c80ab3e90ec8b6bd02c` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:27.720186 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e83389-2328-4ef1-b6e7-e90d54d85168 None admin] RBAC: Authorizing `identity:get_user(user_id=93fd9e230e4d4c80ab3e90ec8b6bd02c)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:27.721712 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e83389-2328-4ef1-b6e7-e90d54d85168 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:27.723481 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 53/110] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:57:27 2022] GET /identity/v3/users/93fd9e230e4d4c80ab3e90ec8b6bd02c => generated 289 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:27.728579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d346e74-a3af-4ce1-9ef9-77f33036cfa8 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:27.728579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d346e74-a3af-4ce1-9ef9-77f33036cfa8 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:27.728579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d346e74-a3af-4ce1-9ef9-77f33036cfa8 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:27.728579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 54/111] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:27.728579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d346e74-a3af-4ce1-9ef9-77f33036cfa8 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:27.742451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 58/112] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:27.743239 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc759e4-c33e-4b9e-8fb4-47b744b13031 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:27.839195 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d346e74-a3af-4ce1-9ef9-77f33036cfa8 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:27.860510 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc759e4-c33e-4b9e-8fb4-47b744b13031 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:27.874483 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55bab25-3a81-48c1-9610-1f160adcab6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:27.875240 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bab25-3a81-48c1-9610-1f160adcab6e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:27.875531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bab25-3a81-48c1-9610-1f160adcab6e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:27.875842 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bab25-3a81-48c1-9610-1f160adcab6e None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:27.876605 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55bab25-3a81-48c1-9610-1f160adcab6e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:27.876920 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55bab25-3a81-48c1-9610-1f160adcab6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:27.878445 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55bab25-3a81-48c1-9610-1f160adcab6e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:27.891432 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 55/113] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:57:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:27.896038 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55bab25-3a81-48c1-9610-1f160adcab6e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:27.900173 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7b6b6-90e0-4d16-a925-4610bc305fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:27.901069 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7b6b6-90e0-4d16-a925-4610bc305fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:27.901358 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7b6b6-90e0-4d16-a925-4610bc305fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:27.901638 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7b6b6-90e0-4d16-a925-4610bc305fb6 None admin] PATH_INFO: `/v3/users/3c37bbe571ec415c9de778d6219de1a0` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:27.902878 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d7b6b6-90e0-4d16-a925-4610bc305fb6 None admin] RBAC: Authorizing `identity:get_user(user_id=3c37bbe571ec415c9de778d6219de1a0)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:27.904354 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d7b6b6-90e0-4d16-a925-4610bc305fb6 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:27.910656 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 59/114] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:57:27 2022] GET /identity/v3/users/3c37bbe571ec415c9de778d6219de1a0 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:27.910656 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c248a-4611-43b2-bab4-0141548e985a None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:27.910656 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c248a-4611-43b2-bab4-0141548e985a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:27.910656 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c248a-4611-43b2-bab4-0141548e985a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:27.915154 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:27.926525 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-3b3c248a-4611-43b2-bab4-0141548e985a None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:27.927724 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3b3c248a-4611-43b2-bab4-0141548e985a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:27.942922 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:28.010192 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 60/115] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:28.010192 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c248a-4611-43b2-bab4-0141548e985a None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:28.010485 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55bab25-3a81-48c1-9610-1f160adcab6e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:28.039911 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef04cd3-8926-45f8-a363-d660b4c2c6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:28.040551 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef04cd3-8926-45f8-a363-d660b4c2c6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:28.040843 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef04cd3-8926-45f8-a363-d660b4c2c6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:28.041245 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef04cd3-8926-45f8-a363-d660b4c2c6f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:28.114882 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c248a-4611-43b2-bab4-0141548e985a None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:28.116134 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef04cd3-8926-45f8-a363-d660b4c2c6f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:28.117664 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef04cd3-8926-45f8-a363-d660b4c2c6f9 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:28.150124 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd525948-0949-4304-aa74-4b960b2a8177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:28.150971 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd525948-0949-4304-aa74-4b960b2a8177 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:28.151259 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd525948-0949-4304-aa74-4b960b2a8177 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:28.151541 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd525948-0949-4304-aa74-4b960b2a8177 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:28.153397 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:28.157469 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:28.163110 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd525948-0949-4304-aa74-4b960b2a8177 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:57:28.171326 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-dd525948-0949-4304-aa74-4b960b2a8177 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 03:57:28.171326 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:28.171326 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:28.171326 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:28.171326 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:28.171326 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:28.171326 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:28.171326 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:28.171326 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:28.171326 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:28.171326 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:28.171326 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:28.171326 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:57:28.171326 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:57:28.171326 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:57:28.171326 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:57:28.172347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:57:28.172347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:57:28.172347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:57:28.172347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:57:28.172347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:28.172347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:28.172347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:28.172347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:28.172347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:28.172347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:28.172347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:28.172347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:28.172347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:28.172347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:28.172347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:28.172347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:28.173299 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:28.173299 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:28.173299 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:28.173299 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:28.173299 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:57:28.173299 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:57:28.173299 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:57:28.173299 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:57:28.173299 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:57:28.173299 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:57:28.173299 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 03:57:28.173299 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:57:28.173299 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 61/116] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Jul 4 03:57:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:57:28.173986 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd525948-0949-4304-aa74-4b960b2a8177 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:28.223898 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 56/117] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:57:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 03:57:28.224750 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef04cd3-8926-45f8-a363-d660b4c2c6f9 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:28.275178 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd525948-0949-4304-aa74-4b960b2a8177 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:28.307593 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19372c65-5ee7-4ee8-82e1-51733092cd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:28.308476 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19372c65-5ee7-4ee8-82e1-51733092cd4e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:28.308772 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19372c65-5ee7-4ee8-82e1-51733092cd4e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:28.309059 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19372c65-5ee7-4ee8-82e1-51733092cd4e None admin] PATH_INFO: `/v3/users/e4dc423a8fa8454bad29c9624cf55962` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:28.310319 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19372c65-5ee7-4ee8-82e1-51733092cd4e None admin] RBAC: Authorizing `identity:get_user(user_id=e4dc423a8fa8454bad29c9624cf55962)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:28.311805 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19372c65-5ee7-4ee8-82e1-51733092cd4e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:28.313456 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 62/118] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:57:28 2022] GET /identity/v3/users/e4dc423a8fa8454bad29c9624cf55962 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:28.314274 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19372c65-5ee7-4ee8-82e1-51733092cd4e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:28.321810 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef04cd3-8926-45f8-a363-d660b4c2c6f9 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:28.356053 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972fc88-b761-44b7-bc8a-f3b689a2d421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:28.356932 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972fc88-b761-44b7-bc8a-f3b689a2d421 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:28.357216 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972fc88-b761-44b7-bc8a-f3b689a2d421 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:28.357480 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972fc88-b761-44b7-bc8a-f3b689a2d421 None admin] PATH_INFO: `/v3/projects/f5159196cf6c47c79e3bf91601a42a40` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:28.358735 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8972fc88-b761-44b7-bc8a-f3b689a2d421 None admin] RBAC: Authorizing `identity:get_project(project_id=f5159196cf6c47c79e3bf91601a42a40)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:28.360238 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8972fc88-b761-44b7-bc8a-f3b689a2d421 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:28.366747 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 57/119] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:57:28 2022] GET /identity/v3/projects/f5159196cf6c47c79e3bf91601a42a40 => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:28.366747 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf930de7-672a-4c8e-8032-1176fadd2f3c None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:28.366747 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf930de7-672a-4c8e-8032-1176fadd2f3c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:28.366747 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf930de7-672a-4c8e-8032-1176fadd2f3c None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:28.366747 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 58/120] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:28.366747 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf930de7-672a-4c8e-8032-1176fadd2f3c None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:28.376632 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:28.378078 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:28.417230 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19372c65-5ee7-4ee8-82e1-51733092cd4e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:28.449629 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe45edf-8cd1-40d6-9a68-fe0dac7062bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:28.450497 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe45edf-8cd1-40d6-9a68-fe0dac7062bd None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:28.450790 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe45edf-8cd1-40d6-9a68-fe0dac7062bd None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:28.451077 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe45edf-8cd1-40d6-9a68-fe0dac7062bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:28.452251 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe45edf-8cd1-40d6-9a68-fe0dac7062bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:28.453728 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe45edf-8cd1-40d6-9a68-fe0dac7062bd None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:28.455424 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 63/121] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:57:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:28.456189 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe45edf-8cd1-40d6-9a68-fe0dac7062bd None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:28.470132 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf930de7-672a-4c8e-8032-1176fadd2f3c None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:28.504417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47a6c9-a6fd-4864-b51d-70101a188cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:28.505101 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47a6c9-a6fd-4864-b51d-70101a188cce None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:28.505395 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47a6c9-a6fd-4864-b51d-70101a188cce None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:28.505683 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47a6c9-a6fd-4864-b51d-70101a188cce None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:28.506475 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df47a6c9-a6fd-4864-b51d-70101a188cce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:28.506798 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df47a6c9-a6fd-4864-b51d-70101a188cce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:28.508220 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df47a6c9-a6fd-4864-b51d-70101a188cce None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:28.516644 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 59/122] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:57:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:28.517587 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47a6c9-a6fd-4864-b51d-70101a188cce None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:28.560771 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe45edf-8cd1-40d6-9a68-fe0dac7062bd None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:28.583405 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:28.588289 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:28.594612 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9d273-ead3-4b47-b6a7-f0e67d04250b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:28.595492 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9d273-ead3-4b47-b6a7-f0e67d04250b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:28.595789 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9d273-ead3-4b47-b6a7-f0e67d04250b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:28.596072 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9d273-ead3-4b47-b6a7-f0e67d04250b None admin] PATH_INFO: `/v3/projects/f5159196cf6c47c79e3bf91601a42a40` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:28.597319 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c9d273-ead3-4b47-b6a7-f0e67d04250b None admin] RBAC: Authorizing `identity:get_project(project_id=f5159196cf6c47c79e3bf91601a42a40)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:28.598838 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c9d273-ead3-4b47-b6a7-f0e67d04250b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:28.600798 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 64/123] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:57:28 2022] GET /identity/v3/projects/f5159196cf6c47c79e3bf91601a42a40 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:28.601327 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9d273-ead3-4b47-b6a7-f0e67d04250b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:28.617035 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47a6c9-a6fd-4864-b51d-70101a188cce None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:28.650281 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3027f00-ee55-4789-bc22-9d33d3e9d5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:28.651166 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3027f00-ee55-4789-bc22-9d33d3e9d5ce None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:28.651458 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3027f00-ee55-4789-bc22-9d33d3e9d5ce None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:28.651746 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3027f00-ee55-4789-bc22-9d33d3e9d5ce None admin] PATH_INFO: `/v3/projects/f5159196cf6c47c79e3bf91601a42a40` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:28.652952 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3027f00-ee55-4789-bc22-9d33d3e9d5ce None admin] RBAC: Authorizing `identity:get_project(project_id=f5159196cf6c47c79e3bf91601a42a40)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:28.654475 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3027f00-ee55-4789-bc22-9d33d3e9d5ce None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:28.656234 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 60/124] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:57:28 2022] GET /identity/v3/projects/f5159196cf6c47c79e3bf91601a42a40 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:28.657338 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3fc8c-cea0-417d-ae8f-1b419007227a None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:28.657631 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3fc8c-cea0-417d-ae8f-1b419007227a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:28.657917 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3fc8c-cea0-417d-ae8f-1b419007227a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:28.674767 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e7e3fc8c-cea0-417d-ae8f-1b419007227a None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:28.676738 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e7e3fc8c-cea0-417d-ae8f-1b419007227a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:28.704689 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9d273-ead3-4b47-b6a7-f0e67d04250b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:28.738329 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7d91b-ecce-422b-ab91-cf1e74144452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:28.739240 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7d91b-ecce-422b-ab91-cf1e74144452 None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:28.739535 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7d91b-ecce-422b-ab91-cf1e74144452 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:28.739820 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7d91b-ecce-422b-ab91-cf1e74144452 None admin] PATH_INFO: `/v3/projects/f5159196cf6c47c79e3bf91601a42a40/users/3c37bbe571ec415c9de778d6219de1a0/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:28.741801 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7d91b-ecce-422b-ab91-cf1e74144452 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5159196cf6c47c79e3bf91601a42a40, user_id=3c37bbe571ec415c9de778d6219de1a0, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:28.743405 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7d91b-ecce-422b-ab91-cf1e74144452 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:28.743953 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 61/125] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:28.744633 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3fc8c-cea0-417d-ae8f-1b419007227a None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:28.763883 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 65/126] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Jul 4 03:57:28 2022] PUT /identity/v3/projects/f5159196cf6c47c79e3bf91601a42a40/users/3c37bbe571ec415c9de778d6219de1a0/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 03:57:28.774482 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7d91b-ecce-422b-ab91-cf1e74144452 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:28.827478 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:28.837504 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:28.866622 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3fc8c-cea0-417d-ae8f-1b419007227a None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:28.889417 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7d91b-ecce-422b-ab91-cf1e74144452 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:28.902716 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8e923-8047-473d-81d5-f1161897b3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:28.903408 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8e923-8047-473d-81d5-f1161897b3c8 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:28.903701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8e923-8047-473d-81d5-f1161897b3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:28.903984 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8e923-8047-473d-81d5-f1161897b3c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:28.904721 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8e923-8047-473d-81d5-f1161897b3c8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:28.906298 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8e923-8047-473d-81d5-f1161897b3c8 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:28.932668 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39468aea-e3b3-401c-855e-772b136ca3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:28.933607 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39468aea-e3b3-401c-855e-772b136ca3d8 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:28.933897 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39468aea-e3b3-401c-855e-772b136ca3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:28.934227 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39468aea-e3b3-401c-855e-772b136ca3d8 None admin] PATH_INFO: `/v3/users/3c37bbe571ec415c9de778d6219de1a0` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:28.935413 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39468aea-e3b3-401c-855e-772b136ca3d8 None admin] RBAC: Authorizing `identity:get_user(user_id=3c37bbe571ec415c9de778d6219de1a0)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:28.936889 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39468aea-e3b3-401c-855e-772b136ca3d8 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:28.942242 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 66/127] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:57:28 2022] GET /identity/v3/users/3c37bbe571ec415c9de778d6219de1a0 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:28.942242 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39468aea-e3b3-401c-855e-772b136ca3d8 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:28.944216 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 62/128] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Jul 4 03:57:28 2022] POST /identity/v3/projects => generated 302 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 03:57:28.945076 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8e923-8047-473d-81d5-f1161897b3c8 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:29.061939 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39468aea-e3b3-401c-855e-772b136ca3d8 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:29.073751 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8e923-8047-473d-81d5-f1161897b3c8 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:29.092060 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:29.094484 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:29.106221 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce63b02-eedb-4bec-be19-d33294ca7dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:29.106947 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce63b02-eedb-4bec-be19-d33294ca7dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:29.107240 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce63b02-eedb-4bec-be19-d33294ca7dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:29.107528 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce63b02-eedb-4bec-be19-d33294ca7dd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:29.108745 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce63b02-eedb-4bec-be19-d33294ca7dd7 None admin] RBAC: Adding query filter params (role.id=99db92117d0048efaae5874a11d96ce9, scope.project.id=f5159196cf6c47c79e3bf91601a42a40, user.id=93fd9e230e4d4c80ab3e90ec8b6bd02c) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:29.109083 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce63b02-eedb-4bec-be19-d33294ca7dd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:29.110669 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce63b02-eedb-4bec-be19-d33294ca7dd7 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:29.117097 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 67/129] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:57:28 2022] GET /identity/v3/role_assignments?user.id=93fd9e230e4d4c80ab3e90ec8b6bd02c&scope.project.id=f5159196cf6c47c79e3bf91601a42a40&role.id=99db92117d0048efaae5874a11d96ce9 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:29.118066 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce63b02-eedb-4bec-be19-d33294ca7dd7 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:29.120678 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0a5ff-f293-4d1d-bdc5-b2343a50b224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:29.121883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0a5ff-f293-4d1d-bdc5-b2343a50b224 None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:29.122460 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0a5ff-f293-4d1d-bdc5-b2343a50b224 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:29.122963 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0a5ff-f293-4d1d-bdc5-b2343a50b224 None admin] PATH_INFO: `/v3/projects/f5159196cf6c47c79e3bf91601a42a40/users/e4dc423a8fa8454bad29c9624cf55962/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:29.126079 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b0a5ff-f293-4d1d-bdc5-b2343a50b224 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5159196cf6c47c79e3bf91601a42a40, user_id=e4dc423a8fa8454bad29c9624cf55962, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:29.127699 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b0a5ff-f293-4d1d-bdc5-b2343a50b224 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:29.148039 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 63/130] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Jul 4 03:57:28 2022] PUT /identity/v3/projects/f5159196cf6c47c79e3bf91601a42a40/users/e4dc423a8fa8454bad29c9624cf55962/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 03:57:29.151851 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0a5ff-f293-4d1d-bdc5-b2343a50b224 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:29.255375 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce63b02-eedb-4bec-be19-d33294ca7dd7 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:29.296136 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40faa48-8c0b-4e34-896b-2cd9a3a94cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:29.297049 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40faa48-8c0b-4e34-896b-2cd9a3a94cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:29.297247 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40faa48-8c0b-4e34-896b-2cd9a3a94cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:29.297550 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40faa48-8c0b-4e34-896b-2cd9a3a94cf8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:29.303872 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0a5ff-f293-4d1d-bdc5-b2343a50b224 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:29.310398 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40faa48-8c0b-4e34-896b-2cd9a3a94cf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:57:29.318685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-d40faa48-8c0b-4e34-896b-2cd9a3a94cf8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 03:57:29.318685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:29.318685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:29.318685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:29.318685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:29.318685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:29.318685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:29.318685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:29.318685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:29.318685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:29.318685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:29.318685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:29.318685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:57:29.318685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:57:29.318685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:57:29.318685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:57:29.319690 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:57:29.319690 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:57:29.319690 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:57:29.319690 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:57:29.319690 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:29.319690 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:29.319690 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:29.319690 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:29.319690 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:29.319690 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:29.319690 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:29.319690 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:29.319690 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:29.319690 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:29.319690 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:29.319690 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:29.320449 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:29.320449 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:29.320449 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:29.320449 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:29.320449 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:57:29.320449 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:57:29.320449 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:57:29.320449 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:57:29.320449 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:57:29.320449 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:57:29.320449 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 03:57:29.320449 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:57:29.320449 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 68/131] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:57:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:57:29.326767 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40faa48-8c0b-4e34-896b-2cd9a3a94cf8 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:29.359613 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb3216-88c3-40e1-8a88-3c3658cc53f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:29.361013 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb3216-88c3-40e1-8a88-3c3658cc53f9 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:29.361728 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb3216-88c3-40e1-8a88-3c3658cc53f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:29.362193 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb3216-88c3-40e1-8a88-3c3658cc53f9 None admin] PATH_INFO: `/v3/projects/f5159196cf6c47c79e3bf91601a42a40` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:29.364245 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb3216-88c3-40e1-8a88-3c3658cc53f9 None admin] RBAC: Authorizing `identity:get_project(project_id=f5159196cf6c47c79e3bf91601a42a40)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:29.366951 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb3216-88c3-40e1-8a88-3c3658cc53f9 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:29.374998 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 64/132] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:57:29 2022] GET /identity/v3/projects/f5159196cf6c47c79e3bf91601a42a40 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:29.376264 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb3216-88c3-40e1-8a88-3c3658cc53f9 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:29.401176 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:29.438543 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:29.489771 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40faa48-8c0b-4e34-896b-2cd9a3a94cf8 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:29.512690 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb3216-88c3-40e1-8a88-3c3658cc53f9 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:29.528305 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa66773-10be-41eb-9e2b-772db0babc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:29.529477 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa66773-10be-41eb-9e2b-772db0babc1d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:29.529958 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa66773-10be-41eb-9e2b-772db0babc1d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:29.530502 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa66773-10be-41eb-9e2b-772db0babc1d None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:29.531552 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa66773-10be-41eb-9e2b-772db0babc1d None admin] RBAC: Adding query filter params (name=member) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:29.532076 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa66773-10be-41eb-9e2b-772db0babc1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:29.533739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa66773-10be-41eb-9e2b-772db0babc1d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:29.544532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 69/133] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Jul 4 03:57:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:57:29.550017 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa66773-10be-41eb-9e2b-772db0babc1d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:29.579108 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb29f4-97c8-4eaf-a85a-e8d761276e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:29.582953 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb29f4-97c8-4eaf-a85a-e8d761276e73 None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:29.583480 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb29f4-97c8-4eaf-a85a-e8d761276e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:29.583962 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb29f4-97c8-4eaf-a85a-e8d761276e73 None admin] PATH_INFO: `/v3/projects/f5159196cf6c47c79e3bf91601a42a40/users/3c37bbe571ec415c9de778d6219de1a0/roles/a34eb11c5d95402e94c1bc45e635e387` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:29.589168 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb29f4-97c8-4eaf-a85a-e8d761276e73 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5159196cf6c47c79e3bf91601a42a40, user_id=3c37bbe571ec415c9de778d6219de1a0, role_id=a34eb11c5d95402e94c1bc45e635e387)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:29.592340 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb29f4-97c8-4eaf-a85a-e8d761276e73 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:29.625525 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 65/134] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Jul 4 03:57:29 2022] PUT /identity/v3/projects/f5159196cf6c47c79e3bf91601a42a40/users/3c37bbe571ec415c9de778d6219de1a0/roles/a34eb11c5d95402e94c1bc45e635e387 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 03:57:29.697043 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa66773-10be-41eb-9e2b-772db0babc1d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:29.711177 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:29.735633 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda37536-1f88-4c06-b7ec-e092d82be69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:29.736552 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda37536-1f88-4c06-b7ec-e092d82be69f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:29.736840 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda37536-1f88-4c06-b7ec-e092d82be69f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:29.737122 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda37536-1f88-4c06-b7ec-e092d82be69f None admin] PATH_INFO: `/v3/users/3c37bbe571ec415c9de778d6219de1a0` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:29.738442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda37536-1f88-4c06-b7ec-e092d82be69f None admin] RBAC: Authorizing `identity:get_user(user_id=3c37bbe571ec415c9de778d6219de1a0)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:29.740130 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda37536-1f88-4c06-b7ec-e092d82be69f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:29.742023 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 70/135] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:57:29 2022] GET /identity/v3/users/3c37bbe571ec415c9de778d6219de1a0 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:29.752029 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb29f4-97c8-4eaf-a85a-e8d761276e73 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:29.879404 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb29f4-97c8-4eaf-a85a-e8d761276e73 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:29.887307 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:29.924319 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4cf84b-c20c-4b66-8758-fa6061dddb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:29.925257 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cf84b-c20c-4b66-8758-fa6061dddb97 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:29.925547 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cf84b-c20c-4b66-8758-fa6061dddb97 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:29.925828 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cf84b-c20c-4b66-8758-fa6061dddb97 None admin] PATH_INFO: `/v3/projects/d98e5e34095b408fa14e8136a08866bb` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:29.931085 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4cf84b-c20c-4b66-8758-fa6061dddb97 None admin] RBAC: Authorizing `identity:get_project(project_id=d98e5e34095b408fa14e8136a08866bb)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:29.932721 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4cf84b-c20c-4b66-8758-fa6061dddb97 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:29.934562 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 66/136] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:57:29 2022] GET /identity/v3/projects/d98e5e34095b408fa14e8136a08866bb => generated 312 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:29.940349 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda37536-1f88-4c06-b7ec-e092d82be69f None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:30.081095 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda37536-1f88-4c06-b7ec-e092d82be69f None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:30.120912 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ba837-40ae-413e-847e-725066a5f4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:30.121827 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ba837-40ae-413e-847e-725066a5f4f4 None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:30.122117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ba837-40ae-413e-847e-725066a5f4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:30.122434 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ba837-40ae-413e-847e-725066a5f4f4 None admin] PATH_INFO: `/v3/projects/d98e5e34095b408fa14e8136a08866bb/users/3c37bbe571ec415c9de778d6219de1a0/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:30.124439 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7ba837-40ae-413e-847e-725066a5f4f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=d98e5e34095b408fa14e8136a08866bb, user_id=3c37bbe571ec415c9de778d6219de1a0, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:30.125923 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7ba837-40ae-413e-847e-725066a5f4f4 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:30.144361 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 71/137] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Jul 4 03:57:29 2022] PUT /identity/v3/projects/d98e5e34095b408fa14e8136a08866bb/users/3c37bbe571ec415c9de778d6219de1a0/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 03:57:31.421568 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2eab09-3f73-4835-acc0-ba90af1b0fe7 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:31.422210 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2eab09-3f73-4835-acc0-ba90af1b0fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:31.422210 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2eab09-3f73-4835-acc0-ba90af1b0fe7 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:31.423673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 67/138] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:31.429417 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc439d63-2096-4d69-be19-1815a25b151e None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:31.429955 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc439d63-2096-4d69-be19-1815a25b151e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:31.430047 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc439d63-2096-4d69-be19-1815a25b151e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:31.453018 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-fc439d63-2096-4d69-be19-1815a25b151e None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:31.454278 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-fc439d63-2096-4d69-be19-1815a25b151e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:31.502094 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:31.552855 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 72/139] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:31.588786 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2eab09-3f73-4835-acc0-ba90af1b0fe7 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:31.717190 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2eab09-3f73-4835-acc0-ba90af1b0fe7 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:31.767549 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af3095-e7af-41d9-945a-0b83cb64e1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:31.768377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af3095-e7af-41d9-945a-0b83cb64e1c0 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:31.768670 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af3095-e7af-41d9-945a-0b83cb64e1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:31.768957 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af3095-e7af-41d9-945a-0b83cb64e1c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:31.780407 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af3095-e7af-41d9-945a-0b83cb64e1c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:57:31.788295 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-95af3095-e7af-41d9-945a-0b83cb64e1c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 03:57:31.788295 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:31.788295 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:31.788295 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:31.788295 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:31.788295 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:31.788295 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:31.788295 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:31.788295 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:31.788295 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:31.788295 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:31.788295 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:31.788295 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:57:31.788295 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:57:31.788295 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:57:31.788295 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:57:31.789197 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:57:31.789197 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:57:31.789197 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:57:31.789197 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:57:31.789197 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:31.789197 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:31.789197 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:31.789197 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:31.789197 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:31.789197 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:31.789197 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:31.789197 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:31.789197 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:31.789197 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:31.789197 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:31.789197 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:31.790031 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:31.790031 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:31.790031 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:31.790031 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:31.790031 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:57:31.790031 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:57:31.790031 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:57:31.790031 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:57:31.790031 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:57:31.790031 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:57:31.790031 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 03:57:31.790031 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:57:31.790031 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 68/140] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:57:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:57:31.796140 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc439d63-2096-4d69-be19-1815a25b151e None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:31.949950 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc439d63-2096-4d69-be19-1815a25b151e None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:31.999816 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6f1c7-f861-472f-8249-2c47f3afdf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:32.000496 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6f1c7-f861-472f-8249-2c47f3afdf8a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:32.000780 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6f1c7-f861-472f-8249-2c47f3afdf8a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:32.001055 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6f1c7-f861-472f-8249-2c47f3afdf8a None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:32.001816 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6f1c7-f861-472f-8249-2c47f3afdf8a None admin] RBAC: Adding query filter params (name=member) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:32.002122 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6f1c7-f861-472f-8249-2c47f3afdf8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:32.003547 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6f1c7-f861-472f-8249-2c47f3afdf8a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:32.018515 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 73/141] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Jul 4 03:57:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:32.024055 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af3095-e7af-41d9-945a-0b83cb64e1c0 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:32.086542 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:32.148004 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af3095-e7af-41d9-945a-0b83cb64e1c0 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:32.183098 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabed53f-97c2-48d8-b1e5-7ce2a70acc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:32.184001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabed53f-97c2-48d8-b1e5-7ce2a70acc74 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:32.184295 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabed53f-97c2-48d8-b1e5-7ce2a70acc74 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:32.184581 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabed53f-97c2-48d8-b1e5-7ce2a70acc74 None admin] PATH_INFO: `/v3/users/3c37bbe571ec415c9de778d6219de1a0` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:32.185815 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabed53f-97c2-48d8-b1e5-7ce2a70acc74 None admin] RBAC: Authorizing `identity:get_user(user_id=3c37bbe571ec415c9de778d6219de1a0)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:32.187360 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabed53f-97c2-48d8-b1e5-7ce2a70acc74 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:32.189345 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 69/142] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:57:32 2022] GET /identity/v3/users/3c37bbe571ec415c9de778d6219de1a0 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:32.194923 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6f1c7-f861-472f-8249-2c47f3afdf8a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:32.228105 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:32.251175 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93360dc8-2f2c-499f-a1de-f7f2ae5a6e41 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:32.251499 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93360dc8-2f2c-499f-a1de-f7f2ae5a6e41 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:32.251756 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93360dc8-2f2c-499f-a1de-f7f2ae5a6e41 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:32.253173 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 70/143] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 03:57:32.259148 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8ca7c-a716-47ce-b686-adfb9503da84 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:32.259467 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8ca7c-a716-47ce-b686-adfb9503da84 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:32.259737 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8ca7c-a716-47ce-b686-adfb9503da84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:32.292623 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-11d8ca7c-a716-47ce-b686-adfb9503da84 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:32.293847 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-11d8ca7c-a716-47ce-b686-adfb9503da84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:32.367185 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6f1c7-f861-472f-8249-2c47f3afdf8a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:32.407179 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5bf3d-cccc-4546-8258-33582c77776e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:32.408464 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5bf3d-cccc-4546-8258-33582c77776e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:32.409188 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5bf3d-cccc-4546-8258-33582c77776e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:32.409706 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5bf3d-cccc-4546-8258-33582c77776e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:32.419429 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 71/144] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:32.426279 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77173f-397e-4e07-b69d-6871a75b79f5 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:32.426279 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77173f-397e-4e07-b69d-6871a75b79f5 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:32.426279 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77173f-397e-4e07-b69d-6871a75b79f5 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:32.426279 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 72/145] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:32.433979 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b90b71-c93b-4a10-96d0-e78ad2152681 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:32.434303 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b90b71-c93b-4a10-96d0-e78ad2152681 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:32.434593 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b90b71-c93b-4a10-96d0-e78ad2152681 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:32.435915 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 73/146] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:32 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:32.436989 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6102a-0aa5-475a-b75b-3697d3ffa0e7 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:32.437284 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6102a-0aa5-475a-b75b-3697d3ffa0e7 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:32.438347 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6102a-0aa5-475a-b75b-3697d3ffa0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:32.467551 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-90b6102a-0aa5-475a-b75b-3697d3ffa0e7 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:32.469927 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-90b6102a-0aa5-475a-b75b-3697d3ffa0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:32.504162 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:32.509527 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e5bf3d-cccc-4546-8258-33582c77776e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:32.512547 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e5bf3d-cccc-4546-8258-33582c77776e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:32.546070 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:32.555346 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 74/147] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:32.564118 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359023b9-9398-45b2-8be6-6d7f499a6bfb None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:32.564630 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359023b9-9398-45b2-8be6-6d7f499a6bfb None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:32.565079 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359023b9-9398-45b2-8be6-6d7f499a6bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:32.591149 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-359023b9-9398-45b2-8be6-6d7f499a6bfb None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:32.592642 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-359023b9-9398-45b2-8be6-6d7f499a6bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:32.620572 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 74/148] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:57:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 03:57:32.621858 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5bf3d-cccc-4546-8258-33582c77776e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:32.671685 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 75/149] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:32.672895 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359023b9-9398-45b2-8be6-6d7f499a6bfb None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:32.753342 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5bf3d-cccc-4546-8258-33582c77776e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:32.766287 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:32.775001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359023b9-9398-45b2-8be6-6d7f499a6bfb None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:32.787641 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:32.794529 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22920c83-a4be-4cd1-90a2-35e848df3d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:32.795636 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22920c83-a4be-4cd1-90a2-35e848df3d2a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:32.796128 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22920c83-a4be-4cd1-90a2-35e848df3d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:32.796597 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22920c83-a4be-4cd1-90a2-35e848df3d2a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:32.808440 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22920c83-a4be-4cd1-90a2-35e848df3d2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:57:32.812260 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53928c5c-c4ed-4b8e-8f1f-d8c5ece08c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:32.813300 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53928c5c-c4ed-4b8e-8f1f-d8c5ece08c70 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:32.813746 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53928c5c-c4ed-4b8e-8f1f-d8c5ece08c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:32.814204 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53928c5c-c4ed-4b8e-8f1f-d8c5ece08c70 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:32.815632 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53928c5c-c4ed-4b8e-8f1f-d8c5ece08c70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:32.817365 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53928c5c-c4ed-4b8e-8f1f-d8c5ece08c70 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:32.817643 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-22920c83-a4be-4cd1-90a2-35e848df3d2a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 03:57:32.817643 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:32.817643 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:32.817643 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:32.817643 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:32.817643 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:32.817643 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:32.817643 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:32.817643 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:32.817643 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:32.817643 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:32.817643 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:32.817643 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:57:32.817643 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:57:32.817643 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:57:32.817643 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:57:32.818609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:57:32.818609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:57:32.818609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:57:32.818609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:57:32.818609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:32.818609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:32.818609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:32.818609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:32.818609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:32.818609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:32.818609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:32.818609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:32.818609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:32.818609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:32.818609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:32.818609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:32.819375 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:32.819375 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:32.819375 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:32.819375 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:32.819375 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:57:32.819375 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:57:32.819375 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:57:32.819375 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:57:32.819375 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:57:32.819375 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:57:32.819375 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 03:57:32.819375 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:57:32.819375 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 75/150] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:57:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:57:32.826616 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22920c83-a4be-4cd1-90a2-35e848df3d2a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:32.826853 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 76/151] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:57:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:32.827959 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53928c5c-c4ed-4b8e-8f1f-d8c5ece08c70 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:32.932896 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53928c5c-c4ed-4b8e-8f1f-d8c5ece08c70 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:32.933134 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22920c83-a4be-4cd1-90a2-35e848df3d2a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:32.975313 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba258ca3-1b7e-4350-8352-009503f278a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:32.975474 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a5369-681c-4a12-91fc-f7ce01316733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:32.976208 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba258ca3-1b7e-4350-8352-009503f278a2 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:32.976327 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a5369-681c-4a12-91fc-f7ce01316733 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:32.976499 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba258ca3-1b7e-4350-8352-009503f278a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:32.976589 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a5369-681c-4a12-91fc-f7ce01316733 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:32.976785 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a5369-681c-4a12-91fc-f7ce01316733 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:32.976874 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba258ca3-1b7e-4350-8352-009503f278a2 None admin] PATH_INFO: `/v3/projects/f5159196cf6c47c79e3bf91601a42a40` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:32.978125 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba258ca3-1b7e-4350-8352-009503f278a2 None admin] RBAC: Authorizing `identity:get_project(project_id=f5159196cf6c47c79e3bf91601a42a40)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:32.980181 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba258ca3-1b7e-4350-8352-009503f278a2 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:32.981923 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 76/152] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:57:32 2022] GET /identity/v3/projects/f5159196cf6c47c79e3bf91601a42a40 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:32.987438 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba258ca3-1b7e-4350-8352-009503f278a2 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:32.987687 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a5369-681c-4a12-91fc-f7ce01316733 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:57:32.995531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-682a5369-681c-4a12-91fc-f7ce01316733 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:57:32.995531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:32.995531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:32.995531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:32.995531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:32.995531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:32.995531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:32.995531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:32.995531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:32.995531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:32.995531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:32.995531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:32.995531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:57:32.995531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:57:32.995531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:57:32.995531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:57:32.996394 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:57:32.996394 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:57:32.996394 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:57:32.996394 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:57:32.996394 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:32.996394 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:32.996394 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:32.996394 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:32.996394 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:32.996394 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:32.996394 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:32.996394 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:32.996394 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:32.996394 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:32.996394 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:32.996394 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:33.001985 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:33.001985 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:33.001985 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:33.001985 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:33.001985 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:57:33.001985 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:57:33.001985 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:57:33.001985 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:57:33.001985 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:57:33.001985 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:57:33.001985 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:57:33.001985 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:57:33.001985 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 77/153] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Jul 4 03:57:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:57:33.001985 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a5369-681c-4a12-91fc-f7ce01316733 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:33.027186 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:33.047879 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:33.090825 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba258ca3-1b7e-4350-8352-009503f278a2 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:33.124187 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a5369-681c-4a12-91fc-f7ce01316733 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:33.125169 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7caa99d-7f5c-411e-bdb5-89d2c1bb5710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:33.125855 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7caa99d-7f5c-411e-bdb5-89d2c1bb5710 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:33.126144 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7caa99d-7f5c-411e-bdb5-89d2c1bb5710 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:33.126453 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7caa99d-7f5c-411e-bdb5-89d2c1bb5710 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:33.127179 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7caa99d-7f5c-411e-bdb5-89d2c1bb5710 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:33.128652 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7caa99d-7f5c-411e-bdb5-89d2c1bb5710 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:33.150670 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 77/154] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Jul 4 03:57:32 2022] POST /identity/v3/users => generated 283 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 03:57:33.150670 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd603c-4a2e-4b89-b319-7e7a79ba3c65 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:33.150670 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd603c-4a2e-4b89-b319-7e7a79ba3c65 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:33.150670 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd603c-4a2e-4b89-b319-7e7a79ba3c65 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:33.150670 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 78/155] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:33.150670 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd603c-4a2e-4b89-b319-7e7a79ba3c65 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:33.174102 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454eb777-f70c-4383-b79e-66fbe4af0b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:33.174851 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454eb777-f70c-4383-b79e-66fbe4af0b13 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:33.175413 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454eb777-f70c-4383-b79e-66fbe4af0b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:33.175604 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454eb777-f70c-4383-b79e-66fbe4af0b13 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:33.176397 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454eb777-f70c-4383-b79e-66fbe4af0b13 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:33.176734 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454eb777-f70c-4383-b79e-66fbe4af0b13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:33.178288 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454eb777-f70c-4383-b79e-66fbe4af0b13 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:33.187852 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 78/156] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Jul 4 03:57:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:33.188575 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454eb777-f70c-4383-b79e-66fbe4af0b13 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:33.274429 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd603c-4a2e-4b89-b319-7e7a79ba3c65 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:33.283742 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:33.295125 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:33.303882 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454eb777-f70c-4383-b79e-66fbe4af0b13 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:33.318127 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4f5c8-f4e7-4b0e-b356-b3529a92e60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:33.319318 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4f5c8-f4e7-4b0e-b356-b3529a92e60b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:33.319318 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4f5c8-f4e7-4b0e-b356-b3529a92e60b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:33.319506 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4f5c8-f4e7-4b0e-b356-b3529a92e60b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:33.320209 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb4f5c8-f4e7-4b0e-b356-b3529a92e60b None admin] RBAC: Adding query filter params (role.id=8d92e2d53a9441a9b6ddaaad264ac4c9, scope.project.id=f5159196cf6c47c79e3bf91601a42a40, user.id=3c37bbe571ec415c9de778d6219de1a0) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:33.320532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb4f5c8-f4e7-4b0e-b356-b3529a92e60b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:33.322278 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb4f5c8-f4e7-4b0e-b356-b3529a92e60b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:33.330510 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 79/157] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:57:33 2022] GET /identity/v3/role_assignments?user.id=3c37bbe571ec415c9de778d6219de1a0&scope.project.id=f5159196cf6c47c79e3bf91601a42a40&role.id=8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:33.332070 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2883019-0f16-4271-bde9-d2539c786b78 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:33.332442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2883019-0f16-4271-bde9-d2539c786b78 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:33.332686 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2883019-0f16-4271-bde9-d2539c786b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:33.344097 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae561c-8467-4ee4-9d69-1f99d8a6ab9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:33.344796 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae561c-8467-4ee4-9d69-1f99d8a6ab9d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:33.345080 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae561c-8467-4ee4-9d69-1f99d8a6ab9d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:33.345357 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae561c-8467-4ee4-9d69-1f99d8a6ab9d None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:33.346127 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae561c-8467-4ee4-9d69-1f99d8a6ab9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:33.346475 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae561c-8467-4ee4-9d69-1f99d8a6ab9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:33.347942 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae561c-8467-4ee4-9d69-1f99d8a6ab9d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:33.351216 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-d2883019-0f16-4271-bde9-d2539c786b78 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:33.352529 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d2883019-0f16-4271-bde9-d2539c786b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:33.364315 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 79/158] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:57:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:33.366183 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d8fb2-848f-410d-bd78-e3855a063917 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:33.366319 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d8fb2-848f-410d-bd78-e3855a063917 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:33.366600 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d8fb2-848f-410d-bd78-e3855a063917 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:33.368556 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 80/159] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:33.369444 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d8fb2-848f-410d-bd78-e3855a063917 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:33.464563 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 80/160] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:33.465580 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2883019-0f16-4271-bde9-d2539c786b78 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:33.522010 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d8fb2-848f-410d-bd78-e3855a063917 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:33.565665 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d918b96-ced0-4ff4-95ad-87dc7cd43383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:33.566963 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d918b96-ced0-4ff4-95ad-87dc7cd43383 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:33.567449 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d918b96-ced0-4ff4-95ad-87dc7cd43383 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:33.567904 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d918b96-ced0-4ff4-95ad-87dc7cd43383 None admin] PATH_INFO: `/v3/users/93fd9e230e4d4c80ab3e90ec8b6bd02c` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:33.569322 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d918b96-ced0-4ff4-95ad-87dc7cd43383 None admin] RBAC: Authorizing `identity:get_user(user_id=93fd9e230e4d4c80ab3e90ec8b6bd02c)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:33.571141 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d918b96-ced0-4ff4-95ad-87dc7cd43383 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:33.572985 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 81/161] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:57:33 2022] GET /identity/v3/users/93fd9e230e4d4c80ab3e90ec8b6bd02c => generated 289 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:33.577650 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d17936-d3fb-4c13-9dfd-b42b56141b3b None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:33.577650 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d17936-d3fb-4c13-9dfd-b42b56141b3b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:33.577650 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d17936-d3fb-4c13-9dfd-b42b56141b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:33.593317 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-78d17936-d3fb-4c13-9dfd-b42b56141b3b None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:33.594649 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-78d17936-d3fb-4c13-9dfd-b42b56141b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:33.599785 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2883019-0f16-4271-bde9-d2539c786b78 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:33.612733 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:33.616655 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:33.646413 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728f307-67dd-4759-bf93-492aac55dc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:33.647674 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728f307-67dd-4759-bf93-492aac55dc85 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:33.648157 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728f307-67dd-4759-bf93-492aac55dc85 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:33.648632 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728f307-67dd-4759-bf93-492aac55dc85 None admin] PATH_INFO: `/v3/users/e4dc423a8fa8454bad29c9624cf55962` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:33.650065 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728f307-67dd-4759-bf93-492aac55dc85 None admin] RBAC: Authorizing `identity:get_user(user_id=e4dc423a8fa8454bad29c9624cf55962)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:33.651614 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728f307-67dd-4759-bf93-492aac55dc85 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:33.653451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 81/162] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:57:33 2022] GET /identity/v3/users/e4dc423a8fa8454bad29c9624cf55962 => generated 247 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:33.654069 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728f307-67dd-4759-bf93-492aac55dc85 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:33.687951 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 82/163] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:33.688728 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d17936-d3fb-4c13-9dfd-b42b56141b3b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:33.798351 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728f307-67dd-4759-bf93-492aac55dc85 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:33.803668 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d17936-d3fb-4c13-9dfd-b42b56141b3b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:33.840524 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6110cf2-b465-4c86-bb92-9c82af17a9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:33.841289 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6110cf2-b465-4c86-bb92-9c82af17a9a4 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:33.841663 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6110cf2-b465-4c86-bb92-9c82af17a9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:33.842024 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6110cf2-b465-4c86-bb92-9c82af17a9a4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:33.845072 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119ab0e-ad46-4526-be40-c300d2d83c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:33.845953 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119ab0e-ad46-4526-be40-c300d2d83c41 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:33.846327 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119ab0e-ad46-4526-be40-c300d2d83c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:33.846515 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119ab0e-ad46-4526-be40-c300d2d83c41 None admin] PATH_INFO: `/v3/projects/f5159196cf6c47c79e3bf91601a42a40` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:33.847900 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2119ab0e-ad46-4526-be40-c300d2d83c41 None admin] RBAC: Authorizing `identity:get_project(project_id=f5159196cf6c47c79e3bf91601a42a40)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:33.849386 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2119ab0e-ad46-4526-be40-c300d2d83c41 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:33.851340 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 83/164] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:57:33 2022] GET /identity/v3/projects/f5159196cf6c47c79e3bf91601a42a40 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:33.851946 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119ab0e-ad46-4526-be40-c300d2d83c41 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:33.858392 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6110cf2-b465-4c86-bb92-9c82af17a9a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:57:33.867360 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-c6110cf2-b465-4c86-bb92-9c82af17a9a4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 03:57:33.867360 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:33.867360 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:33.867360 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:33.867360 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:33.867360 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:33.867360 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:33.867360 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:33.867360 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:33.867360 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:33.867360 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:33.867360 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:33.867360 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:57:33.867360 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:57:33.867360 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:57:33.867360 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:57:33.868393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:57:33.868393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:57:33.868393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:57:33.868393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:57:33.868393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:33.868393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:33.868393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:33.868393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:33.868393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:33.868393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:33.868393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:33.868393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:33.868393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:33.868393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:33.868393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:33.868393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:33.869161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:33.869161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:33.869161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:33.869161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:33.869161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:57:33.869161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:57:33.869161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:57:33.869161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:57:33.869161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:57:33.869161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:57:33.869161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 03:57:33.869161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:57:33.871013 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:33.872953 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 82/165] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Jul 4 03:57:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:57:33.874056 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6110cf2-b465-4c86-bb92-9c82af17a9a4 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:33.923550 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:34.014925 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119ab0e-ad46-4526-be40-c300d2d83c41 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:34.053465 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84740173-0361-4609-859a-78278d40a8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:34.054649 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84740173-0361-4609-859a-78278d40a8ff None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:34.055158 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84740173-0361-4609-859a-78278d40a8ff None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:34.055870 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84740173-0361-4609-859a-78278d40a8ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:34.123228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6110cf2-b465-4c86-bb92-9c82af17a9a4 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:34.136762 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84740173-0361-4609-859a-78278d40a8ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:34.138771 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84740173-0361-4609-859a-78278d40a8ff None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:34.153415 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:34.187145 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e69fb-23b2-4529-9b5f-f3c8aa901dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:34.188072 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e69fb-23b2-4529-9b5f-f3c8aa901dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:34.188362 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e69fb-23b2-4529-9b5f-f3c8aa901dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:34.188642 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e69fb-23b2-4529-9b5f-f3c8aa901dc7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:34.219154 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e69fb-23b2-4529-9b5f-f3c8aa901dc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:57:34.235536 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-b96e69fb-23b2-4529-9b5f-f3c8aa901dc7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 03:57:34.235536 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:34.235536 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:34.235536 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:34.235536 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:34.235536 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:34.235536 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:34.235536 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:34.235536 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:34.235536 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:34.235536 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:34.235536 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:34.235536 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:57:34.235536 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:57:34.235536 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:57:34.235536 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:57:34.236451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:57:34.236451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:57:34.236451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:57:34.236451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:57:34.236451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:34.236451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:34.236451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:34.236451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:34.236451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:34.236451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:34.236451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:34.236451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:34.236451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:34.236451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:34.236451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:34.236451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:34.237251 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:34.237251 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:34.237251 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:34.237251 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:34.237251 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:57:34.237251 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:57:34.237251 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:57:34.237251 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:57:34.237251 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:57:34.237251 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:57:34.237251 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 03:57:34.237251 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:57:34.237251 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 83/166] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:57:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:57:34.238556 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e69fb-23b2-4529-9b5f-f3c8aa901dc7 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:34.249098 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 84/167] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:57:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 03:57:34.249949 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84740173-0361-4609-859a-78278d40a8ff None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:34.367417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84740173-0361-4609-859a-78278d40a8ff None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:34.398613 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:34.404656 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:34.409066 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e69fb-23b2-4529-9b5f-f3c8aa901dc7 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:34.446310 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184525e8-08e3-496f-9355-745a341a38be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:34.447480 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184525e8-08e3-496f-9355-745a341a38be None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:34.447770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184525e8-08e3-496f-9355-745a341a38be None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:34.448051 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184525e8-08e3-496f-9355-745a341a38be None admin] PATH_INFO: `/v3/projects/f5159196cf6c47c79e3bf91601a42a40/users/93fd9e230e4d4c80ab3e90ec8b6bd02c/roles/99db92117d0048efaae5874a11d96ce9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:34.450054 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184525e8-08e3-496f-9355-745a341a38be None admin] RBAC: Authorizing `identity:create_grant(project_id=f5159196cf6c47c79e3bf91601a42a40, user_id=93fd9e230e4d4c80ab3e90ec8b6bd02c, role_id=99db92117d0048efaae5874a11d96ce9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:34.451562 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184525e8-08e3-496f-9355-745a341a38be None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:34.457938 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3caecba-b2bf-4d02-a6f8-bf6df87a3bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:34.458748 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3caecba-b2bf-4d02-a6f8-bf6df87a3bfd None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:34.459040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3caecba-b2bf-4d02-a6f8-bf6df87a3bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:34.459322 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3caecba-b2bf-4d02-a6f8-bf6df87a3bfd None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:34.460343 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3caecba-b2bf-4d02-a6f8-bf6df87a3bfd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:34.460710 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3caecba-b2bf-4d02-a6f8-bf6df87a3bfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:34.462408 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3caecba-b2bf-4d02-a6f8-bf6df87a3bfd None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:34.474899 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 84/168] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Jul 4 03:57:34 2022] PUT /identity/v3/projects/f5159196cf6c47c79e3bf91601a42a40/users/93fd9e230e4d4c80ab3e90ec8b6bd02c/roles/99db92117d0048efaae5874a11d96ce9 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 03:57:34.475894 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184525e8-08e3-496f-9355-745a341a38be None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:34.485271 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 85/169] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:57:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:34.486085 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3caecba-b2bf-4d02-a6f8-bf6df87a3bfd None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:34.604002 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3caecba-b2bf-4d02-a6f8-bf6df87a3bfd None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:34.644447 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761c401-8d3a-4828-9297-19840f41cc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:34.645338 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761c401-8d3a-4828-9297-19840f41cc68 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:34.645622 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761c401-8d3a-4828-9297-19840f41cc68 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:34.645898 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761c401-8d3a-4828-9297-19840f41cc68 None admin] PATH_INFO: `/v3/projects/f5159196cf6c47c79e3bf91601a42a40` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:34.647359 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f761c401-8d3a-4828-9297-19840f41cc68 None admin] RBAC: Authorizing `identity:get_project(project_id=f5159196cf6c47c79e3bf91601a42a40)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:34.648928 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f761c401-8d3a-4828-9297-19840f41cc68 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:34.651182 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 86/170] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:57:34 2022] GET /identity/v3/projects/f5159196cf6c47c79e3bf91601a42a40 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:34.652454 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761c401-8d3a-4828-9297-19840f41cc68 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:34.702615 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:34.740649 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184525e8-08e3-496f-9355-745a341a38be None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:34.796180 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761c401-8d3a-4828-9297-19840f41cc68 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:34.822350 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20bc1c-28b7-4f45-80b0-29486f62955f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:34.823034 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20bc1c-28b7-4f45-80b0-29486f62955f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:34.823320 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20bc1c-28b7-4f45-80b0-29486f62955f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:34.823600 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20bc1c-28b7-4f45-80b0-29486f62955f None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:34.824368 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a20bc1c-28b7-4f45-80b0-29486f62955f None admin] RBAC: Adding query filter params (name=member) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:34.824853 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a20bc1c-28b7-4f45-80b0-29486f62955f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:34.826305 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a20bc1c-28b7-4f45-80b0-29486f62955f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:34.835942 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 85/171] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Jul 4 03:57:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:34.836843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20bc1c-28b7-4f45-80b0-29486f62955f None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:34.859498 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b67f9-1668-4996-9461-3e53af0aff38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:34.860597 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b67f9-1668-4996-9461-3e53af0aff38 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:34.860885 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b67f9-1668-4996-9461-3e53af0aff38 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:34.861165 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b67f9-1668-4996-9461-3e53af0aff38 None admin] PATH_INFO: `/v3/users/3c37bbe571ec415c9de778d6219de1a0` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:34.863365 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b67f9-1668-4996-9461-3e53af0aff38 None admin] RBAC: Authorizing `identity:get_user(user_id=3c37bbe571ec415c9de778d6219de1a0)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:34.866794 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:34.867834 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b67f9-1668-4996-9461-3e53af0aff38 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:34.869695 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 87/172] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:57:34 2022] GET /identity/v3/users/3c37bbe571ec415c9de778d6219de1a0 => generated 275 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:34.870520 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b67f9-1668-4996-9461-3e53af0aff38 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:35.018258 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20bc1c-28b7-4f45-80b0-29486f62955f None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:35.062191 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b67f9-1668-4996-9461-3e53af0aff38 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:35.078567 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:35.088614 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63716ac-e175-4a18-8622-e824d96cf3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:35.089296 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63716ac-e175-4a18-8622-e824d96cf3ee None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:35.089664 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63716ac-e175-4a18-8622-e824d96cf3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:35.089853 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63716ac-e175-4a18-8622-e824d96cf3ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:35.094183 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63716ac-e175-4a18-8622-e824d96cf3ee None admin] RBAC: Adding query filter params (role.id=2eee98054d42475bb7e22a8487ab235e, scope.project.id=f5159196cf6c47c79e3bf91601a42a40, user.id=e4dc423a8fa8454bad29c9624cf55962) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:35.094183 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63716ac-e175-4a18-8622-e824d96cf3ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:35.094183 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63716ac-e175-4a18-8622-e824d96cf3ee None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:35.107275 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 86/173] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:57:34 2022] GET /identity/v3/role_assignments?user.id=e4dc423a8fa8454bad29c9624cf55962&scope.project.id=f5159196cf6c47c79e3bf91601a42a40&role.id=2eee98054d42475bb7e22a8487ab235e => generated 608 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:35.108140 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63716ac-e175-4a18-8622-e824d96cf3ee None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:35.134340 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90962a30-a204-4fcc-9323-837f8f4077aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:35.135305 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90962a30-a204-4fcc-9323-837f8f4077aa None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:35.135590 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90962a30-a204-4fcc-9323-837f8f4077aa None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:35.135868 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90962a30-a204-4fcc-9323-837f8f4077aa None admin] PATH_INFO: `/v3/users/3c37bbe571ec415c9de778d6219de1a0` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:35.137504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90962a30-a204-4fcc-9323-837f8f4077aa None admin] RBAC: Authorizing `identity:get_user(user_id=3c37bbe571ec415c9de778d6219de1a0)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:35.139035 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90962a30-a204-4fcc-9323-837f8f4077aa None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:35.147814 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 88/174] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:57:34 2022] GET /identity/v3/users/3c37bbe571ec415c9de778d6219de1a0 => generated 275 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:35.150246 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90962a30-a204-4fcc-9323-837f8f4077aa None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:35.321765 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:35.357985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63716ac-e175-4a18-8622-e824d96cf3ee None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:35.410084 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90962a30-a204-4fcc-9323-837f8f4077aa None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:35.427054 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a62784-4a4c-4506-85af-2be2ff283c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:35.427725 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a62784-4a4c-4506-85af-2be2ff283c04 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:35.428012 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a62784-4a4c-4506-85af-2be2ff283c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:35.428300 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a62784-4a4c-4506-85af-2be2ff283c04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:35.490951 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb51a1a-cf94-4042-bab8-46d65dbbcbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:35.492024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb51a1a-cf94-4042-bab8-46d65dbbcbd6 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:35.492516 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb51a1a-cf94-4042-bab8-46d65dbbcbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:35.493073 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb51a1a-cf94-4042-bab8-46d65dbbcbd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:35.560284 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a62784-4a4c-4506-85af-2be2ff283c04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:35.564474 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a62784-4a4c-4506-85af-2be2ff283c04 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:35.594586 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:35.647617 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb51a1a-cf94-4042-bab8-46d65dbbcbd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:35.649167 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb51a1a-cf94-4042-bab8-46d65dbbcbd6 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:35.762560 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:35.798528 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 87/175] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:57:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 690 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 03:57:35.800989 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a62784-4a4c-4506-85af-2be2ff283c04 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:35.863030 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 89/176] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:57:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 714 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 03:57:35.864146 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11eb2f-46da-443a-913f-7257b82e597a None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:35.864504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11eb2f-46da-443a-913f-7257b82e597a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:35.864708 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11eb2f-46da-443a-913f-7257b82e597a None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:35.865998 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 90/177] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:35.875147 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909aa8e-3a37-4bdb-8f6d-d20c0547910e None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:35.875435 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909aa8e-3a37-4bdb-8f6d-d20c0547910e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:35.875711 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909aa8e-3a37-4bdb-8f6d-d20c0547910e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:35.900012 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-a909aa8e-3a37-4bdb-8f6d-d20c0547910e None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:35.901326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a909aa8e-3a37-4bdb-8f6d-d20c0547910e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:35.961887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a62784-4a4c-4506-85af-2be2ff283c04 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:36.016099 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fa79d-c3c9-45c9-808d-a97bae09edd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:36.016982 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fa79d-c3c9-45c9-808d-a97bae09edd0 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:36.017266 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fa79d-c3c9-45c9-808d-a97bae09edd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:36.017546 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fa79d-c3c9-45c9-808d-a97bae09edd0 None admin] PATH_INFO: `/v3/projects/f5159196cf6c47c79e3bf91601a42a40` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:36.018857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670fa79d-c3c9-45c9-808d-a97bae09edd0 None admin] RBAC: Authorizing `identity:get_project(project_id=f5159196cf6c47c79e3bf91601a42a40)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:36.022014 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670fa79d-c3c9-45c9-808d-a97bae09edd0 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:36.023942 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 88/178] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:57:35 2022] GET /identity/v3/projects/f5159196cf6c47c79e3bf91601a42a40 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:57:36.024642 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fa79d-c3c9-45c9-808d-a97bae09edd0 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:36.028462 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 91/179] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:36.038323 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909aa8e-3a37-4bdb-8f6d-d20c0547910e None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:36.050239 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:36.135891 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:36.200828 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909aa8e-3a37-4bdb-8f6d-d20c0547910e None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:36.244056 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1522b-51c1-4fac-87ef-ba6edabfd0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:36.245313 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1522b-51c1-4fac-87ef-ba6edabfd0cd None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:36.246022 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1522b-51c1-4fac-87ef-ba6edabfd0cd None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:36.246927 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1522b-51c1-4fac-87ef-ba6edabfd0cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:36.248234 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b1522b-51c1-4fac-87ef-ba6edabfd0cd None admin] RBAC: Adding query filter params (role.id=a34eb11c5d95402e94c1bc45e635e387, scope.project.id=f5159196cf6c47c79e3bf91601a42a40, user.id=3c37bbe571ec415c9de778d6219de1a0) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:36.248749 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b1522b-51c1-4fac-87ef-ba6edabfd0cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:36.249439 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fa79d-c3c9-45c9-808d-a97bae09edd0 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:36.250696 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b1522b-51c1-4fac-87ef-ba6edabfd0cd None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:36.259293 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 92/180] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:57:36 2022] GET /identity/v3/role_assignments?user.id=3c37bbe571ec415c9de778d6219de1a0&scope.project.id=f5159196cf6c47c79e3bf91601a42a40&role.id=a34eb11c5d95402e94c1bc45e635e387 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:57:36.260745 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1522b-51c1-4fac-87ef-ba6edabfd0cd None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:36.350244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:36.355701 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1446c90-476d-4712-b4a9-83c48532536f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:36.356597 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1446c90-476d-4712-b4a9-83c48532536f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:36.356881 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1446c90-476d-4712-b4a9-83c48532536f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:36.357156 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1446c90-476d-4712-b4a9-83c48532536f None admin] PATH_INFO: `/v3/projects/d98e5e34095b408fa14e8136a08866bb` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:36.363145 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1446c90-476d-4712-b4a9-83c48532536f None admin] RBAC: Authorizing `identity:get_project(project_id=d98e5e34095b408fa14e8136a08866bb)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:36.364576 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1446c90-476d-4712-b4a9-83c48532536f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:36.366895 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 89/181] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:57:36 2022] GET /identity/v3/projects/d98e5e34095b408fa14e8136a08866bb => generated 312 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:36.367716 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a526f-5174-4b76-b3a6-9fe3b5c344bb None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:36.368046 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a526f-5174-4b76-b3a6-9fe3b5c344bb None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:36.368326 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a526f-5174-4b76-b3a6-9fe3b5c344bb None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:36.369574 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 90/182] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:36.375177 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ccd00-7db3-401f-a6bf-f02def2e1b7a None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:36.375464 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ccd00-7db3-401f-a6bf-f02def2e1b7a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:36.375740 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ccd00-7db3-401f-a6bf-f02def2e1b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:36.388421 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1522b-51c1-4fac-87ef-ba6edabfd0cd None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:36.427228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-7c1ccd00-7db3-401f-a6bf-f02def2e1b7a None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:36.428433 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7c1ccd00-7db3-401f-a6bf-f02def2e1b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:36.428701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd73d2-3013-4932-b4c3-8422506c7c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:36.429748 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd73d2-3013-4932-b4c3-8422506c7c5f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:36.430255 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd73d2-3013-4932-b4c3-8422506c7c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:36.431035 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd73d2-3013-4932-b4c3-8422506c7c5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:36.445657 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd73d2-3013-4932-b4c3-8422506c7c5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:57:36.455955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-3ddd73d2-3013-4932-b4c3-8422506c7c5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:57:36.455955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:36.455955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:36.455955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:36.455955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:36.455955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:36.455955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:36.455955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:36.455955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:36.455955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:36.455955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:36.455955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:36.455955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:57:36.455955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:57:36.455955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:57:36.455955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:57:36.457044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:57:36.457044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:57:36.457044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:57:36.457044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:57:36.457044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:36.457044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:36.457044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:36.457044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:36.457044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:36.457044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:36.457044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:36.457044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:36.457044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:36.457044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:36.457044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:36.457044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:36.458016 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:36.458016 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:36.458016 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:36.458016 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:36.458016 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:57:36.458016 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:57:36.458016 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:57:36.458016 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:57:36.458016 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:57:36.458016 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:57:36.458016 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:57:36.458016 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:57:36.460586 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 93/183] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Jul 4 03:57:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:57:36.461697 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd73d2-3013-4932-b4c3-8422506c7c5f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:36.522145 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 91/184] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 03:57:36.530570 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ccd00-7db3-401f-a6bf-f02def2e1b7a None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:36.584947 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd73d2-3013-4932-b4c3-8422506c7c5f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:36.613945 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:36.621844 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:36.627881 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f5c7b-34ec-4570-8c35-fc28af833e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:36.628669 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f5c7b-34ec-4570-8c35-fc28af833e9f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:36.629130 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f5c7b-34ec-4570-8c35-fc28af833e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:36.630310 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f5c7b-34ec-4570-8c35-fc28af833e9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:36.632122 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f5c7b-34ec-4570-8c35-fc28af833e9f None admin] RBAC: Adding query filter params (role.id=8d92e2d53a9441a9b6ddaaad264ac4c9, scope.project.id=d98e5e34095b408fa14e8136a08866bb, user.id=3c37bbe571ec415c9de778d6219de1a0) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:36.632442 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f5c7b-34ec-4570-8c35-fc28af833e9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:36.634042 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f5c7b-34ec-4570-8c35-fc28af833e9f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:36.642226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 94/185] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:57:36 2022] GET /identity/v3/role_assignments?user.id=3c37bbe571ec415c9de778d6219de1a0&scope.project.id=d98e5e34095b408fa14e8136a08866bb&role.id=8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:36.644010 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb205d4b-9692-44be-ae03-7b1dcebf8eac None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:36.644422 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb205d4b-9692-44be-ae03-7b1dcebf8eac None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:36.644702 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb205d4b-9692-44be-ae03-7b1dcebf8eac None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:36.650273 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 95/186] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:36.651236 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb205d4b-9692-44be-ae03-7b1dcebf8eac None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:36.665070 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ccd00-7db3-401f-a6bf-f02def2e1b7a None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:36.702482 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb95a3-f316-4f35-af11-9d5ec1047f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:36.703173 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb95a3-f316-4f35-af11-9d5ec1047f48 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:36.706180 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb95a3-f316-4f35-af11-9d5ec1047f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:36.706180 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb95a3-f316-4f35-af11-9d5ec1047f48 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:36.706180 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb95a3-f316-4f35-af11-9d5ec1047f48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:36.706180 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb95a3-f316-4f35-af11-9d5ec1047f48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:36.706590 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb95a3-f316-4f35-af11-9d5ec1047f48 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:36.716156 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 92/187] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:57:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:36.717499 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d93ed2-734c-4f42-818d-efa9cf301079 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:36.717793 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d93ed2-734c-4f42-818d-efa9cf301079 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:36.718076 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d93ed2-734c-4f42-818d-efa9cf301079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:36.742694 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-15d93ed2-734c-4f42-818d-efa9cf301079 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:36.744748 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-15d93ed2-734c-4f42-818d-efa9cf301079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:36.784493 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb205d4b-9692-44be-ae03-7b1dcebf8eac None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:36.825873 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497265c1-67f2-492b-bc71-fcb7ef15e556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:36.827553 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497265c1-67f2-492b-bc71-fcb7ef15e556 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:36.827553 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497265c1-67f2-492b-bc71-fcb7ef15e556 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:36.827553 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497265c1-67f2-492b-bc71-fcb7ef15e556 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:36.841544 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 93/188] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:36.842049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497265c1-67f2-492b-bc71-fcb7ef15e556 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:57:36.847056 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d93ed2-734c-4f42-818d-efa9cf301079 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:36.850005 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-497265c1-67f2-492b-bc71-fcb7ef15e556 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 03:57:36.850005 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:36.850005 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:36.850005 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:36.850005 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:36.850005 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:36.850005 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:36.850005 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:36.850005 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:36.850005 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:36.850005 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:36.850005 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:36.850005 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:57:36.850005 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:57:36.850005 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:57:36.850005 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:57:36.851049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:57:36.851049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:57:36.851049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:57:36.851049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:57:36.851049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:36.851049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:36.851049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:36.851049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:36.851049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:36.851049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:36.851049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:36.851049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:36.851049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:36.851049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:36.851049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:36.851049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:36.851877 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:36.851877 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:36.851877 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:36.851877 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:36.851877 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:57:36.851877 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:57:36.851877 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:57:36.851877 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:57:36.851877 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:57:36.851877 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:57:36.851877 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 03:57:36.851877 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:57:36.852522 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 96/189] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Jul 4 03:57:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:57:36.863503 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497265c1-67f2-492b-bc71-fcb7ef15e556 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:36.904045 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:36.941049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:36.979978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d93ed2-734c-4f42-818d-efa9cf301079 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:36.990013 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497265c1-67f2-492b-bc71-fcb7ef15e556 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:37.022421 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d47bae-5dcd-4633-b137-2a95970d40b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:37.023766 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d47bae-5dcd-4633-b137-2a95970d40b1 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:37.024062 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d47bae-5dcd-4633-b137-2a95970d40b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:37.024423 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d47bae-5dcd-4633-b137-2a95970d40b1 None admin] PATH_INFO: `/v3/users/3e66ae8a37cb4db6bdf728e0790f8aa5` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:37.024722 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54fe35f-1cd2-45bc-a6f2-64422c45ba1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:37.025394 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fe35f-1cd2-45bc-a6f2-64422c45ba1d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:37.025677 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fe35f-1cd2-45bc-a6f2-64422c45ba1d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:37.025951 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fe35f-1cd2-45bc-a6f2-64422c45ba1d None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:37.026737 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54fe35f-1cd2-45bc-a6f2-64422c45ba1d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:37.027045 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54fe35f-1cd2-45bc-a6f2-64422c45ba1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:37.028460 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54fe35f-1cd2-45bc-a6f2-64422c45ba1d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:37.036963 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 97/190] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:57:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:37.040506 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d47bae-5dcd-4633-b137-2a95970d40b1 None admin] RBAC: Authorizing `identity:get_user(user_id=3e66ae8a37cb4db6bdf728e0790f8aa5)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:37.042014 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d47bae-5dcd-4633-b137-2a95970d40b1 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:37.042331 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54fe35f-1cd2-45bc-a6f2-64422c45ba1d None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:37.048448 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 94/191] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:57:36 2022] GET /identity/v3/users/3e66ae8a37cb4db6bdf728e0790f8aa5 => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:37.048448 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d47bae-5dcd-4633-b137-2a95970d40b1 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:37.148284 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54fe35f-1cd2-45bc-a6f2-64422c45ba1d None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:37.160064 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:37.163835 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d47bae-5dcd-4633-b137-2a95970d40b1 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:37.164979 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:37.184649 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5bac0-30b0-42cf-bd3d-6105be7532ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:37.185488 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5bac0-30b0-42cf-bd3d-6105be7532ea None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:37.185780 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5bac0-30b0-42cf-bd3d-6105be7532ea None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:37.186051 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5bac0-30b0-42cf-bd3d-6105be7532ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:37.187278 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d5bac0-30b0-42cf-bd3d-6105be7532ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:37.188888 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d5bac0-30b0-42cf-bd3d-6105be7532ea None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:37.191077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 98/192] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:57:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:37.191749 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5bac0-30b0-42cf-bd3d-6105be7532ea None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:37.206025 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815634b1-4f63-4e9e-80f0-86936b1585ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:37.206946 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815634b1-4f63-4e9e-80f0-86936b1585ca None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:37.207235 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815634b1-4f63-4e9e-80f0-86936b1585ca None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:37.207505 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815634b1-4f63-4e9e-80f0-86936b1585ca None admin] PATH_INFO: `/v3/users/3e66ae8a37cb4db6bdf728e0790f8aa5` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:37.208777 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815634b1-4f63-4e9e-80f0-86936b1585ca None admin] RBAC: Authorizing `identity:get_user(user_id=3e66ae8a37cb4db6bdf728e0790f8aa5)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:37.210254 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815634b1-4f63-4e9e-80f0-86936b1585ca None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:37.212221 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 95/193] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:57:37 2022] GET /identity/v3/users/3e66ae8a37cb4db6bdf728e0790f8aa5 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:37.212867 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815634b1-4f63-4e9e-80f0-86936b1585ca None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:37.302621 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5bac0-30b0-42cf-bd3d-6105be7532ea None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:37.321213 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815634b1-4f63-4e9e-80f0-86936b1585ca None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:37.338926 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016fe1f-4e61-4b03-a029-a27949836f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:37.339587 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016fe1f-4e61-4b03-a029-a27949836f4b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:37.339870 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016fe1f-4e61-4b03-a029-a27949836f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:37.340226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016fe1f-4e61-4b03-a029-a27949836f4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:37.357766 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb361f-1cd7-4c2c-b8ec-23e4658e7504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:37.358617 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb361f-1cd7-4c2c-b8ec-23e4658e7504 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:37.359199 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb361f-1cd7-4c2c-b8ec-23e4658e7504 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:37.359489 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb361f-1cd7-4c2c-b8ec-23e4658e7504 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:37.360222 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb361f-1cd7-4c2c-b8ec-23e4658e7504 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:37.362110 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb361f-1cd7-4c2c-b8ec-23e4658e7504 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:37.398194 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 96/194] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Jul 4 03:57:37 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 03:57:37.398194 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb361f-1cd7-4c2c-b8ec-23e4658e7504 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:37.398497 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:37.416703 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2016fe1f-4e61-4b03-a029-a27949836f4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:37.418268 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2016fe1f-4e61-4b03-a029-a27949836f4b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:37.440393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:37.530634 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb361f-1cd7-4c2c-b8ec-23e4658e7504 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:37.532682 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 99/195] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:57:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 03:57:37.534072 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d411b-5805-454d-ad8a-c9eb3d87e8bf None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:37.534476 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d411b-5805-454d-ad8a-c9eb3d87e8bf None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:37.534782 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d411b-5805-454d-ad8a-c9eb3d87e8bf None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:37.536284 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 100/196] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:37.540968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d411b-5805-454d-ad8a-c9eb3d87e8bf None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:37.576458 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9708ca-6444-4edc-9c2c-321d71c3f2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:37.577130 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9708ca-6444-4edc-9c2c-321d71c3f2e9 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:37.577639 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9708ca-6444-4edc-9c2c-321d71c3f2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:37.577743 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9708ca-6444-4edc-9c2c-321d71c3f2e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:37.643088 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:37.663646 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9708ca-6444-4edc-9c2c-321d71c3f2e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:37.665188 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9708ca-6444-4edc-9c2c-321d71c3f2e9 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:37.670281 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d411b-5805-454d-ad8a-c9eb3d87e8bf None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:37.692074 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:37.712915 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f66d59-43f4-4243-a0d6-4b09ef156a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:37.713799 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f66d59-43f4-4243-a0d6-4b09ef156a1c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:37.714089 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f66d59-43f4-4243-a0d6-4b09ef156a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:37.714402 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f66d59-43f4-4243-a0d6-4b09ef156a1c None admin] PATH_INFO: `/v3/projects/f5bcfb30168d4753a6b0048a7935c78f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:37.715721 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f66d59-43f4-4243-a0d6-4b09ef156a1c None admin] RBAC: Authorizing `identity:get_project(project_id=f5bcfb30168d4753a6b0048a7935c78f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:37.717332 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f66d59-43f4-4243-a0d6-4b09ef156a1c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:37.719334 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 101/197] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:57:37 2022] GET /identity/v3/projects/f5bcfb30168d4753a6b0048a7935c78f => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:37.720511 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c51b5-4c28-4bfe-b86c-8f029dd96e10 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:37.720800 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c51b5-4c28-4bfe-b86c-8f029dd96e10 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:37.721084 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c51b5-4c28-4bfe-b86c-8f029dd96e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:37.741398 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-f15c51b5-4c28-4bfe-b86c-8f029dd96e10 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:37.742612 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f15c51b5-4c28-4bfe-b86c-8f029dd96e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:37.780950 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 97/198] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:57:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 03:57:37.782698 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9708ca-6444-4edc-9c2c-321d71c3f2e9 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:37.823548 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 102/199] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:37.825098 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c51b5-4c28-4bfe-b86c-8f029dd96e10 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:37.909509 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9708ca-6444-4edc-9c2c-321d71c3f2e9 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:37.917013 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:37.937941 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c51b5-4c28-4bfe-b86c-8f029dd96e10 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:37.943209 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:37.956683 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcadf03-4cec-4aa4-8ca8-029c31de1657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:37.957729 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcadf03-4cec-4aa4-8ca8-029c31de1657 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:37.958235 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcadf03-4cec-4aa4-8ca8-029c31de1657 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:37.958690 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcadf03-4cec-4aa4-8ca8-029c31de1657 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:37.959723 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcadf03-4cec-4aa4-8ca8-029c31de1657 None admin] RBAC: Adding query filter params (role.id=2eee98054d42475bb7e22a8487ab235e, scope.project.id=f5bcfb30168d4753a6b0048a7935c78f, user.id=3e66ae8a37cb4db6bdf728e0790f8aa5) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:37.960231 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcadf03-4cec-4aa4-8ca8-029c31de1657 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:37.961974 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcadf03-4cec-4aa4-8ca8-029c31de1657 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:37.968226 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 98/200] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:57:37 2022] GET /identity/v3/role_assignments?user.id=3e66ae8a37cb4db6bdf728e0790f8aa5&scope.project.id=f5bcfb30168d4753a6b0048a7935c78f&role.id=2eee98054d42475bb7e22a8487ab235e => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:37.969332 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcadf03-4cec-4aa4-8ca8-029c31de1657 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:37.987100 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e38cb4-65fb-41cb-bf50-7b09ae080b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:37.988181 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e38cb4-65fb-41cb-bf50-7b09ae080b79 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:37.988566 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e38cb4-65fb-41cb-bf50-7b09ae080b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:37.989024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e38cb4-65fb-41cb-bf50-7b09ae080b79 None admin] PATH_INFO: `/v3/projects/f5bcfb30168d4753a6b0048a7935c78f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:37.990869 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e38cb4-65fb-41cb-bf50-7b09ae080b79 None admin] RBAC: Authorizing `identity:get_project(project_id=f5bcfb30168d4753a6b0048a7935c78f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:37.992659 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e38cb4-65fb-41cb-bf50-7b09ae080b79 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:37.995865 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 103/201] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:57:37 2022] GET /identity/v3/projects/f5bcfb30168d4753a6b0048a7935c78f => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:38.001792 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e38cb4-65fb-41cb-bf50-7b09ae080b79 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:38.112296 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcadf03-4cec-4aa4-8ca8-029c31de1657 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:38.164944 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e38cb4-65fb-41cb-bf50-7b09ae080b79 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:38.180737 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a8522-a242-4838-8d6b-1a2575d1498b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:38.181874 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a8522-a242-4838-8d6b-1a2575d1498b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:38.182330 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a8522-a242-4838-8d6b-1a2575d1498b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:38.182739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a8522-a242-4838-8d6b-1a2575d1498b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:38.202260 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5a8522-a242-4838-8d6b-1a2575d1498b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:57:38.211902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-0d5a8522-a242-4838-8d6b-1a2575d1498b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 03:57:38.211902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:38.211902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:38.211902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:38.211902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:38.211902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:38.211902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:38.211902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:38.211902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:38.211902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:38.211902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:38.211902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:38.211902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:57:38.211902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:57:38.211902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:57:38.211902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:57:38.212902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:57:38.212902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:57:38.212902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:57:38.212902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:57:38.212902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:38.212902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:38.212902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:38.212902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:38.212902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:38.212902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:38.212902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:38.212902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:38.212902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:38.212902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:38.212902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:38.212902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:38.213698 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:38.213698 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:38.213698 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:38.213698 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:38.213698 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:57:38.213698 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:57:38.213698 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:57:38.213698 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:57:38.213698 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:57:38.213698 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:57:38.213698 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 03:57:38.213698 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:57:38.216002 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 99/202] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:57:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:57:38.219739 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a5fa8-849d-4b2d-9006-3a241a3f084e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:38.220504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a5fa8-849d-4b2d-9006-3a241a3f084e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:38.221116 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a5fa8-849d-4b2d-9006-3a241a3f084e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:38.221403 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a5fa8-849d-4b2d-9006-3a241a3f084e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:38.222213 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a8522-a242-4838-8d6b-1a2575d1498b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:38.222316 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a5fa8-849d-4b2d-9006-3a241a3f084e None admin] RBAC: Adding query filter params (role.id=a34eb11c5d95402e94c1bc45e635e387, scope.project.id=f5bcfb30168d4753a6b0048a7935c78f, user.id=3e66ae8a37cb4db6bdf728e0790f8aa5) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:38.222598 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a5fa8-849d-4b2d-9006-3a241a3f084e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:38.224176 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a5fa8-849d-4b2d-9006-3a241a3f084e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:38.231812 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 104/203] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:57:38 2022] GET /identity/v3/role_assignments?user.id=3e66ae8a37cb4db6bdf728e0790f8aa5&scope.project.id=f5bcfb30168d4753a6b0048a7935c78f&role.id=a34eb11c5d95402e94c1bc45e635e387 => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:38.306610 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:38.381204 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a8522-a242-4838-8d6b-1a2575d1498b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:38.430829 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925338cd-1d12-4790-935d-51cf04b6ca40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:38.431512 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925338cd-1d12-4790-935d-51cf04b6ca40 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:38.431797 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925338cd-1d12-4790-935d-51cf04b6ca40 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:38.432078 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925338cd-1d12-4790-935d-51cf04b6ca40 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:38.432844 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925338cd-1d12-4790-935d-51cf04b6ca40 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:38.433153 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925338cd-1d12-4790-935d-51cf04b6ca40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:38.434592 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925338cd-1d12-4790-935d-51cf04b6ca40 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:38.443416 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 100/204] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Jul 4 03:57:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:57:38.448990 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a5fa8-849d-4b2d-9006-3a241a3f084e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:38.474277 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:38.579648 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a5fa8-849d-4b2d-9006-3a241a3f084e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:38.619791 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1978894-9915-450d-a5e8-ec3f0344ffda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:38.620699 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1978894-9915-450d-a5e8-ec3f0344ffda None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:38.620982 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1978894-9915-450d-a5e8-ec3f0344ffda None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:38.621261 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1978894-9915-450d-a5e8-ec3f0344ffda None admin] PATH_INFO: `/v3/users/93fd9e230e4d4c80ab3e90ec8b6bd02c` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:38.622496 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1978894-9915-450d-a5e8-ec3f0344ffda None admin] RBAC: Authorizing `identity:get_user(user_id=93fd9e230e4d4c80ab3e90ec8b6bd02c)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:38.623970 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1978894-9915-450d-a5e8-ec3f0344ffda None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:38.625977 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 105/205] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:57:38 2022] GET /identity/v3/users/93fd9e230e4d4c80ab3e90ec8b6bd02c => generated 289 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:38.631302 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925338cd-1d12-4790-935d-51cf04b6ca40 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:38.788014 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925338cd-1d12-4790-935d-51cf04b6ca40 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:38.804141 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:38.845080 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75b3ca-9b1b-4d89-9db2-9566745d932e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:38.845755 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75b3ca-9b1b-4d89-9db2-9566745d932e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:38.846043 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75b3ca-9b1b-4d89-9db2-9566745d932e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:38.846349 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75b3ca-9b1b-4d89-9db2-9566745d932e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:38.940203 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db75b3ca-9b1b-4d89-9db2-9566745d932e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:38.941683 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db75b3ca-9b1b-4d89-9db2-9566745d932e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:39.070567 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 101/206] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:57:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 03:57:39.079259 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1978894-9915-450d-a5e8-ec3f0344ffda None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:39.182094 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:39.199816 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1978894-9915-450d-a5e8-ec3f0344ffda None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:39.233667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6920894-04d2-4820-b933-e0ecbae98579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:39.234576 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6920894-04d2-4820-b933-e0ecbae98579 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:39.234859 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6920894-04d2-4820-b933-e0ecbae98579 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:39.235135 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6920894-04d2-4820-b933-e0ecbae98579 None admin] PATH_INFO: `/v3/projects/f5159196cf6c47c79e3bf91601a42a40` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:39.236311 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6920894-04d2-4820-b933-e0ecbae98579 None admin] RBAC: Authorizing `identity:get_project(project_id=f5159196cf6c47c79e3bf91601a42a40)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:39.237779 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6920894-04d2-4820-b933-e0ecbae98579 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:39.239520 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 106/207] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:57:39 2022] GET /identity/v3/projects/f5159196cf6c47c79e3bf91601a42a40 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:39.245601 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75b3ca-9b1b-4d89-9db2-9566745d932e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:39.263099 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:39.341526 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75b3ca-9b1b-4d89-9db2-9566745d932e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:39.375071 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503c1ab-2d5a-464c-94fb-3aa21886d7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:39.375729 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503c1ab-2d5a-464c-94fb-3aa21886d7ee None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:39.376014 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503c1ab-2d5a-464c-94fb-3aa21886d7ee None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:39.376293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503c1ab-2d5a-464c-94fb-3aa21886d7ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:39.377131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e503c1ab-2d5a-464c-94fb-3aa21886d7ee None admin] RBAC: Adding query filter params (role.id=99db92117d0048efaae5874a11d96ce9, scope.project.id=f5159196cf6c47c79e3bf91601a42a40, user.id=93fd9e230e4d4c80ab3e90ec8b6bd02c) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:39.377447 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e503c1ab-2d5a-464c-94fb-3aa21886d7ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:39.378924 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e503c1ab-2d5a-464c-94fb-3aa21886d7ee None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:39.385374 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 102/208] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:57:39 2022] GET /identity/v3/role_assignments?user.id=93fd9e230e4d4c80ab3e90ec8b6bd02c&scope.project.id=f5159196cf6c47c79e3bf91601a42a40&role.id=99db92117d0048efaae5874a11d96ce9 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:39.896861 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e45be6-b78b-4897-8a6a-39bc182c972b None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:39.897257 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e45be6-b78b-4897-8a6a-39bc182c972b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:39.897456 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e45be6-b78b-4897-8a6a-39bc182c972b None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:39.898890 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 107/209] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:39.904157 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcff7af-0604-4b75-aca3-9fc58895ef79 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:39.904456 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcff7af-0604-4b75-aca3-9fc58895ef79 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:39.904742 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcff7af-0604-4b75-aca3-9fc58895ef79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:39.922759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ebcff7af-0604-4b75-aca3-9fc58895ef79 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:39.923967 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ebcff7af-0604-4b75-aca3-9fc58895ef79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:40.002972 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 103/210] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:40.007452 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cccea-5228-4592-8486-9a5e0a301ef0 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:40.007819 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cccea-5228-4592-8486-9a5e0a301ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:40.008197 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cccea-5228-4592-8486-9a5e0a301ef0 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:40.009861 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 108/211] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:40.015464 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d37ce-5098-4d30-8b8c-9cdf380a28c3 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:40.015945 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d37ce-5098-4d30-8b8c-9cdf380a28c3 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:40.016397 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d37ce-5098-4d30-8b8c-9cdf380a28c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:40.022576 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:40.035112 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-557d37ce-5098-4d30-8b8c-9cdf380a28c3 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:40.036359 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-557d37ce-5098-4d30-8b8c-9cdf380a28c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:40.038249 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90cccea-5228-4592-8486-9a5e0a301ef0 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:40.118679 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 104/212] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 03:57:40.142450 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d37ce-5098-4d30-8b8c-9cdf380a28c3 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:40.166721 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90cccea-5228-4592-8486-9a5e0a301ef0 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:40.203243 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619bc858-bff8-4557-9682-10a7ed364613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:40.204245 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619bc858-bff8-4557-9682-10a7ed364613 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:40.204528 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619bc858-bff8-4557-9682-10a7ed364613 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:40.204863 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619bc858-bff8-4557-9682-10a7ed364613 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:40.206026 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619bc858-bff8-4557-9682-10a7ed364613 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:40.207688 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619bc858-bff8-4557-9682-10a7ed364613 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:40.209801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 109/213] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:57:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:57:40.216113 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619bc858-bff8-4557-9682-10a7ed364613 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:40.250549 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:40.274176 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d37ce-5098-4d30-8b8c-9cdf380a28c3 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:40.310707 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633de47-bba2-4ef5-8677-68cdf6cf6196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:40.311553 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633de47-bba2-4ef5-8677-68cdf6cf6196 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:40.311890 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633de47-bba2-4ef5-8677-68cdf6cf6196 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:40.312173 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633de47-bba2-4ef5-8677-68cdf6cf6196 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:40.314192 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:40.325414 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b633de47-bba2-4ef5-8677-68cdf6cf6196 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:57:40.333750 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-b633de47-bba2-4ef5-8677-68cdf6cf6196 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 03:57:40.333750 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:40.333750 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:40.333750 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:40.333750 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:40.333750 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:40.333750 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:40.333750 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:40.333750 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:40.333750 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:40.333750 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:40.333750 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:40.333750 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:57:40.333750 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:57:40.333750 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:57:40.333750 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:57:40.334657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:57:40.334657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:57:40.334657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:57:40.334657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:57:40.334657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:40.334657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:40.334657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:40.334657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:40.334657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:40.334657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:40.334657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:40.334657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:40.334657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:40.334657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:40.334657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:40.334657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:40.335462 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:40.335462 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:40.335462 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:40.335462 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:40.335462 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:57:40.335462 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:57:40.335462 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:57:40.335462 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:57:40.335462 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:57:40.335462 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:57:40.335462 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 03:57:40.335462 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:57:40.340031 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 105/214] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:57:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:57:40.340327 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619bc858-bff8-4557-9682-10a7ed364613 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:40.341263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633de47-bba2-4ef5-8677-68cdf6cf6196 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:40.383198 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686b5e8-b926-4ec5-83a3-6265e8922c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:40.384440 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686b5e8-b926-4ec5-83a3-6265e8922c77 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:40.384798 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686b5e8-b926-4ec5-83a3-6265e8922c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:40.385152 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686b5e8-b926-4ec5-83a3-6265e8922c77 None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:40.386650 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a686b5e8-b926-4ec5-83a3-6265e8922c77 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:40.388791 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a686b5e8-b926-4ec5-83a3-6265e8922c77 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:40.421879 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 110/215] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Jul 4 03:57:40 2022] POST /identity/v3/users => generated 297 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 03:57:40.460371 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633de47-bba2-4ef5-8677-68cdf6cf6196 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:40.501481 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94370f47-6bb0-43ec-89ef-b73f9a6cdee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:40.502334 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94370f47-6bb0-43ec-89ef-b73f9a6cdee8 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:40.502672 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94370f47-6bb0-43ec-89ef-b73f9a6cdee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:40.503002 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94370f47-6bb0-43ec-89ef-b73f9a6cdee8 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:40.503894 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94370f47-6bb0-43ec-89ef-b73f9a6cdee8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:40.504212 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94370f47-6bb0-43ec-89ef-b73f9a6cdee8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:40.505731 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94370f47-6bb0-43ec-89ef-b73f9a6cdee8 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:40.507928 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cb908-c352-4ee2-ad2b-095db7fd7ea1 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:40.508222 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cb908-c352-4ee2-ad2b-095db7fd7ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:40.508556 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cb908-c352-4ee2-ad2b-095db7fd7ea1 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:40.510045 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 111/216] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 03:57:40.516070 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b8ebb-2493-4a53-ad8b-d4082c3fee0a None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:40.516672 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b8ebb-2493-4a53-ad8b-d4082c3fee0a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:40.517062 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 106/217] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Jul 4 03:57:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:40.517542 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b8ebb-2493-4a53-ad8b-d4082c3fee0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:40.522781 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94370f47-6bb0-43ec-89ef-b73f9a6cdee8 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:40.536114 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-fc8b8ebb-2493-4a53-ad8b-d4082c3fee0a None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:40.537714 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-fc8b8ebb-2493-4a53-ad8b-d4082c3fee0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:40.588217 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:40.618884 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 112/218] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 03:57:40.620085 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605f00b-3839-493d-aeff-9571e7bd7f93 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:40.620381 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605f00b-3839-493d-aeff-9571e7bd7f93 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:40.620734 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605f00b-3839-493d-aeff-9571e7bd7f93 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:40.622033 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 113/219] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:40.628340 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70edbf-8e40-4433-a84a-f312bf2c191d None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:40.628748 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70edbf-8e40-4433-a84a-f312bf2c191d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:40.629599 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70edbf-8e40-4433-a84a-f312bf2c191d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:40.635780 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:40.642920 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94370f47-6bb0-43ec-89ef-b73f9a6cdee8 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:40.649001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-3d70edbf-8e40-4433-a84a-f312bf2c191d None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:40.650350 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3d70edbf-8e40-4433-a84a-f312bf2c191d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:40.687922 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793c42e-73b1-4b06-a945-c4f0f871b6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:40.688768 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793c42e-73b1-4b06-a945-c4f0f871b6d5 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:40.689061 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793c42e-73b1-4b06-a945-c4f0f871b6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:40.689338 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793c42e-73b1-4b06-a945-c4f0f871b6d5 None admin] PATH_INFO: `/v3/users/7637be4c30eb475ca2d6ac42a1e4ba76` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:40.705521 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793c42e-73b1-4b06-a945-c4f0f871b6d5 None admin] RBAC: Authorizing `identity:get_user(user_id=7637be4c30eb475ca2d6ac42a1e4ba76)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:40.707123 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793c42e-73b1-4b06-a945-c4f0f871b6d5 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:40.709734 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 107/220] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:57:40 2022] GET /identity/v3/users/7637be4c30eb475ca2d6ac42a1e4ba76 => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:57:40.711618 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793c42e-73b1-4b06-a945-c4f0f871b6d5 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:40.741940 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 114/221] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:40.743125 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d70edbf-8e40-4433-a84a-f312bf2c191d None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:40.834381 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793c42e-73b1-4b06-a945-c4f0f871b6d5 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:40.854408 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:40.856341 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d70edbf-8e40-4433-a84a-f312bf2c191d None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:40.880136 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b56b4d-2cbd-4783-86b0-deb69445062d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:40.881252 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b56b4d-2cbd-4783-86b0-deb69445062d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:40.881756 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b56b4d-2cbd-4783-86b0-deb69445062d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:40.882293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b56b4d-2cbd-4783-86b0-deb69445062d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:40.896608 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5d007-fc2f-4527-9fd2-6e2aedcd44dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:40.897620 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5d007-fc2f-4527-9fd2-6e2aedcd44dd None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:40.898098 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5d007-fc2f-4527-9fd2-6e2aedcd44dd None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:40.898617 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5d007-fc2f-4527-9fd2-6e2aedcd44dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:40.899472 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b56b4d-2cbd-4783-86b0-deb69445062d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:57:40.902443 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:40.910131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-32b56b4d-2cbd-4783-86b0-deb69445062d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:57:40.910131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:40.910131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:40.910131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:40.910131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:40.910131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:40.910131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:40.910131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:40.910131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:40.910131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:40.910131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:40.910131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:40.910131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:57:40.910131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:57:40.910131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:57:40.910131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:57:40.911076 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:57:40.911076 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:57:40.911076 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:57:40.911076 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:57:40.911076 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:40.911076 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:40.911076 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:40.911076 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:40.911076 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:40.911076 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:40.911076 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:40.911076 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:40.911076 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:40.911076 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:40.911076 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:40.911076 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:40.911843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:40.911843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:40.911843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:40.911843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:40.911843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:57:40.911843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:57:40.911843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:57:40.911843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:57:40.911843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:57:40.911843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:57:40.911843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:57:40.911843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:57:40.911843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 108/222] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Jul 4 03:57:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:57:40.912479 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b56b4d-2cbd-4783-86b0-deb69445062d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:40.995112 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a5d007-fc2f-4527-9fd2-6e2aedcd44dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:40.997065 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a5d007-fc2f-4527-9fd2-6e2aedcd44dd None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:41.045245 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b56b4d-2cbd-4783-86b0-deb69445062d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:41.080713 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa1674-6e9e-45d9-a11e-9d5bbd7d14aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:41.081876 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa1674-6e9e-45d9-a11e-9d5bbd7d14aa None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:41.082408 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa1674-6e9e-45d9-a11e-9d5bbd7d14aa None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:41.082894 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa1674-6e9e-45d9-a11e-9d5bbd7d14aa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:41.095580 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa1674-6e9e-45d9-a11e-9d5bbd7d14aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:57:41.107187 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-08fa1674-6e9e-45d9-a11e-9d5bbd7d14aa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 03:57:41.107187 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:41.107187 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:41.107187 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:41.107187 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:41.107187 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:41.107187 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:41.107187 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:41.107187 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:41.107187 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:41.107187 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:41.107187 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:41.107187 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:57:41.107187 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:57:41.107187 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:57:41.107187 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:57:41.108066 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:57:41.108066 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:57:41.108066 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:57:41.108066 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:57:41.108066 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:41.108066 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:41.108066 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:41.108066 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:41.108066 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:41.108066 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:41.108066 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:41.108066 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:41.108066 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:41.108066 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:41.108066 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:41.108066 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:41.108846 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:41.108846 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:41.108846 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:41.108846 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:41.108846 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:57:41.108846 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:57:41.108846 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:57:41.108846 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:57:41.108846 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:57:41.108846 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:57:41.108846 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 03:57:41.108846 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:57:41.110194 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 115/223] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:57:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 03:57:41.111960 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 109/224] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Jul 4 03:57:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:57:41.114810 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5d007-fc2f-4527-9fd2-6e2aedcd44dd None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:41.118062 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa1674-6e9e-45d9-a11e-9d5bbd7d14aa None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:41.152953 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:41.155562 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:41.223134 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5d007-fc2f-4527-9fd2-6e2aedcd44dd None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:41.225854 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa1674-6e9e-45d9-a11e-9d5bbd7d14aa None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:41.262251 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b144360-c53b-4061-b95e-73bbb8687b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:41.263069 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2b523-d509-4dd3-9da8-7c2ba18168b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:41.263733 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b144360-c53b-4061-b95e-73bbb8687b94 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:41.263850 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2b523-d509-4dd3-9da8-7c2ba18168b1 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:41.264077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2b523-d509-4dd3-9da8-7c2ba18168b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:41.264362 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2b523-d509-4dd3-9da8-7c2ba18168b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:41.264714 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b144360-c53b-4061-b95e-73bbb8687b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:41.265121 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2b523-d509-4dd3-9da8-7c2ba18168b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:41.265388 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b144360-c53b-4061-b95e-73bbb8687b94 None admin] PATH_INFO: `/v3/projects/f5bcfb30168d4753a6b0048a7935c78f` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:41.265484 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2b523-d509-4dd3-9da8-7c2ba18168b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:41.266901 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2b523-d509-4dd3-9da8-7c2ba18168b1 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:41.267246 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b144360-c53b-4061-b95e-73bbb8687b94 None admin] RBAC: Authorizing `identity:get_project(project_id=f5bcfb30168d4753a6b0048a7935c78f)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:41.269593 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b144360-c53b-4061-b95e-73bbb8687b94 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:41.277160 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 110/225] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:57:41 2022] GET /identity/v3/projects/f5bcfb30168d4753a6b0048a7935c78f => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:41.278302 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b144360-c53b-4061-b95e-73bbb8687b94 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:41.279538 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 116/226] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:57:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:41.284768 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2b523-d509-4dd3-9da8-7c2ba18168b1 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:41.397943 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:41.403934 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b144360-c53b-4061-b95e-73bbb8687b94 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:41.405599 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:41.407832 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2b523-d509-4dd3-9da8-7c2ba18168b1 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:41.441692 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8c992-6a41-4ea1-9cff-6c38ea741a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:41.442482 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8c992-6a41-4ea1-9cff-6c38ea741a56 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:41.442770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8c992-6a41-4ea1-9cff-6c38ea741a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:41.443096 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8c992-6a41-4ea1-9cff-6c38ea741a56 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:41.443954 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff8c992-6a41-4ea1-9cff-6c38ea741a56 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:41.444271 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff8c992-6a41-4ea1-9cff-6c38ea741a56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:41.445804 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff8c992-6a41-4ea1-9cff-6c38ea741a56 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:41.450344 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b2dbc-74be-4a79-9bc9-bbc2b4817479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:41.451669 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b2dbc-74be-4a79-9bc9-bbc2b4817479 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:41.452361 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b2dbc-74be-4a79-9bc9-bbc2b4817479 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:41.452786 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b2dbc-74be-4a79-9bc9-bbc2b4817479 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:41.453780 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b2dbc-74be-4a79-9bc9-bbc2b4817479 None admin] RBAC: Adding query filter params (role.id=8d92e2d53a9441a9b6ddaaad264ac4c9, scope.project.id=f5bcfb30168d4753a6b0048a7935c78f, user.id=7637be4c30eb475ca2d6ac42a1e4ba76) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:41.454207 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 111/227] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:57:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:41.454698 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b2dbc-74be-4a79-9bc9-bbc2b4817479 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:41.454860 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8c992-6a41-4ea1-9cff-6c38ea741a56 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:41.456501 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b2dbc-74be-4a79-9bc9-bbc2b4817479 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:41.464263 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 117/228] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:57:41 2022] GET /identity/v3/role_assignments?user.id=7637be4c30eb475ca2d6ac42a1e4ba76&scope.project.id=f5bcfb30168d4753a6b0048a7935c78f&role.id=8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:41.465303 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b2dbc-74be-4a79-9bc9-bbc2b4817479 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:41.631426 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8c992-6a41-4ea1-9cff-6c38ea741a56 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:41.649540 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b2dbc-74be-4a79-9bc9-bbc2b4817479 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:41.690810 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c084909-f1db-4f61-88cd-eb0c45ec8c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:41.690810 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c084909-f1db-4f61-88cd-eb0c45ec8c42 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:41.690810 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c084909-f1db-4f61-88cd-eb0c45ec8c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:41.690810 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c084909-f1db-4f61-88cd-eb0c45ec8c42 None admin] PATH_INFO: `/v3/users/3e66ae8a37cb4db6bdf728e0790f8aa5` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:41.692310 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c084909-f1db-4f61-88cd-eb0c45ec8c42 None admin] RBAC: Authorizing `identity:get_user(user_id=3e66ae8a37cb4db6bdf728e0790f8aa5)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:41.696170 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c084909-f1db-4f61-88cd-eb0c45ec8c42 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:41.697870 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 112/229] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:57:41 2022] GET /identity/v3/users/3e66ae8a37cb4db6bdf728e0790f8aa5 => generated 283 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:41.701942 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25041a59-64db-4993-9a60-1ce04243bbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:41.702927 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25041a59-64db-4993-9a60-1ce04243bbae None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:41.703217 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25041a59-64db-4993-9a60-1ce04243bbae None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:41.703495 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25041a59-64db-4993-9a60-1ce04243bbae None admin] PATH_INFO: `/v3/users/3e66ae8a37cb4db6bdf728e0790f8aa5` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:41.704894 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c084909-f1db-4f61-88cd-eb0c45ec8c42 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:41.705883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25041a59-64db-4993-9a60-1ce04243bbae None admin] RBAC: Authorizing `identity:get_user(user_id=3e66ae8a37cb4db6bdf728e0790f8aa5)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:41.707402 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25041a59-64db-4993-9a60-1ce04243bbae None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:41.714044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 118/230] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:57:41 2022] GET /identity/v3/users/3e66ae8a37cb4db6bdf728e0790f8aa5 => generated 283 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:41.714947 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25041a59-64db-4993-9a60-1ce04243bbae None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:41.771829 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:41.780383 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:41.864179 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c084909-f1db-4f61-88cd-eb0c45ec8c42 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:41.877096 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25041a59-64db-4993-9a60-1ce04243bbae None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:41.899295 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567bbdc-a75f-413b-96c2-37f2e1fb664a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:41.900088 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567bbdc-a75f-413b-96c2-37f2e1fb664a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:41.900366 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567bbdc-a75f-413b-96c2-37f2e1fb664a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:41.900646 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567bbdc-a75f-413b-96c2-37f2e1fb664a None admin] PATH_INFO: `/v3/projects/f5bcfb30168d4753a6b0048a7935c78f` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:41.901880 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8567bbdc-a75f-413b-96c2-37f2e1fb664a None admin] RBAC: Authorizing `identity:get_project(project_id=f5bcfb30168d4753a6b0048a7935c78f)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:41.903363 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8567bbdc-a75f-413b-96c2-37f2e1fb664a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:41.905293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 113/231] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:57:41 2022] GET /identity/v3/projects/f5bcfb30168d4753a6b0048a7935c78f => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:41.910693 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567bbdc-a75f-413b-96c2-37f2e1fb664a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:41.916786 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d89db7-a44a-4de7-9d8f-74f300db4d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:41.917984 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d89db7-a44a-4de7-9d8f-74f300db4d8d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:41.918497 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d89db7-a44a-4de7-9d8f-74f300db4d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:41.918989 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d89db7-a44a-4de7-9d8f-74f300db4d8d None admin] PATH_INFO: `/v3/projects/f5bcfb30168d4753a6b0048a7935c78f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:41.920444 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d89db7-a44a-4de7-9d8f-74f300db4d8d None admin] RBAC: Authorizing `identity:get_project(project_id=f5bcfb30168d4753a6b0048a7935c78f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:41.922254 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d89db7-a44a-4de7-9d8f-74f300db4d8d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:41.924601 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 119/232] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:57:41 2022] GET /identity/v3/projects/f5bcfb30168d4753a6b0048a7935c78f => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:41.933890 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d89db7-a44a-4de7-9d8f-74f300db4d8d None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:42.007378 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:42.010279 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567bbdc-a75f-413b-96c2-37f2e1fb664a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:42.047877 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7d87c-96db-4ff0-9fc3-87c29c29ade1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:42.048779 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7d87c-96db-4ff0-9fc3-87c29c29ade1 None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:42.049067 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7d87c-96db-4ff0-9fc3-87c29c29ade1 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:42.049348 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7d87c-96db-4ff0-9fc3-87c29c29ade1 None admin] PATH_INFO: `/v3/projects/f5bcfb30168d4753a6b0048a7935c78f/users/3e66ae8a37cb4db6bdf728e0790f8aa5/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:42.051367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf7d87c-96db-4ff0-9fc3-87c29c29ade1 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5bcfb30168d4753a6b0048a7935c78f, user_id=3e66ae8a37cb4db6bdf728e0790f8aa5, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:42.052829 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf7d87c-96db-4ff0-9fc3-87c29c29ade1 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:42.057603 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:42.065584 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d89db7-a44a-4de7-9d8f-74f300db4d8d None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:42.067733 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 114/233] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Jul 4 03:57:41 2022] PUT /identity/v3/projects/f5bcfb30168d4753a6b0048a7935c78f/users/3e66ae8a37cb4db6bdf728e0790f8aa5/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 03:57:42.105290 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684b7c1-b89f-4648-8b75-ebc512971a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:42.106665 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684b7c1-b89f-4648-8b75-ebc512971a75 None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:42.107150 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684b7c1-b89f-4648-8b75-ebc512971a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:42.107688 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684b7c1-b89f-4648-8b75-ebc512971a75 None admin] PATH_INFO: `/v3/projects/f5bcfb30168d4753a6b0048a7935c78f/users/3e66ae8a37cb4db6bdf728e0790f8aa5/roles/a34eb11c5d95402e94c1bc45e635e387` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:42.110268 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6684b7c1-b89f-4648-8b75-ebc512971a75 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5bcfb30168d4753a6b0048a7935c78f, user_id=3e66ae8a37cb4db6bdf728e0790f8aa5, role_id=a34eb11c5d95402e94c1bc45e635e387)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:42.112008 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6684b7c1-b89f-4648-8b75-ebc512971a75 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:42.143890 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 120/234] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Jul 4 03:57:41 2022] PUT /identity/v3/projects/f5bcfb30168d4753a6b0048a7935c78f/users/3e66ae8a37cb4db6bdf728e0790f8aa5/roles/a34eb11c5d95402e94c1bc45e635e387 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 03:57:42.835703 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d34dca-66d4-4b1a-92e8-3c886be996a3 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:42.836112 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d34dca-66d4-4b1a-92e8-3c886be996a3 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:42.836279 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d34dca-66d4-4b1a-92e8-3c886be996a3 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:42.837955 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 115/235] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:42.843644 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b2ee1-aca2-4249-9dc0-2a4bace250bd None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:42.844105 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b2ee1-aca2-4249-9dc0-2a4bace250bd None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:42.844283 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b2ee1-aca2-4249-9dc0-2a4bace250bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:42.867242 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-5e5b2ee1-aca2-4249-9dc0-2a4bace250bd None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:42.868529 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5e5b2ee1-aca2-4249-9dc0-2a4bace250bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:42.954498 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 121/236] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:42.971009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb30c9e-5b36-4cac-9a4c-b1a6f7a7a54b None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:42.971127 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb30c9e-5b36-4cac-9a4c-b1a6f7a7a54b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:42.971326 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb30c9e-5b36-4cac-9a4c-b1a6f7a7a54b None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:42.972722 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 116/237] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:42.978013 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61add77b-b835-4b38-a5ae-708a57259b8c None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:42.978347 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61add77b-b835-4b38-a5ae-708a57259b8c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:42.978638 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61add77b-b835-4b38-a5ae-708a57259b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:42.990242 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb30c9e-5b36-4cac-9a4c-b1a6f7a7a54b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:42.997698 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-61add77b-b835-4b38-a5ae-708a57259b8c None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:42.999011 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-61add77b-b835-4b38-a5ae-708a57259b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:43.067778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 122/238] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:43.092645 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61add77b-b835-4b38-a5ae-708a57259b8c None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:43.115456 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:43.196897 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61add77b-b835-4b38-a5ae-708a57259b8c None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:43.230865 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb30c9e-5b36-4cac-9a4c-b1a6f7a7a54b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:43.233070 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05bc489-2f3f-479c-a0bc-86b616ceef8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:43.233900 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05bc489-2f3f-479c-a0bc-86b616ceef8e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:43.234210 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05bc489-2f3f-479c-a0bc-86b616ceef8e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:43.234504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05bc489-2f3f-479c-a0bc-86b616ceef8e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:43.235690 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05bc489-2f3f-479c-a0bc-86b616ceef8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:43.237209 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05bc489-2f3f-479c-a0bc-86b616ceef8e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:43.240037 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 123/239] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:57:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:43.246471 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05bc489-2f3f-479c-a0bc-86b616ceef8e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:43.350625 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:43.356568 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05bc489-2f3f-479c-a0bc-86b616ceef8e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:43.359422 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2afb37-f052-4212-a022-e254650f8b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:43.360251 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2afb37-f052-4212-a022-e254650f8b41 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:43.360542 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2afb37-f052-4212-a022-e254650f8b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:43.361085 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2afb37-f052-4212-a022-e254650f8b41 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:43.393267 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb201f-0d4f-4e08-b18e-79e414327ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:43.393965 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb201f-0d4f-4e08-b18e-79e414327ac0 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:43.394289 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb201f-0d4f-4e08-b18e-79e414327ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:43.394576 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb201f-0d4f-4e08-b18e-79e414327ac0 None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:43.395573 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb201f-0d4f-4e08-b18e-79e414327ac0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:43.397435 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb201f-0d4f-4e08-b18e-79e414327ac0 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:43.407042 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2afb37-f052-4212-a022-e254650f8b41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:57:43.420055 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 124/240] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Jul 4 03:57:43 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 03:57:43.424083 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-7b2afb37-f052-4212-a022-e254650f8b41 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 03:57:43.424083 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:43.424083 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:43.424083 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:43.424083 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:43.424083 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:43.424083 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:43.424083 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:43.424083 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:43.424083 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:43.424083 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:43.424083 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:43.424083 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:57:43.424083 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:57:43.424083 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:57:43.424083 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:57:43.424978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:57:43.424978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:57:43.424978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:57:43.424978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:57:43.424978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:43.424978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:43.424978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:43.424978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:43.424978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:43.424978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:43.424978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:43.424978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:43.424978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:43.424978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:43.424978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:43.424978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:43.425770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:43.425770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:43.425770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:43.425770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:43.425770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:57:43.425770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:57:43.425770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:57:43.425770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:57:43.425770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:57:43.425770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:57:43.425770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 03:57:43.425770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:57:43.425770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 117/241] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:57:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 436 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:57:43.433119 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb201f-0d4f-4e08-b18e-79e414327ac0 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:43.562415 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb201f-0d4f-4e08-b18e-79e414327ac0 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:43.600781 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a17f24-de16-42ba-a0ee-9301055a3094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:43.601423 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a17f24-de16-42ba-a0ee-9301055a3094 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:43.601719 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a17f24-de16-42ba-a0ee-9301055a3094 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:43.602007 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a17f24-de16-42ba-a0ee-9301055a3094 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:43.602907 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a17f24-de16-42ba-a0ee-9301055a3094 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:43.603234 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a17f24-de16-42ba-a0ee-9301055a3094 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:43.604697 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a17f24-de16-42ba-a0ee-9301055a3094 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:43.614962 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 125/242] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Jul 4 03:57:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:43.620806 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2afb37-f052-4212-a022-e254650f8b41 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:43.661282 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:43.751339 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2afb37-f052-4212-a022-e254650f8b41 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:43.787597 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47801634-93ad-443d-a32e-aa37e6c2b43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:43.788487 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47801634-93ad-443d-a32e-aa37e6c2b43b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:43.788770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47801634-93ad-443d-a32e-aa37e6c2b43b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:43.789050 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47801634-93ad-443d-a32e-aa37e6c2b43b None admin] PATH_INFO: `/v3/users/cc316c34274f42bb9a9cf70117f7b7ba` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:43.804627 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47801634-93ad-443d-a32e-aa37e6c2b43b None admin] RBAC: Authorizing `identity:get_user(user_id=cc316c34274f42bb9a9cf70117f7b7ba)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:43.806232 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47801634-93ad-443d-a32e-aa37e6c2b43b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:43.807979 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 118/243] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:57:43 2022] GET /identity/v3/users/cc316c34274f42bb9a9cf70117f7b7ba => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:43.813623 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a17f24-de16-42ba-a0ee-9301055a3094 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:43.820691 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:43.863172 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2b1fe-a42c-4738-84ca-11d121978385 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:43.863371 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2b1fe-a42c-4738-84ca-11d121978385 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:43.863662 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2b1fe-a42c-4738-84ca-11d121978385 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:43.867426 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 119/244] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 03:57:43.873688 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d37e76-f0d0-4a98-a161-dd056667fe55 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:43.873976 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d37e76-f0d0-4a98-a161-dd056667fe55 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:43.874297 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d37e76-f0d0-4a98-a161-dd056667fe55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:43.891790 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-85d37e76-f0d0-4a98-a161-dd056667fe55 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:43.893100 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-85d37e76-f0d0-4a98-a161-dd056667fe55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:43.959204 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a17f24-de16-42ba-a0ee-9301055a3094 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:43.974299 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 120/245] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 03:57:43.998617 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d37e76-f0d0-4a98-a161-dd056667fe55 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:44.013207 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:44.020029 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13521c6d-c453-49e2-809f-e88236fed998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:44.020825 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13521c6d-c453-49e2-809f-e88236fed998 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:44.021206 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13521c6d-c453-49e2-809f-e88236fed998 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:44.021582 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13521c6d-c453-49e2-809f-e88236fed998 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:44.093579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13521c6d-c453-49e2-809f-e88236fed998 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:44.095344 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13521c6d-c453-49e2-809f-e88236fed998 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:44.097426 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:44.119095 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d37e76-f0d0-4a98-a161-dd056667fe55 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:44.158605 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fbb0c-5ac4-4b6f-8e92-c3e62eeecb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:44.159817 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fbb0c-5ac4-4b6f-8e92-c3e62eeecb7c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:44.160308 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fbb0c-5ac4-4b6f-8e92-c3e62eeecb7c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:44.160780 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fbb0c-5ac4-4b6f-8e92-c3e62eeecb7c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:44.173382 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76fbb0c-5ac4-4b6f-8e92-c3e62eeecb7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:57:44.182084 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-a76fbb0c-5ac4-4b6f-8e92-c3e62eeecb7c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 03:57:44.182084 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:44.182084 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:44.182084 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:44.182084 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:44.182084 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:44.182084 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:44.182084 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:44.182084 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:44.182084 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:44.182084 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:44.182084 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:44.182084 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:57:44.182084 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:57:44.182084 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:57:44.182084 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:57:44.183050 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:57:44.183050 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:57:44.183050 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:57:44.183050 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:57:44.183050 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:44.183050 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:44.183050 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:44.183050 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:44.183050 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:44.183050 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:44.183050 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:44.183050 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:44.183050 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:44.183050 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:44.183050 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:44.183050 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:44.183839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:44.183839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:44.183839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:44.183839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:44.183839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:57:44.183839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:57:44.183839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:57:44.183839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:57:44.183839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:57:44.183839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:57:44.183839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 03:57:44.183839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:57:44.187125 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 121/246] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:57:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:57:44.193493 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fbb0c-5ac4-4b6f-8e92-c3e62eeecb7c None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:44.213435 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 126/247] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:57:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 03:57:44.219454 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13521c6d-c453-49e2-809f-e88236fed998 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:44.327647 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:44.393507 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fbb0c-5ac4-4b6f-8e92-c3e62eeecb7c None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:44.419930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13521c6d-c453-49e2-809f-e88236fed998 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:44.423124 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:44.462995 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5996d6-453b-4b1c-80b6-66b7ecb00d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:44.464310 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5996d6-453b-4b1c-80b6-66b7ecb00d4e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:44.464796 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5996d6-453b-4b1c-80b6-66b7ecb00d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:44.465278 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5996d6-453b-4b1c-80b6-66b7ecb00d4e None admin] PATH_INFO: `/v3/projects/f5bcfb30168d4753a6b0048a7935c78f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:44.466850 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5996d6-453b-4b1c-80b6-66b7ecb00d4e None admin] RBAC: Authorizing `identity:get_project(project_id=f5bcfb30168d4753a6b0048a7935c78f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:44.468722 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5996d6-453b-4b1c-80b6-66b7ecb00d4e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:44.471024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 127/248] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:57:44 2022] GET /identity/v3/projects/f5bcfb30168d4753a6b0048a7935c78f => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:44.474899 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6df148-d033-4573-8649-56b5e768e184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:44.475599 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6df148-d033-4573-8649-56b5e768e184 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:44.475897 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6df148-d033-4573-8649-56b5e768e184 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:44.476181 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6df148-d033-4573-8649-56b5e768e184 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:44.477005 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6df148-d033-4573-8649-56b5e768e184 None admin] RBAC: Adding query filter params (name=member) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:44.477299 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6df148-d033-4573-8649-56b5e768e184 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:44.478300 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5996d6-453b-4b1c-80b6-66b7ecb00d4e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:44.478743 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6df148-d033-4573-8649-56b5e768e184 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:44.493985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 122/249] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Jul 4 03:57:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:57:44.500834 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6df148-d033-4573-8649-56b5e768e184 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:44.599164 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5996d6-453b-4b1c-80b6-66b7ecb00d4e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:44.645412 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80b4c0-39ed-4d84-ab7c-b13003a62f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:44.646533 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80b4c0-39ed-4d84-ab7c-b13003a62f14 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:44.647030 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80b4c0-39ed-4d84-ab7c-b13003a62f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:44.647527 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80b4c0-39ed-4d84-ab7c-b13003a62f14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:44.648617 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae80b4c0-39ed-4d84-ab7c-b13003a62f14 None admin] RBAC: Adding query filter params (role.id=99db92117d0048efaae5874a11d96ce9, scope.project.id=f5bcfb30168d4753a6b0048a7935c78f, user.id=cc316c34274f42bb9a9cf70117f7b7ba) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:44.649212 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae80b4c0-39ed-4d84-ab7c-b13003a62f14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:44.651430 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae80b4c0-39ed-4d84-ab7c-b13003a62f14 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:44.669181 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 128/250] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:57:44 2022] GET /identity/v3/role_assignments?user.id=cc316c34274f42bb9a9cf70117f7b7ba&scope.project.id=f5bcfb30168d4753a6b0048a7935c78f&role.id=99db92117d0048efaae5874a11d96ce9 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:44.754596 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6df148-d033-4573-8649-56b5e768e184 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:44.777972 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc984f5-562e-407a-97b2-ca13f54e039d None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:44.778359 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc984f5-562e-407a-97b2-ca13f54e039d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:44.778568 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc984f5-562e-407a-97b2-ca13f54e039d None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:44.780912 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 129/251] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:44.787383 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ee181-bd71-4d7a-9205-19f1a9cce72f None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:44.787695 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ee181-bd71-4d7a-9205-19f1a9cce72f None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:44.787953 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ee181-bd71-4d7a-9205-19f1a9cce72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:44.807039 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-0b2ee181-bd71-4d7a-9205-19f1a9cce72f None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:44.808782 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0b2ee181-bd71-4d7a-9205-19f1a9cce72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:44.822564 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:44.838918 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae0167-d7fa-4953-b50a-cbd7b77dcdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:44.839250 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:44.839839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae0167-d7fa-4953-b50a-cbd7b77dcdbd None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:44.840137 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae0167-d7fa-4953-b50a-cbd7b77dcdbd None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:44.840413 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae0167-d7fa-4953-b50a-cbd7b77dcdbd None admin] PATH_INFO: `/v3/users/7637be4c30eb475ca2d6ac42a1e4ba76` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:44.841742 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae0167-d7fa-4953-b50a-cbd7b77dcdbd None admin] RBAC: Authorizing `identity:get_user(user_id=7637be4c30eb475ca2d6ac42a1e4ba76)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:44.843316 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae0167-d7fa-4953-b50a-cbd7b77dcdbd None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:44.845186 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 123/252] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:57:44 2022] GET /identity/v3/users/7637be4c30eb475ca2d6ac42a1e4ba76 => generated 297 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:57:44.850986 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae0167-d7fa-4953-b50a-cbd7b77dcdbd None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:44.885755 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 130/253] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 03:57:44.911423 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ee181-bd71-4d7a-9205-19f1a9cce72f None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:45.030813 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae0167-d7fa-4953-b50a-cbd7b77dcdbd None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:45.067409 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b8784-e064-4772-9cc9-5fa46781fb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:45.068619 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b8784-e064-4772-9cc9-5fa46781fb2e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:45.069185 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b8784-e064-4772-9cc9-5fa46781fb2e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:45.069639 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b8784-e064-4772-9cc9-5fa46781fb2e None admin] PATH_INFO: `/v3/projects/f5bcfb30168d4753a6b0048a7935c78f` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:45.071167 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b8784-e064-4772-9cc9-5fa46781fb2e None admin] RBAC: Authorizing `identity:get_project(project_id=f5bcfb30168d4753a6b0048a7935c78f)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:45.072805 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b8784-e064-4772-9cc9-5fa46781fb2e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:45.074832 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 124/254] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:57:44 2022] GET /identity/v3/projects/f5bcfb30168d4753a6b0048a7935c78f => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:57:45.076334 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89990a42-3b3f-494c-a743-249ac730d86b None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:45.076821 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89990a42-3b3f-494c-a743-249ac730d86b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:45.077308 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89990a42-3b3f-494c-a743-249ac730d86b None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:45.078788 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 125/255] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:45.080992 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ee181-bd71-4d7a-9205-19f1a9cce72f None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:45.082405 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89990a42-3b3f-494c-a743-249ac730d86b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:45.154930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c6d7b-dc02-4f53-b410-7e62a60dc4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:45.156095 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c6d7b-dc02-4f53-b410-7e62a60dc4e3 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:45.156575 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c6d7b-dc02-4f53-b410-7e62a60dc4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:45.157043 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c6d7b-dc02-4f53-b410-7e62a60dc4e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:45.168880 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4c6d7b-dc02-4f53-b410-7e62a60dc4e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:57:45.177317 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-4c4c6d7b-dc02-4f53-b410-7e62a60dc4e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:57:45.177317 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:45.177317 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:45.177317 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:45.177317 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:45.177317 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:45.177317 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:45.177317 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:45.177317 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:45.177317 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:45.177317 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:45.177317 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:45.177317 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:57:45.177317 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:57:45.177317 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:57:45.177317 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:57:45.178247 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:57:45.178247 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:57:45.178247 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:57:45.178247 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:57:45.178247 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:45.178247 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:45.178247 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:45.178247 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:45.178247 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:45.178247 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:45.178247 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:45.178247 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:45.178247 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:45.178247 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:45.178247 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:45.178247 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:45.179044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:45.179044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:45.179044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:45.179044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:45.179044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:57:45.179044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:57:45.179044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:57:45.179044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:57:45.179044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:57:45.179044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:57:45.179044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:57:45.179044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:57:45.181753 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 131/256] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Jul 4 03:57:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:57:45.187427 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58e5d6-f565-4b89-a3d2-c6b330ccd8c7 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:45.187950 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58e5d6-f565-4b89-a3d2-c6b330ccd8c7 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:45.188424 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58e5d6-f565-4b89-a3d2-c6b330ccd8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:45.200447 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:45.208850 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-ae58e5d6-f565-4b89-a3d2-c6b330ccd8c7 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:45.210452 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ae58e5d6-f565-4b89-a3d2-c6b330ccd8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:45.229234 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:45.269212 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89990a42-3b3f-494c-a743-249ac730d86b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:45.304733 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 132/257] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:45.305768 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58e5d6-f565-4b89-a3d2-c6b330ccd8c7 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:45.341812 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f548d-cbef-44fc-9a4e-6fb173afe08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:45.342752 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f548d-cbef-44fc-9a4e-6fb173afe08c None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:45.343034 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f548d-cbef-44fc-9a4e-6fb173afe08c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:45.343313 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f548d-cbef-44fc-9a4e-6fb173afe08c None admin] PATH_INFO: `/v3/projects/f5bcfb30168d4753a6b0048a7935c78f/users/7637be4c30eb475ca2d6ac42a1e4ba76/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:45.346591 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f548d-cbef-44fc-9a4e-6fb173afe08c None admin] RBAC: Authorizing `identity:create_grant(project_id=f5bcfb30168d4753a6b0048a7935c78f, user_id=7637be4c30eb475ca2d6ac42a1e4ba76, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:45.348064 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f548d-cbef-44fc-9a4e-6fb173afe08c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:45.375739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 126/258] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Jul 4 03:57:45 2022] PUT /identity/v3/projects/f5bcfb30168d4753a6b0048a7935c78f/users/7637be4c30eb475ca2d6ac42a1e4ba76/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 03:57:45.376719 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f548d-cbef-44fc-9a4e-6fb173afe08c None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:45.517766 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58e5d6-f565-4b89-a3d2-c6b330ccd8c7 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:45.589653 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34003aed-8119-4033-875f-10d6dcbc341f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:45.590747 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34003aed-8119-4033-875f-10d6dcbc341f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:45.591271 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34003aed-8119-4033-875f-10d6dcbc341f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:45.592041 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34003aed-8119-4033-875f-10d6dcbc341f None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:45.593675 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34003aed-8119-4033-875f-10d6dcbc341f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:45.594317 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34003aed-8119-4033-875f-10d6dcbc341f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:45.602202 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f548d-cbef-44fc-9a4e-6fb173afe08c None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:45.603270 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34003aed-8119-4033-875f-10d6dcbc341f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:45.625066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 133/259] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:57:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:45.630995 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34003aed-8119-4033-875f-10d6dcbc341f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:45.662975 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:45.664007 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:45.686635 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28050c39-0321-4f97-897c-5b023d06781b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:45.687477 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28050c39-0321-4f97-897c-5b023d06781b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:45.687758 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28050c39-0321-4f97-897c-5b023d06781b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:45.688037 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28050c39-0321-4f97-897c-5b023d06781b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:45.718016 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28050c39-0321-4f97-897c-5b023d06781b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:57:45.726416 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-28050c39-0321-4f97-897c-5b023d06781b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 03:57:45.726416 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:45.726416 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:45.726416 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:45.726416 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:45.726416 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:45.726416 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:45.726416 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:45.726416 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:45.726416 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:45.726416 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:45.726416 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:45.726416 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:57:45.726416 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:57:45.726416 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:57:45.726416 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:57:45.727384 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:57:45.727384 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:57:45.727384 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:57:45.727384 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:57:45.727384 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:45.727384 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:45.727384 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:45.727384 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:45.727384 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:45.727384 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:45.727384 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:45.727384 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:45.727384 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:45.727384 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:45.727384 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:45.727384 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:45.728258 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:45.728258 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:45.728258 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:45.728258 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:45.728258 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:57:45.728258 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:57:45.728258 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:57:45.728258 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:57:45.728258 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:57:45.728258 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:57:45.728258 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 03:57:45.728258 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:57:45.728258 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 127/260] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Jul 4 03:57:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:57:45.733448 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28050c39-0321-4f97-897c-5b023d06781b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:45.797755 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34003aed-8119-4033-875f-10d6dcbc341f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:45.867644 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7413bbd-1324-4e38-b0aa-eb0dfde1f37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:45.868631 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7413bbd-1324-4e38-b0aa-eb0dfde1f37e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:45.868914 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7413bbd-1324-4e38-b0aa-eb0dfde1f37e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:45.869189 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7413bbd-1324-4e38-b0aa-eb0dfde1f37e None admin] PATH_INFO: `/v3/users/3e66ae8a37cb4db6bdf728e0790f8aa5` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:45.873804 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7413bbd-1324-4e38-b0aa-eb0dfde1f37e None admin] RBAC: Authorizing `identity:get_user(user_id=3e66ae8a37cb4db6bdf728e0790f8aa5)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:45.875418 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7413bbd-1324-4e38-b0aa-eb0dfde1f37e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:45.877404 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 134/261] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:57:45 2022] GET /identity/v3/users/3e66ae8a37cb4db6bdf728e0790f8aa5 => generated 283 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:57:45.882910 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7413bbd-1324-4e38-b0aa-eb0dfde1f37e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:45.918591 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28050c39-0321-4f97-897c-5b023d06781b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:45.990888 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fda801-46cf-4cf0-a54e-99f4569d59c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:45.991914 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fda801-46cf-4cf0-a54e-99f4569d59c2 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:45.992206 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fda801-46cf-4cf0-a54e-99f4569d59c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:45.992491 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fda801-46cf-4cf0-a54e-99f4569d59c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:45.993406 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fda801-46cf-4cf0-a54e-99f4569d59c2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:45.993721 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fda801-46cf-4cf0-a54e-99f4569d59c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:45.995635 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fda801-46cf-4cf0-a54e-99f4569d59c2 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:46.006252 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 128/262] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:57:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:46.012350 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fda801-46cf-4cf0-a54e-99f4569d59c2 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:46.064819 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:46.089438 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:46.108954 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7413bbd-1324-4e38-b0aa-eb0dfde1f37e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:46.206879 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef1cc8-b73f-4805-b2fc-331c75095171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:46.207556 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef1cc8-b73f-4805-b2fc-331c75095171 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:46.207845 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef1cc8-b73f-4805-b2fc-331c75095171 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:46.208126 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef1cc8-b73f-4805-b2fc-331c75095171 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:46.208291 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fda801-46cf-4cf0-a54e-99f4569d59c2 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:46.260115 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef30cad-a655-4119-b8fb-6c9b365da676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:46.261772 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef30cad-a655-4119-b8fb-6c9b365da676 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:46.262316 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef30cad-a655-4119-b8fb-6c9b365da676 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:46.262791 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef30cad-a655-4119-b8fb-6c9b365da676 None admin] PATH_INFO: `/v3/users/3e66ae8a37cb4db6bdf728e0790f8aa5` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:46.264371 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef30cad-a655-4119-b8fb-6c9b365da676 None admin] RBAC: Authorizing `identity:get_user(user_id=3e66ae8a37cb4db6bdf728e0790f8aa5)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:46.266068 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef30cad-a655-4119-b8fb-6c9b365da676 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:46.268312 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 129/263] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:57:46 2022] GET /identity/v3/users/3e66ae8a37cb4db6bdf728e0790f8aa5 => generated 283 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:57:46.275198 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef30cad-a655-4119-b8fb-6c9b365da676 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:46.315476 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef1cc8-b73f-4805-b2fc-331c75095171 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:46.316949 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef1cc8-b73f-4805-b2fc-331c75095171 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:46.402847 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:46.422178 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 135/264] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:57:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 04 03:57:46.425405 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef1cc8-b73f-4805-b2fc-331c75095171 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:46.471901 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef30cad-a655-4119-b8fb-6c9b365da676 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:46.515379 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:46.524968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef1cc8-b73f-4805-b2fc-331c75095171 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:46.560976 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a199a-e36c-4434-b6e8-8efc0412cd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:46.561873 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a199a-e36c-4434-b6e8-8efc0412cd0d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:46.562174 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a199a-e36c-4434-b6e8-8efc0412cd0d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:46.562645 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a199a-e36c-4434-b6e8-8efc0412cd0d None admin] PATH_INFO: `/v3/projects/f5bcfb30168d4753a6b0048a7935c78f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:46.563830 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a199a-e36c-4434-b6e8-8efc0412cd0d None admin] RBAC: Authorizing `identity:get_project(project_id=f5bcfb30168d4753a6b0048a7935c78f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:46.565320 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a199a-e36c-4434-b6e8-8efc0412cd0d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:46.567457 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 136/265] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:57:46 2022] GET /identity/v3/projects/f5bcfb30168d4753a6b0048a7935c78f => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:57:46.568603 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314dd96-7692-4181-98a2-981d2e5804a0 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:46.568886 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314dd96-7692-4181-98a2-981d2e5804a0 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:46.569162 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314dd96-7692-4181-98a2-981d2e5804a0 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:46.575150 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 137/266] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:46.575935 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e3c5b-fd2e-4417-b562-ec867ac5fe0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:46.576061 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314dd96-7692-4181-98a2-981d2e5804a0 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:46.576790 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e3c5b-fd2e-4417-b562-ec867ac5fe0a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:46.576990 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e3c5b-fd2e-4417-b562-ec867ac5fe0a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:46.577429 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e3c5b-fd2e-4417-b562-ec867ac5fe0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:46.674370 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:46.716705 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7e3c5b-fd2e-4417-b562-ec867ac5fe0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:46.718536 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7e3c5b-fd2e-4417-b562-ec867ac5fe0a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:46.776210 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314dd96-7692-4181-98a2-981d2e5804a0 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:46.844944 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2939c-b197-45b0-9148-37b4d87bc9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:46.847064 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2939c-b197-45b0-9148-37b4d87bc9ae None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:46.847566 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2939c-b197-45b0-9148-37b4d87bc9ae None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:46.848037 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2939c-b197-45b0-9148-37b4d87bc9ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:46.850375 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd2939c-b197-45b0-9148-37b4d87bc9ae None admin] RBAC: Adding query filter params (role.id=2eee98054d42475bb7e22a8487ab235e, scope.project.id=f5bcfb30168d4753a6b0048a7935c78f, user.id=3e66ae8a37cb4db6bdf728e0790f8aa5) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:46.852514 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd2939c-b197-45b0-9148-37b4d87bc9ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:46.854236 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd2939c-b197-45b0-9148-37b4d87bc9ae None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:46.868278 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 138/267] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:57:46 2022] GET /identity/v3/role_assignments?user.id=3e66ae8a37cb4db6bdf728e0790f8aa5&scope.project.id=f5bcfb30168d4753a6b0048a7935c78f&role.id=2eee98054d42475bb7e22a8487ab235e => generated 608 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:46.876051 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac426ed-6620-43fc-a00d-6b9efc89019e None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:46.876051 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac426ed-6620-43fc-a00d-6b9efc89019e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:46.876333 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac426ed-6620-43fc-a00d-6b9efc89019e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:46.884210 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 130/268] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:57:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 03:57:46.890481 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e3c5b-fd2e-4417-b562-ec867ac5fe0a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:46.907460 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-2ac426ed-6620-43fc-a00d-6b9efc89019e None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:46.908563 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-2ac426ed-6620-43fc-a00d-6b9efc89019e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:46.922479 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:47.033575 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e3c5b-fd2e-4417-b562-ec867ac5fe0a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:47.071041 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e7fbf-cbdf-4da2-b453-4010e75d24d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:47.072304 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e7fbf-cbdf-4da2-b453-4010e75d24d4 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:47.072818 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e7fbf-cbdf-4da2-b453-4010e75d24d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:47.073296 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e7fbf-cbdf-4da2-b453-4010e75d24d4 None admin] PATH_INFO: `/v3/projects/f5bcfb30168d4753a6b0048a7935c78f` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:47.074921 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e7fbf-cbdf-4da2-b453-4010e75d24d4 None admin] RBAC: Authorizing `identity:get_project(project_id=f5bcfb30168d4753a6b0048a7935c78f)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:47.076745 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e7fbf-cbdf-4da2-b453-4010e75d24d4 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:47.079218 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 131/269] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:57:46 2022] GET /identity/v3/projects/f5bcfb30168d4753a6b0048a7935c78f => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:47.080815 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325013f-8241-4868-ba0a-b72f868ccf04 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:47.081329 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325013f-8241-4868-ba0a-b72f868ccf04 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:47.081804 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325013f-8241-4868-ba0a-b72f868ccf04 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:47.083418 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 132/270] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:47.084981 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325013f-8241-4868-ba0a-b72f868ccf04 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:47.100719 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 139/271] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:47.102186 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a5c13-949a-44a7-a259-462af1ae7ad7 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:47.102472 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a5c13-949a-44a7-a259-462af1ae7ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:47.102753 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a5c13-949a-44a7-a259-462af1ae7ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:47.140803 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-da4a5c13-949a-44a7-a259-462af1ae7ad7 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:47.142190 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-da4a5c13-949a-44a7-a259-462af1ae7ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:47.181877 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:47.201647 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:47.204104 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325013f-8241-4868-ba0a-b72f868ccf04 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:47.230770 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 140/272] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:47.232033 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a5c13-949a-44a7-a259-462af1ae7ad7 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:47.240425 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1db24-1919-4b2a-8a97-63ae64750262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:47.240763 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1db24-1919-4b2a-8a97-63ae64750262 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:47.241053 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1db24-1919-4b2a-8a97-63ae64750262 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:47.241339 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1db24-1919-4b2a-8a97-63ae64750262 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:47.242197 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1db24-1919-4b2a-8a97-63ae64750262 None admin] RBAC: Adding query filter params (role.id=a34eb11c5d95402e94c1bc45e635e387, scope.project.id=f5bcfb30168d4753a6b0048a7935c78f, user.id=3e66ae8a37cb4db6bdf728e0790f8aa5) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:47.242521 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1db24-1919-4b2a-8a97-63ae64750262 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:47.244052 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1db24-1919-4b2a-8a97-63ae64750262 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:47.250344 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 133/273] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:57:47 2022] GET /identity/v3/role_assignments?user.id=3e66ae8a37cb4db6bdf728e0790f8aa5&scope.project.id=f5bcfb30168d4753a6b0048a7935c78f&role.id=a34eb11c5d95402e94c1bc45e635e387 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:47.282102 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1db24-1919-4b2a-8a97-63ae64750262 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:47.363994 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a5c13-949a-44a7-a259-462af1ae7ad7 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:47.394300 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1db24-1919-4b2a-8a97-63ae64750262 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:47.405806 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e2a54-d145-4eca-998c-503afd419f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:47.406935 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e2a54-d145-4eca-998c-503afd419f01 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:47.407449 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e2a54-d145-4eca-998c-503afd419f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:47.407904 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e2a54-d145-4eca-998c-503afd419f01 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:47.409268 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e2a54-d145-4eca-998c-503afd419f01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:47.411052 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e2a54-d145-4eca-998c-503afd419f01 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:47.413358 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 141/274] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:57:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:47.418648 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e2a54-d145-4eca-998c-503afd419f01 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:47.438101 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92f2b2-af28-4cdb-b981-5f72881236ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:47.439057 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92f2b2-af28-4cdb-b981-5f72881236ea None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:47.439342 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92f2b2-af28-4cdb-b981-5f72881236ea None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:47.439669 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92f2b2-af28-4cdb-b981-5f72881236ea None admin] PATH_INFO: `/v3/roles/member` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:47.454181 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92f2b2-af28-4cdb-b981-5f72881236ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:57:47.461276 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-bb92f2b2-af28-4cdb-b981-5f72881236ea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 03:57:47.461276 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:47.461276 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:47.461276 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:47.461276 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:47.461276 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:47.461276 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:47.461276 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:47.461276 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:47.461276 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:47.461276 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:47.461276 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:47.461276 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:57:47.461276 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:57:47.461276 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:57:47.461276 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:57:47.462347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:57:47.462347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:57:47.462347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:57:47.462347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:57:47.462347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:47.462347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:47.462347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:47.462347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:47.462347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:47.462347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:47.462347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:47.462347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:47.462347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:47.462347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:47.462347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:47.462347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:47.463143 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:47.463143 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:47.463143 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:47.463143 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:47.463143 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:57:47.463143 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:57:47.463143 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:57:47.463143 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:57:47.463143 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:57:47.463143 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:57:47.463143 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 03:57:47.463143 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:57:47.463143 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 134/275] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:57:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:57:47.470195 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92f2b2-af28-4cdb-b981-5f72881236ea None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:47.482588 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:47.507654 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:47.586816 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e2a54-d145-4eca-998c-503afd419f01 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:47.591551 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92f2b2-af28-4cdb-b981-5f72881236ea None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:47.631397 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e37d43-68ce-4f6e-a130-722a4b944852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:47.632002 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e37d43-68ce-4f6e-a130-722a4b944852 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:47.632296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e37d43-68ce-4f6e-a130-722a4b944852 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:47.632579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e37d43-68ce-4f6e-a130-722a4b944852 None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:47.633378 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e37d43-68ce-4f6e-a130-722a4b944852 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:47.634733 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdca802-4e58-4182-889e-79851766a3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:47.634938 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e37d43-68ce-4f6e-a130-722a4b944852 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:47.635829 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdca802-4e58-4182-889e-79851766a3d1 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:47.636086 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdca802-4e58-4182-889e-79851766a3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:47.636687 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdca802-4e58-4182-889e-79851766a3d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:47.637449 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdca802-4e58-4182-889e-79851766a3d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:47.637757 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdca802-4e58-4182-889e-79851766a3d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:47.639190 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdca802-4e58-4182-889e-79851766a3d1 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:47.649107 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 135/276] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Jul 4 03:57:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:57:47.650962 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed872dd-ab77-4710-b1f3-6ca239444e96 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:47.651195 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed872dd-ab77-4710-b1f3-6ca239444e96 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:47.651474 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed872dd-ab77-4710-b1f3-6ca239444e96 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:47.656930 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 136/277] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:47.656930 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed872dd-ab77-4710-b1f3-6ca239444e96 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:47.663772 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 142/278] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Jul 4 03:57:47 2022] POST /identity/v3/users => generated 293 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 03:57:47.665013 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ff36f-ce85-4c63-bb56-5ad53eabec7e None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:47.665348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ff36f-ce85-4c63-bb56-5ad53eabec7e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:47.665740 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ff36f-ce85-4c63-bb56-5ad53eabec7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:47.687913 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-990ff36f-ce85-4c63-bb56-5ad53eabec7e None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:47.689821 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-990ff36f-ce85-4c63-bb56-5ad53eabec7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:47.755989 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:47.793419 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 143/279] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:47.800033 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed872dd-ab77-4710-b1f3-6ca239444e96 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:47.813522 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ff36f-ce85-4c63-bb56-5ad53eabec7e None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:47.843272 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9901a3-2630-4115-884f-a3b5e85821cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:47.844263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9901a3-2630-4115-884f-a3b5e85821cc None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:47.844559 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9901a3-2630-4115-884f-a3b5e85821cc None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:47.844842 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9901a3-2630-4115-884f-a3b5e85821cc None admin] PATH_INFO: `/v3/users/64bb722b359844c1abdbff57b7488f32` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:47.849707 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:47.863096 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9901a3-2630-4115-884f-a3b5e85821cc None admin] RBAC: Authorizing `identity:get_user(user_id=64bb722b359844c1abdbff57b7488f32)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:47.866398 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9901a3-2630-4115-884f-a3b5e85821cc None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:47.868631 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 137/280] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:57:47 2022] GET /identity/v3/users/64bb722b359844c1abdbff57b7488f32 => generated 293 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:57:47.875809 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9901a3-2630-4115-884f-a3b5e85821cc None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:47.943414 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ff36f-ce85-4c63-bb56-5ad53eabec7e None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:47.988776 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c988f-6268-4456-80bd-d02d64bc53bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:47.989613 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c988f-6268-4456-80bd-d02d64bc53bb None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:47.989900 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c988f-6268-4456-80bd-d02d64bc53bb None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:47.990202 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c988f-6268-4456-80bd-d02d64bc53bb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:48.005393 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c988f-6268-4456-80bd-d02d64bc53bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:57:48.009248 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9901a3-2630-4115-884f-a3b5e85821cc None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:48.014029 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-098c988f-6268-4456-80bd-d02d64bc53bb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 03:57:48.014029 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:48.014029 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:48.014029 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:48.014029 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:48.014029 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:48.014029 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:48.014029 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:48.014029 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:48.014029 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:48.014029 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:48.014029 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:48.014029 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:57:48.014029 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:57:48.014029 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:57:48.014029 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:57:48.014950 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:57:48.014950 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:57:48.014950 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:57:48.014950 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:57:48.014950 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:48.014950 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:48.014950 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:48.014950 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:48.014950 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:48.014950 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:48.014950 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:48.014950 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:48.014950 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:48.014950 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:48.014950 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:48.014950 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:48.015940 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:48.015940 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:48.015940 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:48.015940 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:48.015940 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:57:48.015940 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:57:48.015940 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:57:48.015940 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:57:48.015940 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:57:48.015940 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:57:48.015940 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 03:57:48.015940 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:57:48.015940 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 144/281] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:57:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:57:48.023746 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c988f-6268-4456-80bd-d02d64bc53bb None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:48.042969 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:48.055306 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb6c05-278e-4999-b08a-30f08bcece54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:48.056112 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb6c05-278e-4999-b08a-30f08bcece54 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:48.056468 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb6c05-278e-4999-b08a-30f08bcece54 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:48.057107 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb6c05-278e-4999-b08a-30f08bcece54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:48.058086 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb6c05-278e-4999-b08a-30f08bcece54 None admin] RBAC: Adding query filter params (role.id=8d92e2d53a9441a9b6ddaaad264ac4c9, user.id=64bb722b359844c1abdbff57b7488f32, scope.system=all) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:48.058768 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb6c05-278e-4999-b08a-30f08bcece54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:48.061069 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb6c05-278e-4999-b08a-30f08bcece54 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:48.070191 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 138/282] 10.222.0.49 () {56 vars in 1308 bytes} [Mon Jul 4 03:57:47 2022] GET /identity/v3/role_assignments?user.id=64bb722b359844c1abdbff57b7488f32&scope.system=all&role.id=8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:57:48.145370 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:48.158095 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c988f-6268-4456-80bd-d02d64bc53bb None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:48.205562 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a00c9-3179-4e8a-9554-ed245fc9679c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:48.206688 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a00c9-3179-4e8a-9554-ed245fc9679c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:48.207202 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a00c9-3179-4e8a-9554-ed245fc9679c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:48.207688 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a00c9-3179-4e8a-9554-ed245fc9679c None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:48.208670 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a00c9-3179-4e8a-9554-ed245fc9679c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:48.209212 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a00c9-3179-4e8a-9554-ed245fc9679c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:48.210938 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a00c9-3179-4e8a-9554-ed245fc9679c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:48.221637 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 145/283] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Jul 4 03:57:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:48.227275 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb6c05-278e-4999-b08a-30f08bcece54 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:48.278148 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998d036-1a3e-4edf-bbd9-d36cb99f314a None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:48.278505 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998d036-1a3e-4edf-bbd9-d36cb99f314a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:48.280603 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998d036-1a3e-4edf-bbd9-d36cb99f314a None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:48.280603 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 146/284] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:48.286631 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb16f0-2e96-4b1e-9af7-0cbb4cc5d67d None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:48.286921 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb16f0-2e96-4b1e-9af7-0cbb4cc5d67d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:48.287203 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb16f0-2e96-4b1e-9af7-0cbb4cc5d67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:48.307139 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-10fb16f0-2e96-4b1e-9af7-0cbb4cc5d67d None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:48.308361 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-10fb16f0-2e96-4b1e-9af7-0cbb4cc5d67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:48.365791 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb6c05-278e-4999-b08a-30f08bcece54 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:48.400914 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed79cb-2541-4be8-86e0-ca2126dff1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:48.401810 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed79cb-2541-4be8-86e0-ca2126dff1ba None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:48.402097 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed79cb-2541-4be8-86e0-ca2126dff1ba None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:48.402439 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed79cb-2541-4be8-86e0-ca2126dff1ba None admin] PATH_INFO: `/v3/users/cc316c34274f42bb9a9cf70117f7b7ba` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:48.403631 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed79cb-2541-4be8-86e0-ca2126dff1ba None admin] RBAC: Authorizing `identity:get_user(user_id=cc316c34274f42bb9a9cf70117f7b7ba)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:48.405104 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed79cb-2541-4be8-86e0-ca2126dff1ba None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:48.407106 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 139/285] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:57:48 2022] GET /identity/v3/users/cc316c34274f42bb9a9cf70117f7b7ba => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:48.412474 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed79cb-2541-4be8-86e0-ca2126dff1ba None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:48.446263 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 147/286] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 03:57:48.496417 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:48.497371 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb16f0-2e96-4b1e-9af7-0cbb4cc5d67d None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:48.571651 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed79cb-2541-4be8-86e0-ca2126dff1ba None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:48.620061 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109941e-3c2c-4735-b945-1902f55b8906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:48.620995 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109941e-3c2c-4735-b945-1902f55b8906 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:48.621215 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109941e-3c2c-4735-b945-1902f55b8906 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:48.621496 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109941e-3c2c-4735-b945-1902f55b8906 None admin] PATH_INFO: `/v3/projects/f5bcfb30168d4753a6b0048a7935c78f` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:48.622734 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109941e-3c2c-4735-b945-1902f55b8906 None admin] RBAC: Authorizing `identity:get_project(project_id=f5bcfb30168d4753a6b0048a7935c78f)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:48.624217 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109941e-3c2c-4735-b945-1902f55b8906 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:48.630929 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 140/287] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:57:48 2022] GET /identity/v3/projects/f5bcfb30168d4753a6b0048a7935c78f => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:57:48.635846 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109941e-3c2c-4735-b945-1902f55b8906 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:48.641760 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:48.662731 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb16f0-2e96-4b1e-9af7-0cbb4cc5d67d None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:48.705091 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52edb4-129f-4957-808d-df3bdead60fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:48.706353 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52edb4-129f-4957-808d-df3bdead60fd None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:48.706891 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52edb4-129f-4957-808d-df3bdead60fd None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:48.707367 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52edb4-129f-4957-808d-df3bdead60fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:48.727990 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e52edb4-129f-4957-808d-df3bdead60fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:57:48.737024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-2e52edb4-129f-4957-808d-df3bdead60fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 03:57:48.737024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:48.737024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:48.737024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:48.737024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:48.737024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:48.737024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:48.737024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:48.737024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:48.737024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:48.737024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:48.737024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:48.737024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:57:48.737024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:57:48.737024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:57:48.737024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:57:48.737908 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:57:48.737908 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:57:48.737908 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:57:48.737908 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:57:48.737908 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:48.737908 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:48.737908 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:48.737908 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:48.737908 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:48.737908 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:48.737908 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:48.737908 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:48.737908 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:48.737908 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:48.737908 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:48.737908 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:48.738758 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:48.738758 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:48.738758 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:48.738758 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:48.738758 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:57:48.738758 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:57:48.738758 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:57:48.738758 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:57:48.738758 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:57:48.738758 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:57:48.738758 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 03:57:48.738758 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:57:48.742092 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 148/288] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:57:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:57:48.748787 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52edb4-129f-4957-808d-df3bdead60fd None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:48.830681 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109941e-3c2c-4735-b945-1902f55b8906 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:48.880662 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:48.889197 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155263d2-2f14-44b0-bc33-358755ed2c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:48.890107 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155263d2-2f14-44b0-bc33-358755ed2c56 None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:48.890428 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155263d2-2f14-44b0-bc33-358755ed2c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:48.890714 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155263d2-2f14-44b0-bc33-358755ed2c56 None admin] PATH_INFO: `/v3/projects/f5bcfb30168d4753a6b0048a7935c78f/users/cc316c34274f42bb9a9cf70117f7b7ba/roles/99db92117d0048efaae5874a11d96ce9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:48.892746 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155263d2-2f14-44b0-bc33-358755ed2c56 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5bcfb30168d4753a6b0048a7935c78f, user_id=cc316c34274f42bb9a9cf70117f7b7ba, role_id=99db92117d0048efaae5874a11d96ce9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:48.894607 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155263d2-2f14-44b0-bc33-358755ed2c56 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:48.912483 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 141/289] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Jul 4 03:57:48 2022] PUT /identity/v3/projects/f5bcfb30168d4753a6b0048a7935c78f/users/cc316c34274f42bb9a9cf70117f7b7ba/roles/99db92117d0048efaae5874a11d96ce9 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 03:57:48.942196 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52edb4-129f-4957-808d-df3bdead60fd None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:48.984658 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ab060-bfcd-44d6-aa11-c8d399f83267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:48.985518 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ab060-bfcd-44d6-aa11-c8d399f83267 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:48.985868 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ab060-bfcd-44d6-aa11-c8d399f83267 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:48.986280 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ab060-bfcd-44d6-aa11-c8d399f83267 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:48.987195 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ab060-bfcd-44d6-aa11-c8d399f83267 None admin] RBAC: Adding query filter params (name=member) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:48.987579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ab060-bfcd-44d6-aa11-c8d399f83267 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:48.989156 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ab060-bfcd-44d6-aa11-c8d399f83267 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:48.999861 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 149/290] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Jul 4 03:57:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:57:49.005712 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155263d2-2f14-44b0-bc33-358755ed2c56 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:49.115644 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155263d2-2f14-44b0-bc33-358755ed2c56 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:49.151598 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1e45f-4605-4c59-89ef-e3eb3e7295c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:49.152493 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1e45f-4605-4c59-89ef-e3eb3e7295c2 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:49.152780 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1e45f-4605-4c59-89ef-e3eb3e7295c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:49.153061 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1e45f-4605-4c59-89ef-e3eb3e7295c2 None admin] PATH_INFO: `/v3/users/7637be4c30eb475ca2d6ac42a1e4ba76` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:49.154337 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1e45f-4605-4c59-89ef-e3eb3e7295c2 None admin] RBAC: Authorizing `identity:get_user(user_id=7637be4c30eb475ca2d6ac42a1e4ba76)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:49.155818 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1e45f-4605-4c59-89ef-e3eb3e7295c2 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:49.157851 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 142/291] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:57:49 2022] GET /identity/v3/users/7637be4c30eb475ca2d6ac42a1e4ba76 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:49.163066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ab060-bfcd-44d6-aa11-c8d399f83267 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:49.172695 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:49.275464 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ab060-bfcd-44d6-aa11-c8d399f83267 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:49.310617 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b23dc-ef84-40f8-abe5-633876747607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:49.311337 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b23dc-ef84-40f8-abe5-633876747607 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:49.311634 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b23dc-ef84-40f8-abe5-633876747607 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:49.311920 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b23dc-ef84-40f8-abe5-633876747607 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:49.394789 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b23dc-ef84-40f8-abe5-633876747607 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:49.396642 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b23dc-ef84-40f8-abe5-633876747607 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:49.403824 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:49.517203 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 150/292] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:57:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 04 03:57:49.522786 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1e45f-4605-4c59-89ef-e3eb3e7295c2 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:49.604836 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:49.662019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1e45f-4605-4c59-89ef-e3eb3e7295c2 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:49.709774 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff6531-16a4-4f6c-aa85-bea55af86934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:49.710738 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff6531-16a4-4f6c-aa85-bea55af86934 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:49.711029 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff6531-16a4-4f6c-aa85-bea55af86934 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:49.711313 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff6531-16a4-4f6c-aa85-bea55af86934 None admin] PATH_INFO: `/v3/projects/f5bcfb30168d4753a6b0048a7935c78f` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:49.712585 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff6531-16a4-4f6c-aa85-bea55af86934 None admin] RBAC: Authorizing `identity:get_project(project_id=f5bcfb30168d4753a6b0048a7935c78f)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:49.714060 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff6531-16a4-4f6c-aa85-bea55af86934 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:49.716125 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 143/293] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:57:49 2022] GET /identity/v3/projects/f5bcfb30168d4753a6b0048a7935c78f => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:49.721930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b23dc-ef84-40f8-abe5-633876747607 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:49.863868 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b23dc-ef84-40f8-abe5-633876747607 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:49.871191 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:49.903612 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896c083-4594-4ac7-b302-fff20ee97fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:49.904283 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896c083-4594-4ac7-b302-fff20ee97fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:49.904569 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896c083-4594-4ac7-b302-fff20ee97fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:49.904848 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896c083-4594-4ac7-b302-fff20ee97fd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:49.905694 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896c083-4594-4ac7-b302-fff20ee97fd0 None admin] RBAC: Adding query filter params (role.id=8d92e2d53a9441a9b6ddaaad264ac4c9, scope.project.id=f5bcfb30168d4753a6b0048a7935c78f, user.id=7637be4c30eb475ca2d6ac42a1e4ba76) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:49.906017 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896c083-4594-4ac7-b302-fff20ee97fd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:49.907515 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896c083-4594-4ac7-b302-fff20ee97fd0 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:49.913926 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 151/294] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:57:49 2022] GET /identity/v3/role_assignments?user.id=7637be4c30eb475ca2d6ac42a1e4ba76&scope.project.id=f5bcfb30168d4753a6b0048a7935c78f&role.id=8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:50.307372 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f2b38-7e96-448f-8ada-13958d7e0093 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:50.307784 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f2b38-7e96-448f-8ada-13958d7e0093 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:50.308013 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f2b38-7e96-448f-8ada-13958d7e0093 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:50.309591 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 144/295] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:50.315216 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10c4b7-3cd1-4557-bbc1-28dbe9cad132 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:50.316111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10c4b7-3cd1-4557-bbc1-28dbe9cad132 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:50.316588 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10c4b7-3cd1-4557-bbc1-28dbe9cad132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:50.334551 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-2b10c4b7-3cd1-4557-bbc1-28dbe9cad132 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:50.336062 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-2b10c4b7-3cd1-4557-bbc1-28dbe9cad132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:50.401005 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f6c3a-78eb-4aa6-b24b-f3dcfd869b48 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:50.401634 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f6c3a-78eb-4aa6-b24b-f3dcfd869b48 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:50.402127 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f6c3a-78eb-4aa6-b24b-f3dcfd869b48 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:50.403753 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 145/296] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 03:57:50.411860 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd87322-684d-4042-b68e-2a547c3d5dc7 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:50.412694 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd87322-684d-4042-b68e-2a547c3d5dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:50.412694 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd87322-684d-4042-b68e-2a547c3d5dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:50.414525 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 152/297] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 03:57:50.431019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ccd87322-684d-4042-b68e-2a547c3d5dc7 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:50.432208 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ccd87322-684d-4042-b68e-2a547c3d5dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:50.448977 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10c4b7-3cd1-4557-bbc1-28dbe9cad132 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:50.517850 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 146/298] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 03:57:50.519164 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531f0b1-2dec-4337-bace-5955298db6c3 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:50.519460 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531f0b1-2dec-4337-bace-5955298db6c3 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:50.519746 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531f0b1-2dec-4337-bace-5955298db6c3 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:50.521193 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 147/299] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:50.526736 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061687f1-5928-47fa-b46b-dbc4ef747fe3 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:50.527280 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061687f1-5928-47fa-b46b-dbc4ef747fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:50.527475 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061687f1-5928-47fa-b46b-dbc4ef747fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:50.547744 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-061687f1-5928-47fa-b46b-dbc4ef747fe3 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:50.548953 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-061687f1-5928-47fa-b46b-dbc4ef747fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:50.576801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:50.580118 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10c4b7-3cd1-4557-bbc1-28dbe9cad132 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:50.607770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:50.617059 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64c073-acd2-4d81-bee0-07a4a8f954e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:50.617891 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64c073-acd2-4d81-bee0-07a4a8f954e3 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:50.618205 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64c073-acd2-4d81-bee0-07a4a8f954e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:50.618494 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64c073-acd2-4d81-bee0-07a4a8f954e3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:50.627018 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 148/300] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:50.627699 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061687f1-5928-47fa-b46b-dbc4ef747fe3 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:50.632777 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64c073-acd2-4d81-bee0-07a4a8f954e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:57:50.641434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-ec64c073-acd2-4d81-bee0-07a4a8f954e3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 03:57:50.641434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:50.641434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:50.641434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:50.641434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:50.641434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:50.641434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:50.641434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:50.641434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:50.641434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:50.641434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:50.641434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:50.641434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:57:50.641434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:57:50.641434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:57:50.641434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:57:50.642598 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:57:50.642598 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:57:50.642598 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:57:50.642598 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:57:50.642598 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:50.642598 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:50.642598 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:50.642598 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:50.642598 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:50.642598 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:50.642598 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:50.642598 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:50.642598 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:50.642598 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:50.642598 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:50.642598 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:50.643797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:50.643797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:50.643797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:50.643797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:50.643797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:57:50.643797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:57:50.643797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:57:50.643797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:57:50.643797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:57:50.643797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:57:50.643797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 03:57:50.643797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:57:50.643797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 153/301] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:57:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:57:50.649445 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64c073-acd2-4d81-bee0-07a4a8f954e3 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:50.744916 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061687f1-5928-47fa-b46b-dbc4ef747fe3 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:50.772477 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64c073-acd2-4d81-bee0-07a4a8f954e3 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:50.779989 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed633c9-432d-45d3-91e7-d86ad94b6892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:50.780794 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed633c9-432d-45d3-91e7-d86ad94b6892 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:50.781082 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed633c9-432d-45d3-91e7-d86ad94b6892 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:50.781368 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed633c9-432d-45d3-91e7-d86ad94b6892 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:50.782550 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed633c9-432d-45d3-91e7-d86ad94b6892 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:50.784013 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed633c9-432d-45d3-91e7-d86ad94b6892 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:50.785643 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 149/302] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:57:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:50.791099 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed633c9-432d-45d3-91e7-d86ad94b6892 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:50.807040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19cd18-c0cd-4f63-94d4-632b6a812aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:50.807769 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19cd18-c0cd-4f63-94d4-632b6a812aaa None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:50.808062 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19cd18-c0cd-4f63-94d4-632b6a812aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:50.808349 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19cd18-c0cd-4f63-94d4-632b6a812aaa None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:50.809108 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e19cd18-c0cd-4f63-94d4-632b6a812aaa None admin] RBAC: Adding query filter params (name=reader) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:50.809427 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e19cd18-c0cd-4f63-94d4-632b6a812aaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:50.810866 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e19cd18-c0cd-4f63-94d4-632b6a812aaa None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:50.819099 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 154/303] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Jul 4 03:57:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:57:50.824408 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19cd18-c0cd-4f63-94d4-632b6a812aaa None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:50.846323 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:50.847537 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:50.895846 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed633c9-432d-45d3-91e7-d86ad94b6892 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:50.928823 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19cd18-c0cd-4f63-94d4-632b6a812aaa None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:50.932479 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93311fb5-2d0c-4ff9-9a39-1650a8a8cb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:50.933286 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93311fb5-2d0c-4ff9-9a39-1650a8a8cb19 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:50.933577 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93311fb5-2d0c-4ff9-9a39-1650a8a8cb19 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:50.933856 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93311fb5-2d0c-4ff9-9a39-1650a8a8cb19 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:50.944428 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93311fb5-2d0c-4ff9-9a39-1650a8a8cb19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:57:50.952133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-93311fb5-2d0c-4ff9-9a39-1650a8a8cb19 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 03:57:50.952133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:50.952133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:50.952133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:50.952133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:50.952133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:50.952133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:50.952133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:50.952133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:50.952133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:50.952133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:50.952133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:50.952133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:57:50.952133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:57:50.952133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:57:50.952133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:57:50.953001 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:57:50.953001 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:57:50.953001 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:57:50.953001 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:57:50.953001 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:50.953001 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:50.953001 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:50.953001 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:50.953001 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:50.953001 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:50.953001 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:50.953001 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:50.953001 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:50.953001 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:50.953001 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:50.953001 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:50.958933 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:50.958933 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:50.958933 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:50.958933 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:50.958933 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:57:50.958933 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:57:50.958933 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:57:50.958933 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:57:50.958933 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:57:50.958933 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:57:50.958933 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 03:57:50.958933 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:57:50.958933 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 150/304] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:57:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:57:50.958933 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93311fb5-2d0c-4ff9-9a39-1650a8a8cb19 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:50.974751 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3ae6b-f22d-4ffc-bd55-54e5022e3596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:50.975451 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3ae6b-f22d-4ffc-bd55-54e5022e3596 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:50.975740 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3ae6b-f22d-4ffc-bd55-54e5022e3596 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:50.976025 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3ae6b-f22d-4ffc-bd55-54e5022e3596 None admin] PATH_INFO: `/v3/groups` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:50.976748 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3ae6b-f22d-4ffc-bd55-54e5022e3596 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:50.978324 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3ae6b-f22d-4ffc-bd55-54e5022e3596 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:50.994812 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 155/305] 10.222.0.49 () {60 vars in 1134 bytes} [Mon Jul 4 03:57:50 2022] POST /identity/v3/groups => generated 229 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 03:57:50.994812 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3ae6b-f22d-4ffc-bd55-54e5022e3596 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:51.100381 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:51.110228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93311fb5-2d0c-4ff9-9a39-1650a8a8cb19 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:51.123833 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3ae6b-f22d-4ffc-bd55-54e5022e3596 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:51.127717 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:51.153524 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e21904-e92d-42cd-9214-5c08eef75426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:51.154891 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e21904-e92d-42cd-9214-5c08eef75426 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:51.155429 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e21904-e92d-42cd-9214-5c08eef75426 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:51.155900 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e21904-e92d-42cd-9214-5c08eef75426 None admin] PATH_INFO: `/v3/users/4f8b4a658dc6473ea0bd9b21c9b58886` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:51.163228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ef50a-7201-4bb7-9c13-b9a69be6bc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:51.163921 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ef50a-7201-4bb7-9c13-b9a69be6bc16 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:51.164209 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ef50a-7201-4bb7-9c13-b9a69be6bc16 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:51.164530 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ef50a-7201-4bb7-9c13-b9a69be6bc16 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:51.165299 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030ef50a-7201-4bb7-9c13-b9a69be6bc16 None admin] RBAC: Adding query filter params (name=member) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:51.165616 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030ef50a-7201-4bb7-9c13-b9a69be6bc16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:51.167169 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030ef50a-7201-4bb7-9c13-b9a69be6bc16 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:51.171659 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e21904-e92d-42cd-9214-5c08eef75426 None admin] RBAC: Authorizing `identity:get_user(user_id=4f8b4a658dc6473ea0bd9b21c9b58886)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:51.173142 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e21904-e92d-42cd-9214-5c08eef75426 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:51.175210 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 151/306] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:57:50 2022] GET /identity/v3/users/4f8b4a658dc6473ea0bd9b21c9b58886 => generated 293 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:51.176733 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 156/307] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Jul 4 03:57:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:51.182537 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e21904-e92d-42cd-9214-5c08eef75426 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:51.182670 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ef50a-7201-4bb7-9c13-b9a69be6bc16 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:51.285547 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ef50a-7201-4bb7-9c13-b9a69be6bc16 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:51.288801 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e21904-e92d-42cd-9214-5c08eef75426 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:51.320571 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d9b6f-2dd4-4199-9397-9aa4c9c36773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:51.321277 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d9b6f-2dd4-4199-9397-9aa4c9c36773 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:51.321554 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d9b6f-2dd4-4199-9397-9aa4c9c36773 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:51.321843 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d9b6f-2dd4-4199-9397-9aa4c9c36773 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:51.322719 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d9b6f-2dd4-4199-9397-9aa4c9c36773 None admin] RBAC: Adding query filter params (role.id=99db92117d0048efaae5874a11d96ce9, user.id=4f8b4a658dc6473ea0bd9b21c9b58886, scope.system=all) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:51.323044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d9b6f-2dd4-4199-9397-9aa4c9c36773 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:51.324535 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d9b6f-2dd4-4199-9397-9aa4c9c36773 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:51.328099 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fab9f45-2bae-4876-beae-310c3334ba18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:51.329482 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab9f45-2bae-4876-beae-310c3334ba18 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:51.329970 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab9f45-2bae-4876-beae-310c3334ba18 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:51.330211 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 157/308] 10.222.0.49 () {56 vars in 1308 bytes} [Mon Jul 4 03:57:51 2022] GET /identity/v3/role_assignments?user.id=4f8b4a658dc6473ea0bd9b21c9b58886&scope.system=all&role.id=99db92117d0048efaae5874a11d96ce9 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:51.330674 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab9f45-2bae-4876-beae-310c3334ba18 None admin] PATH_INFO: `/v3/users/64bb722b359844c1abdbff57b7488f32` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:51.332180 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fab9f45-2bae-4876-beae-310c3334ba18 None admin] RBAC: Authorizing `identity:get_user(user_id=64bb722b359844c1abdbff57b7488f32)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:51.333874 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fab9f45-2bae-4876-beae-310c3334ba18 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:51.336260 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 152/309] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:57:51 2022] GET /identity/v3/users/64bb722b359844c1abdbff57b7488f32 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:57:51.346207 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d9b6f-2dd4-4199-9397-9aa4c9c36773 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:51.357039 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:51.438710 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf88a4-9bf8-4428-a5fe-760f153e00dc None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:51.439002 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf88a4-9bf8-4428-a5fe-760f153e00dc None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:51.439290 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf88a4-9bf8-4428-a5fe-760f153e00dc None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:51.440950 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 153/310] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:51.446704 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d83e9-d8b1-477d-be70-50bab3724e02 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:51.446996 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d83e9-d8b1-477d-be70-50bab3724e02 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:51.447283 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d83e9-d8b1-477d-be70-50bab3724e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:51.462672 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d9b6f-2dd4-4199-9397-9aa4c9c36773 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:51.471108 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-e97d83e9-d8b1-477d-be70-50bab3724e02 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:51.473057 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e97d83e9-d8b1-477d-be70-50bab3724e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:51.504280 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c613f3d-05ff-4053-99cb-ca8fe622b13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:51.504785 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c613f3d-05ff-4053-99cb-ca8fe622b13b None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:51.505072 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c613f3d-05ff-4053-99cb-ca8fe622b13b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:51.505351 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c613f3d-05ff-4053-99cb-ca8fe622b13b None admin] PATH_INFO: `/v3/system/users/64bb722b359844c1abdbff57b7488f32/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:51.507605 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c613f3d-05ff-4053-99cb-ca8fe622b13b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=64bb722b359844c1abdbff57b7488f32, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:51.508431 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c613f3d-05ff-4053-99cb-ca8fe622b13b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:51.518892 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:51.520744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 158/311] 10.222.0.49 () {58 vars in 1334 bytes} [Mon Jul 4 03:57:51 2022] PUT /identity/v3/system/users/64bb722b359844c1abdbff57b7488f32/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 03:57:51.563509 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 154/312] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:51.589122 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c613f3d-05ff-4053-99cb-ca8fe622b13b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:51.669644 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:51.704731 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c613f3d-05ff-4053-99cb-ca8fe622b13b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:51.740615 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe31a7-fa01-4fad-aaba-295cf61a2d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:51.741425 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe31a7-fa01-4fad-aaba-295cf61a2d14 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:51.741714 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe31a7-fa01-4fad-aaba-295cf61a2d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:51.741993 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe31a7-fa01-4fad-aaba-295cf61a2d14 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:51.754041 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe31a7-fa01-4fad-aaba-295cf61a2d14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:57:51.762434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-31fe31a7-fa01-4fad-aaba-295cf61a2d14 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 03:57:51.762434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:51.762434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:51.762434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:51.762434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:51.762434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:51.762434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:51.762434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:51.762434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:51.762434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:51.762434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:51.762434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:51.762434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:57:51.762434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:57:51.762434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:57:51.762434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:57:51.763348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:57:51.763348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:57:51.763348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:57:51.763348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:57:51.763348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:51.763348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:51.763348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:51.763348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:51.763348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:51.763348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:51.763348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:51.763348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:51.763348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:51.763348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:51.763348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:51.763348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:51.764193 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:51.764193 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:51.764193 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:51.764193 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:51.764193 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:57:51.764193 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:57:51.764193 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:57:51.764193 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:57:51.764193 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:57:51.764193 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:57:51.764193 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 03:57:51.764193 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:57:51.764193 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 159/313] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:57:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:57:51.770858 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d83e9-d8b1-477d-be70-50bab3724e02 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:51.874523 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d83e9-d8b1-477d-be70-50bab3724e02 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:51.909723 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af1dff-8b58-4f2c-8e65-cc52b2991a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:51.910875 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af1dff-8b58-4f2c-8e65-cc52b2991a77 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:51.911356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af1dff-8b58-4f2c-8e65-cc52b2991a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:51.911826 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af1dff-8b58-4f2c-8e65-cc52b2991a77 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:51.912875 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af1dff-8b58-4f2c-8e65-cc52b2991a77 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:51.913454 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af1dff-8b58-4f2c-8e65-cc52b2991a77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:51.915092 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af1dff-8b58-4f2c-8e65-cc52b2991a77 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:51.924198 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 155/314] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Jul 4 03:57:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:51.929569 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe31a7-fa01-4fad-aaba-295cf61a2d14 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:52.038207 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe31a7-fa01-4fad-aaba-295cf61a2d14 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:52.068224 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:52.074797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581b471-453c-4328-ba2c-1ab1c1dee0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:52.075930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581b471-453c-4328-ba2c-1ab1c1dee0cd None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:52.076408 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581b471-453c-4328-ba2c-1ab1c1dee0cd None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:52.076924 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581b471-453c-4328-ba2c-1ab1c1dee0cd None admin] PATH_INFO: `/v3/users/cc316c34274f42bb9a9cf70117f7b7ba` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:52.078338 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b581b471-453c-4328-ba2c-1ab1c1dee0cd None admin] RBAC: Authorizing `identity:get_user(user_id=cc316c34274f42bb9a9cf70117f7b7ba)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:52.080000 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b581b471-453c-4328-ba2c-1ab1c1dee0cd None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:52.081859 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 160/315] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:57:51 2022] GET /identity/v3/users/cc316c34274f42bb9a9cf70117f7b7ba => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:52.091135 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af1dff-8b58-4f2c-8e65-cc52b2991a77 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:52.122489 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:52.196500 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af1dff-8b58-4f2c-8e65-cc52b2991a77 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:52.232200 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37275579-4b5d-43df-9bc7-ea4ef9013bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:52.233260 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37275579-4b5d-43df-9bc7-ea4ef9013bee None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:52.233742 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37275579-4b5d-43df-9bc7-ea4ef9013bee None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:52.234254 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37275579-4b5d-43df-9bc7-ea4ef9013bee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:52.302783 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37275579-4b5d-43df-9bc7-ea4ef9013bee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:52.304600 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37275579-4b5d-43df-9bc7-ea4ef9013bee None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:52.334033 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:52.407975 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 156/316] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:57:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 03:57:52.415326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581b471-453c-4328-ba2c-1ab1c1dee0cd None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:52.524834 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581b471-453c-4328-ba2c-1ab1c1dee0cd None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:52.559092 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7c198-885a-489b-aab0-697aa2317483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:52.559983 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7c198-885a-489b-aab0-697aa2317483 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:52.560270 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7c198-885a-489b-aab0-697aa2317483 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:52.560549 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7c198-885a-489b-aab0-697aa2317483 None admin] PATH_INFO: `/v3/projects/f5bcfb30168d4753a6b0048a7935c78f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:52.561739 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf7c198-885a-489b-aab0-697aa2317483 None admin] RBAC: Authorizing `identity:get_project(project_id=f5bcfb30168d4753a6b0048a7935c78f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:52.563267 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf7c198-885a-489b-aab0-697aa2317483 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:52.565036 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 161/317] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:57:52 2022] GET /identity/v3/projects/f5bcfb30168d4753a6b0048a7935c78f => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:52.571127 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37275579-4b5d-43df-9bc7-ea4ef9013bee None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:52.673790 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37275579-4b5d-43df-9bc7-ea4ef9013bee None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:52.702490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:52.708311 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42edd1e-bd08-4f6b-851b-94596068f41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:52.709188 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42edd1e-bd08-4f6b-851b-94596068f41c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:52.709615 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42edd1e-bd08-4f6b-851b-94596068f41c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:52.710033 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42edd1e-bd08-4f6b-851b-94596068f41c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:52.711067 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42edd1e-bd08-4f6b-851b-94596068f41c None admin] RBAC: Adding query filter params (role.id=99db92117d0048efaae5874a11d96ce9, scope.project.id=f5bcfb30168d4753a6b0048a7935c78f, user.id=cc316c34274f42bb9a9cf70117f7b7ba) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:52.711582 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42edd1e-bd08-4f6b-851b-94596068f41c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:52.713169 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42edd1e-bd08-4f6b-851b-94596068f41c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:52.719873 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 157/318] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:57:52 2022] GET /identity/v3/role_assignments?user.id=cc316c34274f42bb9a9cf70117f7b7ba&scope.project.id=f5bcfb30168d4753a6b0048a7935c78f&role.id=99db92117d0048efaae5874a11d96ce9 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:57:53.142098 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a823a77-abb4-4f1d-bd87-fd7c35f733f5 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:53.142381 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a823a77-abb4-4f1d-bd87-fd7c35f733f5 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:53.142661 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a823a77-abb4-4f1d-bd87-fd7c35f733f5 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:53.144230 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 162/319] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:53.149284 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549e255-823b-4716-a6dc-666b26270ed1 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:53.149588 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549e255-823b-4716-a6dc-666b26270ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:53.149852 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549e255-823b-4716-a6dc-666b26270ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:53.167133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-6549e255-823b-4716-a6dc-666b26270ed1 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:53.168302 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6549e255-823b-4716-a6dc-666b26270ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:53.239145 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 158/320] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:53.261893 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a823a77-abb4-4f1d-bd87-fd7c35f733f5 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:53.331439 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:53.357547 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d6114-eed6-46d0-95c8-7bc77cbed2c5 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:53.357886 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d6114-eed6-46d0-95c8-7bc77cbed2c5 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:53.358121 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d6114-eed6-46d0-95c8-7bc77cbed2c5 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:53.359708 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 159/321] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:53.364601 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62544466-6eda-4e2f-8e9f-7db058c1b093 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:53.364867 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62544466-6eda-4e2f-8e9f-7db058c1b093 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:53.365163 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62544466-6eda-4e2f-8e9f-7db058c1b093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:53.371199 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a823a77-abb4-4f1d-bd87-fd7c35f733f5 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:53.382101 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-62544466-6eda-4e2f-8e9f-7db058c1b093 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:53.383354 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-62544466-6eda-4e2f-8e9f-7db058c1b093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:53.408151 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526b296-fdfb-4b3f-bfcf-1f4b5db7c826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:53.408956 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526b296-fdfb-4b3f-bfcf-1f4b5db7c826 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:53.409240 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526b296-fdfb-4b3f-bfcf-1f4b5db7c826 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:53.409520 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526b296-fdfb-4b3f-bfcf-1f4b5db7c826 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:53.410712 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d526b296-fdfb-4b3f-bfcf-1f4b5db7c826 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:53.412354 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d526b296-fdfb-4b3f-bfcf-1f4b5db7c826 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:53.414015 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 163/322] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:57:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:53.419409 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526b296-fdfb-4b3f-bfcf-1f4b5db7c826 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:53.457899 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 160/323] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 03:57:53.480047 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62544466-6eda-4e2f-8e9f-7db058c1b093 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:53.534582 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526b296-fdfb-4b3f-bfcf-1f4b5db7c826 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:53.536380 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:53.576925 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f27aff-b920-4b8a-8be3-3b59f0bed487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:53.578197 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f27aff-b920-4b8a-8be3-3b59f0bed487 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:53.578921 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f27aff-b920-4b8a-8be3-3b59f0bed487 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:53.579744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f27aff-b920-4b8a-8be3-3b59f0bed487 None admin] PATH_INFO: `/v3/groups` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:53.580867 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f27aff-b920-4b8a-8be3-3b59f0bed487 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:53.582314 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62544466-6eda-4e2f-8e9f-7db058c1b093 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:53.583048 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f27aff-b920-4b8a-8be3-3b59f0bed487 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:53.587365 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:53.604490 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 164/324] 10.222.0.49 () {60 vars in 1134 bytes} [Mon Jul 4 03:57:53 2022] POST /identity/v3/groups => generated 226 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 03:57:53.620838 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374053b-104a-4159-ad7e-f168eb4018fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:53.621779 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374053b-104a-4159-ad7e-f168eb4018fc None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:53.622138 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374053b-104a-4159-ad7e-f168eb4018fc None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:53.622549 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374053b-104a-4159-ad7e-f168eb4018fc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:53.635995 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d374053b-104a-4159-ad7e-f168eb4018fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:57:53.644529 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-d374053b-104a-4159-ad7e-f168eb4018fc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 03:57:53.644529 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:53.644529 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:53.644529 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:53.644529 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:53.644529 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:53.644529 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:53.644529 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:53.644529 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:53.644529 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:53.644529 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:53.644529 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:53.644529 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:57:53.644529 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:57:53.644529 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:57:53.644529 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:57:53.645462 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:57:53.645462 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:57:53.645462 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:57:53.645462 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:57:53.645462 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:53.645462 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:53.645462 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:53.645462 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:53.645462 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:53.645462 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:53.645462 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:53.645462 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:53.645462 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:53.645462 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:53.645462 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:53.645462 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:53.646696 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:53.646696 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:53.646696 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:53.646696 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:53.646696 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:57:53.646696 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:57:53.646696 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:57:53.646696 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:57:53.646696 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:57:53.646696 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:57:53.646696 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 03:57:53.646696 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:57:53.646696 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 161/325] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:57:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:57:53.654999 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f27aff-b920-4b8a-8be3-3b59f0bed487 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:53.658545 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9beeb6-0876-4c9d-9a0a-e284e64154d3 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:53.658835 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9beeb6-0876-4c9d-9a0a-e284e64154d3 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:53.659123 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9beeb6-0876-4c9d-9a0a-e284e64154d3 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:53.660825 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 162/326] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:53.667485 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60acf9-0916-4ab1-9a14-402a192a61e9 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:53.667961 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60acf9-0916-4ab1-9a14-402a192a61e9 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:53.668376 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60acf9-0916-4ab1-9a14-402a192a61e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:53.687292 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-1c60acf9-0916-4ab1-9a14-402a192a61e9 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:53.688526 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1c60acf9-0916-4ab1-9a14-402a192a61e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:53.763973 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 163/327] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:53.779961 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f27aff-b920-4b8a-8be3-3b59f0bed487 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:53.788586 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60acf9-0916-4ab1-9a14-402a192a61e9 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:53.820398 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7987ab-6c26-41f1-b6c0-01d9adbb6fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:53.821157 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7987ab-6c26-41f1-b6c0-01d9adbb6fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:53.822268 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7987ab-6c26-41f1-b6c0-01d9adbb6fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:53.822268 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7987ab-6c26-41f1-b6c0-01d9adbb6fd1 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:53.822561 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7987ab-6c26-41f1-b6c0-01d9adbb6fd1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:53.822852 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7987ab-6c26-41f1-b6c0-01d9adbb6fd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:53.824262 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7987ab-6c26-41f1-b6c0-01d9adbb6fd1 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:53.834876 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 165/328] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Jul 4 03:57:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:53.840432 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7987ab-6c26-41f1-b6c0-01d9adbb6fd1 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:53.840856 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:53.911365 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60acf9-0916-4ab1-9a14-402a192a61e9 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:53.912443 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:53.958346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a02e7-246b-4450-af2f-4ef10f849908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:53.960050 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a02e7-246b-4450-af2f-4ef10f849908 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:53.960050 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a02e7-246b-4450-af2f-4ef10f849908 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:53.960050 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a02e7-246b-4450-af2f-4ef10f849908 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:53.964247 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7987ab-6c26-41f1-b6c0-01d9adbb6fd1 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:53.981284 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576a02e7-246b-4450-af2f-4ef10f849908 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:57:53.989009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-576a02e7-246b-4450-af2f-4ef10f849908 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 03:57:53.989009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:53.989009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:53.989009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:53.989009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:53.989009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:53.989009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:53.989009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:53.989009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:53.989009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:53.989009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:53.989009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:53.989009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:57:53.989009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:57:53.989009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:57:53.989009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:57:53.989881 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:57:53.989881 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:57:53.989881 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:57:53.989881 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:57:53.989881 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:53.989881 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:53.989881 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:53.989881 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:53.989881 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:53.989881 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:53.989881 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:53.989881 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:53.989881 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:53.989881 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:53.989881 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:53.989881 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:53.990763 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:53.990763 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:53.990763 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:53.990763 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:53.990763 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:57:53.990763 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:57:53.990763 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:57:53.990763 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:57:53.990763 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:57:53.990763 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:57:53.990763 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 03:57:53.990763 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:57:53.990763 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 164/329] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:57:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:57:53.997819 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a02e7-246b-4450-af2f-4ef10f849908 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:54.018554 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8108b-ac18-4143-8ad6-1542c80566eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:54.020147 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8108b-ac18-4143-8ad6-1542c80566eb None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:54.020638 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8108b-ac18-4143-8ad6-1542c80566eb None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:54.021113 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8108b-ac18-4143-8ad6-1542c80566eb None admin] PATH_INFO: `/v3/users/4f8b4a658dc6473ea0bd9b21c9b58886` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:54.022589 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8108b-ac18-4143-8ad6-1542c80566eb None admin] RBAC: Authorizing `identity:get_user(user_id=4f8b4a658dc6473ea0bd9b21c9b58886)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:54.024837 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8108b-ac18-4143-8ad6-1542c80566eb None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:54.027341 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 166/330] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:57:53 2022] GET /identity/v3/users/4f8b4a658dc6473ea0bd9b21c9b58886 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:57:54.035223 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8108b-ac18-4143-8ad6-1542c80566eb None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:54.120613 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a02e7-246b-4450-af2f-4ef10f849908 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:54.124845 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:54.164910 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f19b0b-8138-496c-8cf1-20f9a37cb8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:54.165981 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f19b0b-8138-496c-8cf1-20f9a37cb8fa None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:54.166544 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f19b0b-8138-496c-8cf1-20f9a37cb8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:54.166826 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f19b0b-8138-496c-8cf1-20f9a37cb8fa None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:54.167593 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f19b0b-8138-496c-8cf1-20f9a37cb8fa None admin] RBAC: Adding query filter params (name=member) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:54.167902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f19b0b-8138-496c-8cf1-20f9a37cb8fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:54.168201 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8108b-ac18-4143-8ad6-1542c80566eb None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:54.169303 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f19b0b-8138-496c-8cf1-20f9a37cb8fa None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:54.180213 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 165/331] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Jul 4 03:57:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:54.186195 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f19b0b-8138-496c-8cf1-20f9a37cb8fa None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:54.201351 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:54.217250 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9422740-01ab-4abc-8de8-07d89d88e193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:54.218638 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9422740-01ab-4abc-8de8-07d89d88e193 None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:54.219001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9422740-01ab-4abc-8de8-07d89d88e193 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:54.219584 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9422740-01ab-4abc-8de8-07d89d88e193 None admin] PATH_INFO: `/v3/system/users/4f8b4a658dc6473ea0bd9b21c9b58886/roles/99db92117d0048efaae5874a11d96ce9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:54.221707 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9422740-01ab-4abc-8de8-07d89d88e193 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4f8b4a658dc6473ea0bd9b21c9b58886, role_id=99db92117d0048efaae5874a11d96ce9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:54.223732 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9422740-01ab-4abc-8de8-07d89d88e193 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:54.237410 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 167/332] 10.222.0.49 () {58 vars in 1334 bytes} [Mon Jul 4 03:57:54 2022] PUT /identity/v3/system/users/4f8b4a658dc6473ea0bd9b21c9b58886/roles/99db92117d0048efaae5874a11d96ce9 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 03:57:54.305699 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f19b0b-8138-496c-8cf1-20f9a37cb8fa None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:54.344609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894a472-12fb-466f-84d6-17d44f968ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:54.345606 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894a472-12fb-466f-84d6-17d44f968ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:54.345961 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894a472-12fb-466f-84d6-17d44f968ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:54.346347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894a472-12fb-466f-84d6-17d44f968ec3 None admin] PATH_INFO: `/v3/users/64bb722b359844c1abdbff57b7488f32` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:54.347763 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894a472-12fb-466f-84d6-17d44f968ec3 None admin] RBAC: Authorizing `identity:get_user(user_id=64bb722b359844c1abdbff57b7488f32)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:54.349372 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894a472-12fb-466f-84d6-17d44f968ec3 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:54.351571 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 166/333] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:57:54 2022] GET /identity/v3/users/64bb722b359844c1abdbff57b7488f32 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:54.357046 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9422740-01ab-4abc-8de8-07d89d88e193 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:54.473929 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9422740-01ab-4abc-8de8-07d89d88e193 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:54.513192 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d09b5-6d82-46fb-8a37-fb8410e2bda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:54.513869 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d09b5-6d82-46fb-8a37-fb8410e2bda0 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:54.514185 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d09b5-6d82-46fb-8a37-fb8410e2bda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:54.514465 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d09b5-6d82-46fb-8a37-fb8410e2bda0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:54.515311 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d09b5-6d82-46fb-8a37-fb8410e2bda0 None admin] RBAC: Adding query filter params (role.id=8d92e2d53a9441a9b6ddaaad264ac4c9, user.id=64bb722b359844c1abdbff57b7488f32, scope.system=all) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:54.515632 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d09b5-6d82-46fb-8a37-fb8410e2bda0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:54.517121 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d09b5-6d82-46fb-8a37-fb8410e2bda0 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:54.529966 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 168/334] 10.222.0.49 () {56 vars in 1308 bytes} [Mon Jul 4 03:57:54 2022] GET /identity/v3/role_assignments?user.id=64bb722b359844c1abdbff57b7488f32&scope.system=all&role.id=8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 510 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:57:55.901111 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c8793-5eb7-4e60-8918-ed94a3c114e9 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:55.901645 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c8793-5eb7-4e60-8918-ed94a3c114e9 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:55.901645 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c8793-5eb7-4e60-8918-ed94a3c114e9 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:55.903443 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 167/335] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:55.909622 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de565317-f108-4492-bde7-c3d3f523e77c None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:55.910619 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de565317-f108-4492-bde7-c3d3f523e77c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:55.911102 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de565317-f108-4492-bde7-c3d3f523e77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:55.932213 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-de565317-f108-4492-bde7-c3d3f523e77c None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:55.933833 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-de565317-f108-4492-bde7-c3d3f523e77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:56.002657 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:56.030302 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 169/336] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:56.075691 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c8793-5eb7-4e60-8918-ed94a3c114e9 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:56.124642 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:56.215121 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c8793-5eb7-4e60-8918-ed94a3c114e9 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:56.254234 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8391dd-36d5-4056-b024-5c871250025a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:56.255057 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8391dd-36d5-4056-b024-5c871250025a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:56.255351 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8391dd-36d5-4056-b024-5c871250025a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:56.255637 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8391dd-36d5-4056-b024-5c871250025a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:56.270870 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8391dd-36d5-4056-b024-5c871250025a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:57:56.278783 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-8f8391dd-36d5-4056-b024-5c871250025a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 03:57:56.278783 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:56.278783 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:56.278783 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:56.278783 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:56.278783 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:56.278783 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:56.278783 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:56.278783 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:56.278783 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:56.278783 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:56.278783 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:56.278783 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:57:56.278783 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:57:56.278783 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:57:56.278783 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:57:56.279676 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:57:56.279676 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:57:56.279676 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:57:56.279676 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:57:56.279676 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:56.279676 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:56.279676 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:56.279676 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:56.279676 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:56.279676 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:56.279676 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:56.279676 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:56.279676 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:56.279676 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:56.279676 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:56.279676 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:56.280475 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:56.280475 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:56.280475 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:56.280475 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:56.280475 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:57:56.280475 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:57:56.280475 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:57:56.280475 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:57:56.280475 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:57:56.280475 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:57:56.280475 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 03:57:56.280475 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:57:56.281567 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 168/337] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:57:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:57:56.287262 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de565317-f108-4492-bde7-c3d3f523e77c None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:56.394560 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de565317-f108-4492-bde7-c3d3f523e77c None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:56.434142 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a6e88b-de68-4be9-98ca-1628f47d102c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:56.434863 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6e88b-de68-4be9-98ca-1628f47d102c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:56.435154 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6e88b-de68-4be9-98ca-1628f47d102c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:56.435440 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6e88b-de68-4be9-98ca-1628f47d102c None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:56.436211 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a6e88b-de68-4be9-98ca-1628f47d102c None admin] RBAC: Adding query filter params (name=member) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:56.436526 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a6e88b-de68-4be9-98ca-1628f47d102c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:56.437959 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a6e88b-de68-4be9-98ca-1628f47d102c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:56.447162 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 170/338] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Jul 4 03:57:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:56.452721 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8391dd-36d5-4056-b024-5c871250025a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:56.562777 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:56.572295 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8391dd-36d5-4056-b024-5c871250025a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:56.616759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8335cad-c03a-493e-b168-dc6302884cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:56.617479 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8335cad-c03a-493e-b168-dc6302884cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:56.617777 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8335cad-c03a-493e-b168-dc6302884cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:56.618058 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8335cad-c03a-493e-b168-dc6302884cc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:56.698599 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8335cad-c03a-493e-b168-dc6302884cc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:56.700114 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8335cad-c03a-493e-b168-dc6302884cc8 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:56.709469 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ce9d8-f161-4234-81f0-77aa890b49bf None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:56.709761 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ce9d8-f161-4234-81f0-77aa890b49bf None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:56.710040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ce9d8-f161-4234-81f0-77aa890b49bf None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:56.711835 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 171/339] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 03:57:56.718478 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cd0d5-2c9e-4b46-ad46-fa00284fdd28 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:56.718911 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cd0d5-2c9e-4b46-ad46-fa00284fdd28 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:56.719200 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cd0d5-2c9e-4b46-ad46-fa00284fdd28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:56.738997 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-d15cd0d5-2c9e-4b46-ad46-fa00284fdd28 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:56.740371 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d15cd0d5-2c9e-4b46-ad46-fa00284fdd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:56.785595 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:56.839250 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 172/340] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 03:57:56.840943 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95892f5a-d3f5-431b-adfc-0eb14bd6970e None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:56.841239 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95892f5a-d3f5-431b-adfc-0eb14bd6970e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:56.841519 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95892f5a-d3f5-431b-adfc-0eb14bd6970e None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:56.844179 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 173/341] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:56.849569 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df7dee-c8d4-4d12-80ae-95722579229a None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:56.849867 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df7dee-c8d4-4d12-80ae-95722579229a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:56.850138 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df7dee-c8d4-4d12-80ae-95722579229a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:56.852843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:56.865825 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 169/342] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:57:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 03:57:56.874578 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8335cad-c03a-493e-b168-dc6302884cc8 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:56.875171 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c7df7dee-c8d4-4d12-80ae-95722579229a None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:56.876376 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c7df7dee-c8d4-4d12-80ae-95722579229a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:56.950690 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 174/343] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:56.951630 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df7dee-c8d4-4d12-80ae-95722579229a None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:56.999176 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8335cad-c03a-493e-b168-dc6302884cc8 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:57.036533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19568ddb-f51d-4212-84c5-a3e01854e9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:57.037428 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19568ddb-f51d-4212-84c5-a3e01854e9bd None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:57.037723 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19568ddb-f51d-4212-84c5-a3e01854e9bd None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:57.037999 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19568ddb-f51d-4212-84c5-a3e01854e9bd None admin] PATH_INFO: `/v3/projects/f5159196cf6c47c79e3bf91601a42a40` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:57.039372 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19568ddb-f51d-4212-84c5-a3e01854e9bd None admin] RBAC: Authorizing `identity:get_project(project_id=f5159196cf6c47c79e3bf91601a42a40)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:57.040849 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19568ddb-f51d-4212-84c5-a3e01854e9bd None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:57.046283 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 170/344] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:57:56 2022] GET /identity/v3/projects/f5159196cf6c47c79e3bf91601a42a40 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:57.047357 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19568ddb-f51d-4212-84c5-a3e01854e9bd None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:57.103606 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df7dee-c8d4-4d12-80ae-95722579229a None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:57.107083 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:57.182910 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9f3c1-9da6-434f-980e-d38980f42055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:57.183867 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9f3c1-9da6-434f-980e-d38980f42055 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:57.184156 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9f3c1-9da6-434f-980e-d38980f42055 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:57.184433 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9f3c1-9da6-434f-980e-d38980f42055 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:57.192557 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:57.215094 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d9f3c1-9da6-434f-980e-d38980f42055 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:57:57.231399 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19568ddb-f51d-4212-84c5-a3e01854e9bd None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:57.231578 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-85d9f3c1-9da6-434f-980e-d38980f42055 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 03:57:57.231578 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:57.231578 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:57.231578 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:57.231578 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:57.231578 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:57.231578 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:57.231578 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:57.231578 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:57.231578 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:57.231578 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:57.231578 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:57.231578 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:57:57.231578 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:57:57.231578 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:57:57.231578 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:57:57.232418 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:57:57.232418 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:57:57.232418 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:57:57.232418 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:57:57.232418 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:57.232418 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:57.232418 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:57.232418 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:57.232418 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:57.232418 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:57.232418 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:57.232418 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:57.232418 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:57.232418 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:57.232418 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:57.232418 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:57.234760 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:57.234760 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:57.234760 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:57.234760 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:57.234760 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:57:57.234760 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:57:57.234760 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:57:57.234760 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:57:57.234760 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:57:57.234760 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:57:57.234760 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 03:57:57.234760 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:57:57.234760 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 175/345] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Jul 4 03:57:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:57:57.234760 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9f3c1-9da6-434f-980e-d38980f42055 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:57.276745 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad245520-fef5-4f98-a6a4-b94db5c690d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:57.277547 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad245520-fef5-4f98-a6a4-b94db5c690d7 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:57.277832 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad245520-fef5-4f98-a6a4-b94db5c690d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:57.278106 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad245520-fef5-4f98-a6a4-b94db5c690d7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:57.291584 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad245520-fef5-4f98-a6a4-b94db5c690d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:57:57.301103 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-ad245520-fef5-4f98-a6a4-b94db5c690d7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 03:57:57.301103 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:57.301103 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:57.301103 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:57.301103 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:57.301103 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:57.301103 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:57.301103 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:57.301103 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:57.301103 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:57.301103 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:57.301103 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:57.301103 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:57:57.301103 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:57:57.301103 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:57:57.301103 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:57:57.303220 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:57:57.303220 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:57:57.303220 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:57:57.303220 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:57:57.303220 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:57.303220 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:57.303220 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:57.303220 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:57.303220 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:57.303220 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:57.303220 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:57.303220 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:57.303220 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:57.303220 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:57.303220 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:57.303220 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:57.305172 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:57.305172 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:57.305172 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:57.305172 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:57.305172 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:57:57.305172 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:57:57.305172 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:57:57.305172 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:57:57.305172 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:57:57.305172 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:57:57.305172 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 04 03:57:57.305172 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:57:57.305172 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 171/346] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:57:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:57:57.305172 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad245520-fef5-4f98-a6a4-b94db5c690d7 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:57.440693 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad245520-fef5-4f98-a6a4-b94db5c690d7 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:57.476170 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9f3c1-9da6-434f-980e-d38980f42055 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:57.479257 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:57.503678 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c3515-41ee-4099-b844-821cb6572dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:57.504499 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c3515-41ee-4099-b844-821cb6572dba None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:57.504786 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c3515-41ee-4099-b844-821cb6572dba None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:57.505068 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c3515-41ee-4099-b844-821cb6572dba None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:57.505887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c3515-41ee-4099-b844-821cb6572dba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:57.506263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c3515-41ee-4099-b844-821cb6572dba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:57.509805 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c3515-41ee-4099-b844-821cb6572dba None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:57.522619 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 172/347] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:57:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:57.523285 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c3515-41ee-4099-b844-821cb6572dba None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:57.543316 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff1ad5-f777-4e20-9fba-5e79d9fd28d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:57.544210 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff1ad5-f777-4e20-9fba-5e79d9fd28d2 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:57.544499 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff1ad5-f777-4e20-9fba-5e79d9fd28d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:57.544777 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff1ad5-f777-4e20-9fba-5e79d9fd28d2 None admin] PATH_INFO: `/v3/groups/6baf459f92a34fd18e9e3800c50eeb9d` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:57.552085 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff1ad5-f777-4e20-9fba-5e79d9fd28d2 None admin] RBAC: Authorizing `identity:get_group(group_id=6baf459f92a34fd18e9e3800c50eeb9d)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:57.553590 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff1ad5-f777-4e20-9fba-5e79d9fd28d2 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:57.555484 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 176/348] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Jul 4 03:57:57 2022] GET /identity/v3/groups/6baf459f92a34fd18e9e3800c50eeb9d => generated 226 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:57.556290 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff1ad5-f777-4e20-9fba-5e79d9fd28d2 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:57.583241 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:57.657913 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c3515-41ee-4099-b844-821cb6572dba None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:57.676454 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff1ad5-f777-4e20-9fba-5e79d9fd28d2 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:57.716410 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b889426-4252-47ab-9957-283ca3ba16d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:57.717123 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b889426-4252-47ab-9957-283ca3ba16d9 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:57.717507 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b889426-4252-47ab-9957-283ca3ba16d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:57.717861 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b889426-4252-47ab-9957-283ca3ba16d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:57.718736 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b889426-4252-47ab-9957-283ca3ba16d9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:57.719119 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b889426-4252-47ab-9957-283ca3ba16d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:57.719401 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9664abb-d83c-4f26-b98a-dbbd823dc93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:57.720062 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9664abb-d83c-4f26-b98a-dbbd823dc93a None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:57.720352 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9664abb-d83c-4f26-b98a-dbbd823dc93a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:57.720539 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b889426-4252-47ab-9957-283ca3ba16d9 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:57.720644 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9664abb-d83c-4f26-b98a-dbbd823dc93a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:57.735407 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 173/349] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Jul 4 03:57:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:57.737172 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf33e8-b470-4ef9-8827-85521a08c4f0 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:57.737660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf33e8-b470-4ef9-8827-85521a08c4f0 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:57.738272 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf33e8-b470-4ef9-8827-85521a08c4f0 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:57.739860 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 174/350] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:57.740763 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf33e8-b470-4ef9-8827-85521a08c4f0 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:57.804600 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:57.810537 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9664abb-d83c-4f26-b98a-dbbd823dc93a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:57.812376 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9664abb-d83c-4f26-b98a-dbbd823dc93a None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:57.839753 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:57.891020 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf33e8-b470-4ef9-8827-85521a08c4f0 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:57.933923 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3199d36-8cbb-4b23-b65d-d6b050ad3ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:57.934645 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3199d36-8cbb-4b23-b65d-d6b050ad3ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:57.934933 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3199d36-8cbb-4b23-b65d-d6b050ad3ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:57.935210 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3199d36-8cbb-4b23-b65d-d6b050ad3ff0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:57.936059 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3199d36-8cbb-4b23-b65d-d6b050ad3ff0 None admin] RBAC: Adding query filter params (group.id=6baf459f92a34fd18e9e3800c50eeb9d, role.id=8d92e2d53a9441a9b6ddaaad264ac4c9, scope.project.id=f5159196cf6c47c79e3bf91601a42a40) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:57.936378 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3199d36-8cbb-4b23-b65d-d6b050ad3ff0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:57.937992 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3199d36-8cbb-4b23-b65d-d6b050ad3ff0 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:57.943020 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 177/351] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:57:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 03:57:57.944163 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9664abb-d83c-4f26-b98a-dbbd823dc93a None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:57.944518 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 175/352] 10.222.0.49 () {56 vars in 1376 bytes} [Mon Jul 4 03:57:57 2022] GET /identity/v3/role_assignments?group.id=6baf459f92a34fd18e9e3800c50eeb9d&scope.project.id=f5159196cf6c47c79e3bf91601a42a40&role.id=8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:57.946044 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aeffbc-1fb8-4fb6-96ca-73183ccdc91f None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:57.950691 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aeffbc-1fb8-4fb6-96ca-73183ccdc91f None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:57.951048 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aeffbc-1fb8-4fb6-96ca-73183ccdc91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:57.970562 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-c1aeffbc-1fb8-4fb6-96ca-73183ccdc91f None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:57.971712 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c1aeffbc-1fb8-4fb6-96ca-73183ccdc91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:58.058604 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 176/353] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:58.059596 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aeffbc-1fb8-4fb6-96ca-73183ccdc91f None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:58.075732 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9664abb-d83c-4f26-b98a-dbbd823dc93a None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:58.105212 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:58.130004 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9c9a9-9a2f-4e6a-bc16-0909d961eef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:58.130945 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9c9a9-9a2f-4e6a-bc16-0909d961eef1 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:58.131229 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9c9a9-9a2f-4e6a-bc16-0909d961eef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:58.131508 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9c9a9-9a2f-4e6a-bc16-0909d961eef1 None admin] PATH_INFO: `/v3/users/4f8b4a658dc6473ea0bd9b21c9b58886` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:58.134589 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:58.134731 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9c9a9-9a2f-4e6a-bc16-0909d961eef1 None admin] RBAC: Authorizing `identity:get_user(user_id=4f8b4a658dc6473ea0bd9b21c9b58886)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:58.136176 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9c9a9-9a2f-4e6a-bc16-0909d961eef1 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:58.138494 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 178/354] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:57:57 2022] GET /identity/v3/users/4f8b4a658dc6473ea0bd9b21c9b58886 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:58.139168 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9c9a9-9a2f-4e6a-bc16-0909d961eef1 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:58.233960 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aeffbc-1fb8-4fb6-96ca-73183ccdc91f None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:58.272086 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9c9a9-9a2f-4e6a-bc16-0909d961eef1 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:58.276942 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1478d91a-33b2-4b33-aba5-ddb5e49c0161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:58.277832 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478d91a-33b2-4b33-aba5-ddb5e49c0161 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:58.278120 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478d91a-33b2-4b33-aba5-ddb5e49c0161 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:58.279101 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478d91a-33b2-4b33-aba5-ddb5e49c0161 None admin] PATH_INFO: `/v3/projects/f5159196cf6c47c79e3bf91601a42a40` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:58.280348 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1478d91a-33b2-4b33-aba5-ddb5e49c0161 None admin] RBAC: Authorizing `identity:get_project(project_id=f5159196cf6c47c79e3bf91601a42a40)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:58.281827 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1478d91a-33b2-4b33-aba5-ddb5e49c0161 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:58.288189 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 177/355] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:57:58 2022] GET /identity/v3/projects/f5159196cf6c47c79e3bf91601a42a40 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:58.288189 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1478d91a-33b2-4b33-aba5-ddb5e49c0161 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:58.315346 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e36124-6324-440c-93d4-15b6370b5ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:58.316534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e36124-6324-440c-93d4-15b6370b5ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:58.317022 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e36124-6324-440c-93d4-15b6370b5ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:58.317494 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e36124-6324-440c-93d4-15b6370b5ab1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:58.329959 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e36124-6324-440c-93d4-15b6370b5ab1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:57:58.339003 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-66e36124-6324-440c-93d4-15b6370b5ab1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 03:57:58.339003 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:58.339003 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:58.339003 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:58.339003 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:58.339003 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:58.339003 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:58.339003 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:58.339003 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:58.339003 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:58.339003 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:58.339003 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:58.339003 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:57:58.339003 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:57:58.339003 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:57:58.339003 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:57:58.339936 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:57:58.339936 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:57:58.339936 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:57:58.339936 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:57:58.339936 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:58.339936 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:58.339936 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:58.339936 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:58.339936 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:58.339936 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:58.339936 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:58.339936 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:58.339936 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:58.339936 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:58.339936 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:58.339936 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:58.340722 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:58.340722 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:58.340722 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:58.340722 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:58.340722 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:57:58.340722 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:57:58.340722 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:57:58.340722 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:57:58.340722 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:57:58.340722 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:57:58.340722 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 03:57:58.340722 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:57:58.343212 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 179/356] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:57:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:57:58.347923 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a74e48-809c-4917-b029-62c2b870e195 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:58.348350 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a74e48-809c-4917-b029-62c2b870e195 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:58.348759 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a74e48-809c-4917-b029-62c2b870e195 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:58.350563 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 180/357] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:58.351429 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a74e48-809c-4917-b029-62c2b870e195 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:58.404886 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1478d91a-33b2-4b33-aba5-ddb5e49c0161 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:58.415939 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:58.420873 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:58.447131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f025c-cac4-43d0-9a9d-5d857eaff0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:58.448197 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f025c-cac4-43d0-9a9d-5d857eaff0d3 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:58.448684 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f025c-cac4-43d0-9a9d-5d857eaff0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:58.449189 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f025c-cac4-43d0-9a9d-5d857eaff0d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:58.450310 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f025c-cac4-43d0-9a9d-5d857eaff0d3 None admin] RBAC: Adding query filter params (role.id=99db92117d0048efaae5874a11d96ce9, user.id=4f8b4a658dc6473ea0bd9b21c9b58886, scope.system=all) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:58.450799 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f025c-cac4-43d0-9a9d-5d857eaff0d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:58.452426 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f025c-cac4-43d0-9a9d-5d857eaff0d3 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:58.471562 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 178/358] 10.222.0.49 () {56 vars in 1308 bytes} [Mon Jul 4 03:57:58 2022] GET /identity/v3/role_assignments?user.id=4f8b4a658dc6473ea0bd9b21c9b58886&scope.system=all&role.id=99db92117d0048efaae5874a11d96ce9 => generated 510 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:58.473300 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29f0a8-2f59-469e-98ae-de5232a4d909 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:58.473661 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29f0a8-2f59-469e-98ae-de5232a4d909 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:58.474032 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29f0a8-2f59-469e-98ae-de5232a4d909 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:58.475704 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 179/359] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:57:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:57:58.476980 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29f0a8-2f59-469e-98ae-de5232a4d909 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:58.495635 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a74e48-809c-4917-b029-62c2b870e195 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:58.551649 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0ac81-1602-4719-bdec-99581de3a05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:58.552859 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0ac81-1602-4719-bdec-99581de3a05c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:58.553357 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0ac81-1602-4719-bdec-99581de3a05c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:58.553908 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0ac81-1602-4719-bdec-99581de3a05c None admin] PATH_INFO: `/v3/groups/6baf459f92a34fd18e9e3800c50eeb9d` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:58.555592 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0ac81-1602-4719-bdec-99581de3a05c None admin] RBAC: Authorizing `identity:get_group(group_id=6baf459f92a34fd18e9e3800c50eeb9d)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:58.557397 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0ac81-1602-4719-bdec-99581de3a05c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:58.559522 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 181/360] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Jul 4 03:57:58 2022] GET /identity/v3/groups/6baf459f92a34fd18e9e3800c50eeb9d => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:58.561250 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ad432-dea7-4915-9c14-273de9804cfc None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:58.561799 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ad432-dea7-4915-9c14-273de9804cfc None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:58.563083 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ad432-dea7-4915-9c14-273de9804cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:58.590869 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-744ad432-dea7-4915-9c14-273de9804cfc None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:58.592119 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-744ad432-dea7-4915-9c14-273de9804cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:58.613690 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29f0a8-2f59-469e-98ae-de5232a4d909 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:58.664514 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade9118-7253-4cc6-8de3-ab039a9f3b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:58.665575 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade9118-7253-4cc6-8de3-ab039a9f3b25 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:58.665868 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade9118-7253-4cc6-8de3-ab039a9f3b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:58.666431 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade9118-7253-4cc6-8de3-ab039a9f3b25 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:58.667208 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ade9118-7253-4cc6-8de3-ab039a9f3b25 None admin] RBAC: Adding query filter params (name=member) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:58.667674 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ade9118-7253-4cc6-8de3-ab039a9f3b25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:58.669545 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ade9118-7253-4cc6-8de3-ab039a9f3b25 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:58.674169 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 182/361] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:58.675581 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a0793-14ef-46b7-945a-1dab218c1bc5 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:58.675932 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a0793-14ef-46b7-945a-1dab218c1bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:58.676217 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a0793-14ef-46b7-945a-1dab218c1bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:58.680315 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 180/362] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Jul 4 03:57:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:58.680982 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade9118-7253-4cc6-8de3-ab039a9f3b25 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:58.702259 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-813a0793-14ef-46b7-945a-1dab218c1bc5 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:57:58.703458 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-813a0793-14ef-46b7-945a-1dab218c1bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:57:58.735692 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:58.766749 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:58.799827 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 183/363] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:57:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:57:58.800781 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a0793-14ef-46b7-945a-1dab218c1bc5 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:58.820342 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade9118-7253-4cc6-8de3-ab039a9f3b25 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:58.869408 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0509fd9-1eae-4c33-9a8e-8759906b6ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:58.870088 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0509fd9-1eae-4c33-9a8e-8759906b6ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:58.870477 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0509fd9-1eae-4c33-9a8e-8759906b6ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:58.870762 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0509fd9-1eae-4c33-9a8e-8759906b6ae6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:58.872018 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0509fd9-1eae-4c33-9a8e-8759906b6ae6 None admin] RBAC: Adding query filter params (group.id=6baf459f92a34fd18e9e3800c50eeb9d, role.id=a34eb11c5d95402e94c1bc45e635e387, scope.project.id=f5159196cf6c47c79e3bf91601a42a40) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:58.872136 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0509fd9-1eae-4c33-9a8e-8759906b6ae6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:58.873662 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0509fd9-1eae-4c33-9a8e-8759906b6ae6 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:58.880520 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 181/364] 10.222.0.49 () {56 vars in 1376 bytes} [Mon Jul 4 03:57:58 2022] GET /identity/v3/role_assignments?group.id=6baf459f92a34fd18e9e3800c50eeb9d&scope.project.id=f5159196cf6c47c79e3bf91601a42a40&role.id=a34eb11c5d95402e94c1bc45e635e387 => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:58.882200 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0509fd9-1eae-4c33-9a8e-8759906b6ae6 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:58.924377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a0793-14ef-46b7-945a-1dab218c1bc5 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:58.973513 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eee608-f91a-4578-bd8d-e7423363aeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:58.974851 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eee608-f91a-4578-bd8d-e7423363aeea None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:58.975830 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eee608-f91a-4578-bd8d-e7423363aeea None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:58.976627 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eee608-f91a-4578-bd8d-e7423363aeea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:59.013333 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:59.024459 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0509fd9-1eae-4c33-9a8e-8759906b6ae6 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:59.042742 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:59.065849 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c085a81d-bd76-464c-a5f6-5a51b75be60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:59.067281 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eee608-f91a-4578-bd8d-e7423363aeea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:59.067646 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085a81d-bd76-464c-a5f6-5a51b75be60f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:59.068182 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085a81d-bd76-464c-a5f6-5a51b75be60f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:59.068704 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085a81d-bd76-464c-a5f6-5a51b75be60f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:59.068805 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eee608-f91a-4578-bd8d-e7423363aeea None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:59.085840 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c085a81d-bd76-464c-a5f6-5a51b75be60f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:57:59.095617 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-c085a81d-bd76-464c-a5f6-5a51b75be60f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:57:59.095617 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:59.095617 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:59.095617 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:59.095617 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:59.095617 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:59.095617 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:59.095617 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:59.095617 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:59.095617 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:59.095617 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:59.095617 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:59.095617 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:57:59.095617 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:57:59.095617 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:57:59.095617 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:57:59.096553 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:57:59.096553 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:57:59.096553 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:57:59.096553 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:57:59.096553 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:59.096553 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:59.096553 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:59.096553 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:59.096553 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:59.096553 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:59.096553 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:59.096553 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:59.096553 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:59.096553 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:59.096553 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:59.096553 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:59.097369 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:59.097369 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:59.097369 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:59.097369 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:59.097369 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:57:59.097369 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:57:59.097369 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:57:59.097369 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:57:59.097369 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:57:59.097369 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:57:59.097369 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:57:59.097369 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:57:59.097369 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 182/365] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Jul 4 03:57:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:57:59.098024 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c085a81d-bd76-464c-a5f6-5a51b75be60f None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:59.204062 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 184/366] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:57:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 03:57:59.205601 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eee608-f91a-4578-bd8d-e7423363aeea None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:59.226999 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c085a81d-bd76-464c-a5f6-5a51b75be60f None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:59.273801 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000caa8-0dda-4abc-aa40-f94c259b38b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:59.275075 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000caa8-0dda-4abc-aa40-f94c259b38b6 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:59.275399 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000caa8-0dda-4abc-aa40-f94c259b38b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:59.275754 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000caa8-0dda-4abc-aa40-f94c259b38b6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:59.289104 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e000caa8-0dda-4abc-aa40-f94c259b38b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:57:59.296529 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:59.297803 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-e000caa8-0dda-4abc-aa40-f94c259b38b6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 03:57:59.297803 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:57:59.297803 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:57:59.297803 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:57:59.297803 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:57:59.297803 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:57:59.297803 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:57:59.297803 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:57:59.297803 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:57:59.297803 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:57:59.297803 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:57:59.297803 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:57:59.297803 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:57:59.297803 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:57:59.297803 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:57:59.297803 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:57:59.298826 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:57:59.298826 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:57:59.298826 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:57:59.298826 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:57:59.298826 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:57:59.298826 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:57:59.298826 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:57:59.298826 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:57:59.298826 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:57:59.298826 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:57:59.298826 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:57:59.298826 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:57:59.298826 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:57:59.298826 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:57:59.298826 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:57:59.298826 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:57:59.299789 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:57:59.299789 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:57:59.299789 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:57:59.299789 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:57:59.299789 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:57:59.299789 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:57:59.299789 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:57:59.299789 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:57:59.299789 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:57:59.299789 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:57:59.299789 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 03:57:59.299789 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:57:59.304651 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 183/367] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Jul 4 03:57:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:57:59.304651 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000caa8-0dda-4abc-aa40-f94c259b38b6 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:59.321381 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:59.339411 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eee608-f91a-4578-bd8d-e7423363aeea None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:59.384028 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eba2e8-66e7-43d0-b1ed-d64b85b309fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:59.385205 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eba2e8-66e7-43d0-b1ed-d64b85b309fb None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:59.386693 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eba2e8-66e7-43d0-b1ed-d64b85b309fb None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:59.387006 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eba2e8-66e7-43d0-b1ed-d64b85b309fb None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:59.387802 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eba2e8-66e7-43d0-b1ed-d64b85b309fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:59.388121 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eba2e8-66e7-43d0-b1ed-d64b85b309fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:59.391099 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eba2e8-66e7-43d0-b1ed-d64b85b309fb None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:59.400642 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 185/368] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:57:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:59.401660 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eba2e8-66e7-43d0-b1ed-d64b85b309fb None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:59.429972 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000caa8-0dda-4abc-aa40-f94c259b38b6 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:59.473912 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd90c93-3111-4ace-b0c5-be4303f705f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:59.474842 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd90c93-3111-4ace-b0c5-be4303f705f3 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:59.475130 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd90c93-3111-4ace-b0c5-be4303f705f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:59.475409 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd90c93-3111-4ace-b0c5-be4303f705f3 None admin] PATH_INFO: `/v3/projects/f5bcfb30168d4753a6b0048a7935c78f` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:59.476801 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd90c93-3111-4ace-b0c5-be4303f705f3 None admin] RBAC: Authorizing `identity:get_project(project_id=f5bcfb30168d4753a6b0048a7935c78f)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:59.478303 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd90c93-3111-4ace-b0c5-be4303f705f3 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:59.480395 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 184/369] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:57:59 2022] GET /identity/v3/projects/f5bcfb30168d4753a6b0048a7935c78f => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:59.481249 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd90c93-3111-4ace-b0c5-be4303f705f3 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:59.530362 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eba2e8-66e7-43d0-b1ed-d64b85b309fb None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:59.579988 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:59.581346 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf82e0b-9bf6-4d9a-bc08-890079d915be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:59.582042 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf82e0b-9bf6-4d9a-bc08-890079d915be None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:59.582354 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf82e0b-9bf6-4d9a-bc08-890079d915be None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:59.582634 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf82e0b-9bf6-4d9a-bc08-890079d915be None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:59.584291 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf82e0b-9bf6-4d9a-bc08-890079d915be None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:57:59.584291 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf82e0b-9bf6-4d9a-bc08-890079d915be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:59.585105 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf82e0b-9bf6-4d9a-bc08-890079d915be None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:59.594668 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 186/370] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:57:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:59.595340 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf82e0b-9bf6-4d9a-bc08-890079d915be None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:59.600566 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:59.609831 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd90c93-3111-4ace-b0c5-be4303f705f3 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:59.647338 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a1f13-721b-41aa-8f9f-e7a2d4c126a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:59.648195 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a1f13-721b-41aa-8f9f-e7a2d4c126a2 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:59.648580 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a1f13-721b-41aa-8f9f-e7a2d4c126a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:59.649014 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a1f13-721b-41aa-8f9f-e7a2d4c126a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:59.708724 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf82e0b-9bf6-4d9a-bc08-890079d915be None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:59.722577 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a1f13-721b-41aa-8f9f-e7a2d4c126a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:59.724295 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a1f13-721b-41aa-8f9f-e7a2d4c126a2 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:59.745807 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1a997-8bc8-460b-bad6-2b84a3fe4294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:59.747023 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1a997-8bc8-460b-bad6-2b84a3fe4294 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:59.747486 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1a997-8bc8-460b-bad6-2b84a3fe4294 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:59.747984 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1a997-8bc8-460b-bad6-2b84a3fe4294 None admin] PATH_INFO: `/v3/groups/6baf459f92a34fd18e9e3800c50eeb9d` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:59.749484 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1a997-8bc8-460b-bad6-2b84a3fe4294 None admin] RBAC: Authorizing `identity:get_group(group_id=6baf459f92a34fd18e9e3800c50eeb9d)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:59.751198 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1a997-8bc8-460b-bad6-2b84a3fe4294 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:57:59.753057 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 187/371] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Jul 4 03:57:59 2022] GET /identity/v3/groups/6baf459f92a34fd18e9e3800c50eeb9d => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:57:59.754014 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1a997-8bc8-460b-bad6-2b84a3fe4294 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:59.812431 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:59.831383 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:57:59.839834 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 185/372] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:57:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 03:57:59.840779 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a1f13-721b-41aa-8f9f-e7a2d4c126a2 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:57:59.865089 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1a997-8bc8-460b-bad6-2b84a3fe4294 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:59.900918 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f314a-f480-49c8-b6bb-83769a8773f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:57:59.901946 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f314a-f480-49c8-b6bb-83769a8773f9 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:57:59.902458 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f314a-f480-49c8-b6bb-83769a8773f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:57:59.902935 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f314a-f480-49c8-b6bb-83769a8773f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:57:59.956658 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a1f13-721b-41aa-8f9f-e7a2d4c126a2 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:57:59.980337 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f314a-f480-49c8-b6bb-83769a8773f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:57:59.982217 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f314a-f480-49c8-b6bb-83769a8773f9 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:00.002190 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adff80b-0fdc-4611-8fc6-78302dde7d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:00.002871 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adff80b-0fdc-4611-8fc6-78302dde7d8c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:00.003159 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adff80b-0fdc-4611-8fc6-78302dde7d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:00.003440 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adff80b-0fdc-4611-8fc6-78302dde7d8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:00.004665 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adff80b-0fdc-4611-8fc6-78302dde7d8c None admin] RBAC: Adding query filter params (group.id=6baf459f92a34fd18e9e3800c50eeb9d, role.id=8d92e2d53a9441a9b6ddaaad264ac4c9, scope.project.id=f5bcfb30168d4753a6b0048a7935c78f) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:00.004665 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adff80b-0fdc-4611-8fc6-78302dde7d8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:00.006692 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adff80b-0fdc-4611-8fc6-78302dde7d8c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:00.013334 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 186/373] 10.222.0.49 () {56 vars in 1376 bytes} [Mon Jul 4 03:57:59 2022] GET /identity/v3/role_assignments?group.id=6baf459f92a34fd18e9e3800c50eeb9d&scope.project.id=f5bcfb30168d4753a6b0048a7935c78f&role.id=8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:00.014337 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adff80b-0fdc-4611-8fc6-78302dde7d8c None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:00.058019 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:00.072580 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:00.093578 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 188/374] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:57:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 03:58:00.099363 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f314a-f480-49c8-b6bb-83769a8773f9 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:00.141245 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adff80b-0fdc-4611-8fc6-78302dde7d8c None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:00.181213 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991dbf3-8233-4488-b682-7cbb35ccea33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:00.182112 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991dbf3-8233-4488-b682-7cbb35ccea33 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:00.182428 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991dbf3-8233-4488-b682-7cbb35ccea33 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:00.182707 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991dbf3-8233-4488-b682-7cbb35ccea33 None admin] PATH_INFO: `/v3/projects/a178190dbd1b4a75a7550013812afce1` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:00.184190 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f991dbf3-8233-4488-b682-7cbb35ccea33 None admin] RBAC: Authorizing `identity:get_project(project_id=a178190dbd1b4a75a7550013812afce1)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:00.185695 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f991dbf3-8233-4488-b682-7cbb35ccea33 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:00.187648 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 187/375] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:58:00 2022] GET /identity/v3/projects/a178190dbd1b4a75a7550013812afce1 => generated 344 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:00.193576 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991dbf3-8233-4488-b682-7cbb35ccea33 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:00.212073 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f314a-f480-49c8-b6bb-83769a8773f9 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:00.250851 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036930d-ea10-4184-be99-51d41faa9a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:00.252101 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036930d-ea10-4184-be99-51d41faa9a74 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:00.252577 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036930d-ea10-4184-be99-51d41faa9a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:00.252860 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036930d-ea10-4184-be99-51d41faa9a74 None admin] PATH_INFO: `/v3/projects/f5bcfb30168d4753a6b0048a7935c78f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:00.254109 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036930d-ea10-4184-be99-51d41faa9a74 None admin] RBAC: Authorizing `identity:get_project(project_id=f5bcfb30168d4753a6b0048a7935c78f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:00.255639 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036930d-ea10-4184-be99-51d41faa9a74 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:00.257718 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 189/376] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:58:00 2022] GET /identity/v3/projects/f5bcfb30168d4753a6b0048a7935c78f => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:58:00.263796 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036930d-ea10-4184-be99-51d41faa9a74 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:00.307604 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:00.320283 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991dbf3-8233-4488-b682-7cbb35ccea33 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:00.346870 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:00.385899 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3e77c-7a11-491c-938b-7a59a537d776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:00.387143 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3e77c-7a11-491c-938b-7a59a537d776 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:00.387427 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3e77c-7a11-491c-938b-7a59a537d776 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:00.387704 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3e77c-7a11-491c-938b-7a59a537d776 None admin] PATH_INFO: `/v3/groups/36c04050dfd044cdbde09d6c1849cd5f` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:00.402171 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3e77c-7a11-491c-938b-7a59a537d776 None admin] RBAC: Authorizing `identity:get_group(group_id=36c04050dfd044cdbde09d6c1849cd5f)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:00.403672 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3e77c-7a11-491c-938b-7a59a537d776 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:00.405441 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 188/377] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Jul 4 03:58:00 2022] GET /identity/v3/groups/36c04050dfd044cdbde09d6c1849cd5f => generated 229 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:58:00.412873 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3e77c-7a11-491c-938b-7a59a537d776 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:00.420163 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036930d-ea10-4184-be99-51d41faa9a74 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:00.467423 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f4df3b-ba10-434b-8e19-ad7ebc680ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:00.468314 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4df3b-ba10-434b-8e19-ad7ebc680ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:00.468596 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4df3b-ba10-434b-8e19-ad7ebc680ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:00.468872 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4df3b-ba10-434b-8e19-ad7ebc680ee5 None admin] PATH_INFO: `/v3/groups/6baf459f92a34fd18e9e3800c50eeb9d` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:00.472247 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f4df3b-ba10-434b-8e19-ad7ebc680ee5 None admin] RBAC: Authorizing `identity:get_group(group_id=6baf459f92a34fd18e9e3800c50eeb9d)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:00.473893 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f4df3b-ba10-434b-8e19-ad7ebc680ee5 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:00.481482 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 190/378] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Jul 4 03:58:00 2022] GET /identity/v3/groups/6baf459f92a34fd18e9e3800c50eeb9d => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:58:00.482978 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681d4e0-5572-4889-bc7e-776bfce94631 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:00.483377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681d4e0-5572-4889-bc7e-776bfce94631 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:00.483694 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681d4e0-5572-4889-bc7e-776bfce94631 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:00.485292 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 191/379] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:00.486004 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681d4e0-5572-4889-bc7e-776bfce94631 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:00.557078 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3e77c-7a11-491c-938b-7a59a537d776 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:00.598640 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123b56f-3de7-4639-9175-de46fb6d73a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:00.599225 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123b56f-3de7-4639-9175-de46fb6d73a5 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:00.599512 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123b56f-3de7-4639-9175-de46fb6d73a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:00.599795 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123b56f-3de7-4639-9175-de46fb6d73a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:00.600636 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123b56f-3de7-4639-9175-de46fb6d73a5 None admin] RBAC: Adding query filter params (group.id=36c04050dfd044cdbde09d6c1849cd5f, role.id=2eee98054d42475bb7e22a8487ab235e, scope.project.id=a178190dbd1b4a75a7550013812afce1) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:00.600954 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123b56f-3de7-4639-9175-de46fb6d73a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:00.603033 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123b56f-3de7-4639-9175-de46fb6d73a5 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:00.609344 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 189/380] 10.222.0.49 () {56 vars in 1376 bytes} [Mon Jul 4 03:58:00 2022] GET /identity/v3/role_assignments?group.id=36c04050dfd044cdbde09d6c1849cd5f&scope.project.id=a178190dbd1b4a75a7550013812afce1&role.id=2eee98054d42475bb7e22a8487ab235e => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:00.610680 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5a272-087f-4a18-9305-fe5d86de86fe None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:00.611028 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5a272-087f-4a18-9305-fe5d86de86fe None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:00.611313 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5a272-087f-4a18-9305-fe5d86de86fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:00.618980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681d4e0-5572-4889-bc7e-776bfce94631 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:00.627597 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:00.640989 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-04e5a272-087f-4a18-9305-fe5d86de86fe None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:00.642071 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-04e5a272-087f-4a18-9305-fe5d86de86fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:00.664866 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf53e40-10d9-4f9c-82b3-8fb2a272d41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:00.665814 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf53e40-10d9-4f9c-82b3-8fb2a272d41a None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:00.666285 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf53e40-10d9-4f9c-82b3-8fb2a272d41a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:00.666708 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf53e40-10d9-4f9c-82b3-8fb2a272d41a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:00.668089 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf53e40-10d9-4f9c-82b3-8fb2a272d41a None admin] RBAC: Adding query filter params (group.id=6baf459f92a34fd18e9e3800c50eeb9d, role.id=a34eb11c5d95402e94c1bc45e635e387, scope.project.id=f5bcfb30168d4753a6b0048a7935c78f) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:00.668561 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf53e40-10d9-4f9c-82b3-8fb2a272d41a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:00.670587 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf53e40-10d9-4f9c-82b3-8fb2a272d41a None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:00.678930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 192/381] 10.222.0.49 () {56 vars in 1376 bytes} [Mon Jul 4 03:58:00 2022] GET /identity/v3/role_assignments?group.id=6baf459f92a34fd18e9e3800c50eeb9d&scope.project.id=f5bcfb30168d4753a6b0048a7935c78f&role.id=a34eb11c5d95402e94c1bc45e635e387 => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:00.717588 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:00.772733 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 190/382] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:58:00.807493 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf53e40-10d9-4f9c-82b3-8fb2a272d41a None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:00.941125 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf53e40-10d9-4f9c-82b3-8fb2a272d41a None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:00.993011 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21534ca9-7c24-491b-a620-90155b5c1421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:00.993833 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21534ca9-7c24-491b-a620-90155b5c1421 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:00.994119 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21534ca9-7c24-491b-a620-90155b5c1421 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:00.994430 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21534ca9-7c24-491b-a620-90155b5c1421 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:01.005631 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21534ca9-7c24-491b-a620-90155b5c1421 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:58:01.013873 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-21534ca9-7c24-491b-a620-90155b5c1421 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 03:58:01.013873 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:01.013873 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:01.013873 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:01.013873 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:01.013873 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:01.013873 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:01.013873 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:01.013873 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:01.013873 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:01.013873 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:01.013873 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:01.013873 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:58:01.013873 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:58:01.013873 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:58:01.013873 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:58:01.014849 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:58:01.014849 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:58:01.014849 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:58:01.014849 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:58:01.014849 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:01.014849 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:01.014849 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:01.014849 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:01.014849 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:01.014849 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:01.014849 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:01.014849 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:01.014849 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:01.014849 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:01.014849 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:01.014849 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:01.015674 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:01.015674 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:01.015674 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:01.015674 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:01.015674 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:58:01.015674 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:58:01.015674 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:58:01.015674 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:58:01.015674 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:58:01.015674 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:58:01.015674 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 03:58:01.015674 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:01.015674 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 193/383] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:58:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:01.021255 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5a272-087f-4a18-9305-fe5d86de86fe None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:01.176223 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5a272-087f-4a18-9305-fe5d86de86fe None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:01.223500 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965e2e6-74f4-4688-83e4-67eb0e1728aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:01.224115 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965e2e6-74f4-4688-83e4-67eb0e1728aa None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:01.224403 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965e2e6-74f4-4688-83e4-67eb0e1728aa None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:01.224688 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965e2e6-74f4-4688-83e4-67eb0e1728aa None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:01.225458 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965e2e6-74f4-4688-83e4-67eb0e1728aa None admin] RBAC: Adding query filter params (name=member) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:01.225776 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965e2e6-74f4-4688-83e4-67eb0e1728aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:01.227276 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965e2e6-74f4-4688-83e4-67eb0e1728aa None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:01.236390 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 191/384] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Jul 4 03:58:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:01.242185 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21534ca9-7c24-491b-a620-90155b5c1421 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:01.323558 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:01.339697 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af184d58-d8be-41b6-892e-2481c6129639 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:01.339996 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af184d58-d8be-41b6-892e-2481c6129639 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:01.340266 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af184d58-d8be-41b6-892e-2481c6129639 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:01.341948 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 192/385] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:01.347241 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a781ef-e38d-4941-b2e7-beef39407d0e None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:01.347534 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a781ef-e38d-4941-b2e7-beef39407d0e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:01.347818 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a781ef-e38d-4941-b2e7-beef39407d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:01.372268 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-14a781ef-e38d-4941-b2e7-beef39407d0e None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:01.373477 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-14a781ef-e38d-4941-b2e7-beef39407d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:01.421928 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:01.457876 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21534ca9-7c24-491b-a620-90155b5c1421 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:01.485406 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 193/386] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 03:58:01.512639 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a781ef-e38d-4941-b2e7-beef39407d0e None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:01.525471 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790e01e-caa1-4245-8a63-b5f08dbe2664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:01.527065 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790e01e-caa1-4245-8a63-b5f08dbe2664 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:01.527360 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790e01e-caa1-4245-8a63-b5f08dbe2664 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:01.527645 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790e01e-caa1-4245-8a63-b5f08dbe2664 None admin] PATH_INFO: `/v3/groups/6baf459f92a34fd18e9e3800c50eeb9d` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:01.531642 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790e01e-caa1-4245-8a63-b5f08dbe2664 None admin] RBAC: Authorizing `identity:get_group(group_id=6baf459f92a34fd18e9e3800c50eeb9d)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:01.533193 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790e01e-caa1-4245-8a63-b5f08dbe2664 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:01.538436 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 194/387] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Jul 4 03:58:01 2022] GET /identity/v3/groups/6baf459f92a34fd18e9e3800c50eeb9d => generated 226 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:01.540628 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790e01e-caa1-4245-8a63-b5f08dbe2664 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:01.630453 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a781ef-e38d-4941-b2e7-beef39407d0e None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:01.667506 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f7c26-c6f5-4850-abf5-e77588667324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:01.668333 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f7c26-c6f5-4850-abf5-e77588667324 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:01.668623 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f7c26-c6f5-4850-abf5-e77588667324 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:01.668907 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f7c26-c6f5-4850-abf5-e77588667324 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:01.679755 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f7c26-c6f5-4850-abf5-e77588667324 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:58:01.687889 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-4e0f7c26-c6f5-4850-abf5-e77588667324 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 03:58:01.687889 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:01.687889 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:01.687889 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:01.687889 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:01.687889 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:01.687889 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:01.687889 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:01.687889 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:01.687889 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:01.687889 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:01.687889 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:01.687889 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:58:01.687889 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:58:01.687889 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:58:01.687889 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:58:01.688768 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:58:01.688768 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:58:01.688768 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:58:01.688768 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:58:01.688768 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:01.688768 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:01.688768 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:01.688768 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:01.688768 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:01.688768 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:01.688768 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:01.688768 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:01.688768 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:01.688768 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:01.688768 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:01.688768 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:01.689579 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:01.689579 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:01.689579 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:01.689579 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:01.689579 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:58:01.689579 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:58:01.689579 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:58:01.689579 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:58:01.689579 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:58:01.689579 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:58:01.689579 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 03:58:01.689579 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:01.689579 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 194/388] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Jul 4 03:58:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:58:01.694607 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:01.696408 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f7c26-c6f5-4850-abf5-e77588667324 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:01.699377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790e01e-caa1-4245-8a63-b5f08dbe2664 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:01.740296 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:01.766666 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e6145-9c0e-40df-a05d-01bfa51cf140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:01.767562 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e6145-9c0e-40df-a05d-01bfa51cf140 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:01.767853 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e6145-9c0e-40df-a05d-01bfa51cf140 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:01.768136 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e6145-9c0e-40df-a05d-01bfa51cf140 None admin] PATH_INFO: `/v3/projects/f5159196cf6c47c79e3bf91601a42a40` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:01.771222 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e6145-9c0e-40df-a05d-01bfa51cf140 None admin] RBAC: Authorizing `identity:get_project(project_id=f5159196cf6c47c79e3bf91601a42a40)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:01.772773 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e6145-9c0e-40df-a05d-01bfa51cf140 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:01.775043 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 195/389] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:58:01 2022] GET /identity/v3/projects/f5159196cf6c47c79e3bf91601a42a40 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:58:01.780340 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e6145-9c0e-40df-a05d-01bfa51cf140 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:01.856178 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f7c26-c6f5-4850-abf5-e77588667324 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:01.892364 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337fc95c-d393-47cc-9366-4522a6873825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:01.893110 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fc95c-d393-47cc-9366-4522a6873825 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:01.893404 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fc95c-d393-47cc-9366-4522a6873825 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:01.893692 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fc95c-d393-47cc-9366-4522a6873825 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:01.894678 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337fc95c-d393-47cc-9366-4522a6873825 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:01.894999 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337fc95c-d393-47cc-9366-4522a6873825 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:01.896565 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337fc95c-d393-47cc-9366-4522a6873825 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:01.905549 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 195/390] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:58:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:01.911336 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337fc95c-d393-47cc-9366-4522a6873825 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:02.005518 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:02.023701 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337fc95c-d393-47cc-9366-4522a6873825 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:02.064450 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb592c-5cc3-4af5-9e9f-10a04c97c633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:02.065349 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb592c-5cc3-4af5-9e9f-10a04c97c633 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:02.065639 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb592c-5cc3-4af5-9e9f-10a04c97c633 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:02.065933 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb592c-5cc3-4af5-9e9f-10a04c97c633 None admin] PATH_INFO: `/v3/groups/6baf459f92a34fd18e9e3800c50eeb9d` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:02.067223 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb592c-5cc3-4af5-9e9f-10a04c97c633 None admin] RBAC: Authorizing `identity:get_group(group_id=6baf459f92a34fd18e9e3800c50eeb9d)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:02.068735 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb592c-5cc3-4af5-9e9f-10a04c97c633 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:02.070852 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 196/391] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Jul 4 03:58:01 2022] GET /identity/v3/groups/6baf459f92a34fd18e9e3800c50eeb9d => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:58:02.076364 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb592c-5cc3-4af5-9e9f-10a04c97c633 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:02.085594 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e6145-9c0e-40df-a05d-01bfa51cf140 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:02.154926 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73f041-de9c-40a8-a259-c3cf82961823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:02.155868 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73f041-de9c-40a8-a259-c3cf82961823 None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:02.156160 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73f041-de9c-40a8-a259-c3cf82961823 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:02.156443 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73f041-de9c-40a8-a259-c3cf82961823 None admin] PATH_INFO: `/v3/projects/f5159196cf6c47c79e3bf91601a42a40/groups/6baf459f92a34fd18e9e3800c50eeb9d/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:02.164488 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73f041-de9c-40a8-a259-c3cf82961823 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5159196cf6c47c79e3bf91601a42a40, group_id=6baf459f92a34fd18e9e3800c50eeb9d, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:02.164638 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73f041-de9c-40a8-a259-c3cf82961823 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:02.188785 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 196/392] 10.222.0.49 () {58 vars in 1442 bytes} [Mon Jul 4 03:58:01 2022] PUT /identity/v3/projects/f5159196cf6c47c79e3bf91601a42a40/groups/6baf459f92a34fd18e9e3800c50eeb9d/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 03:58:02.189233 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb592c-5cc3-4af5-9e9f-10a04c97c633 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:02.241443 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6bbeb4-d260-4692-aea3-cf5a8647a6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:02.242552 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bbeb4-d260-4692-aea3-cf5a8647a6b2 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:02.242839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bbeb4-d260-4692-aea3-cf5a8647a6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:02.243131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bbeb4-d260-4692-aea3-cf5a8647a6b2 None admin] PATH_INFO: `/v3/projects/f5159196cf6c47c79e3bf91601a42a40` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:02.244368 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6bbeb4-d260-4692-aea3-cf5a8647a6b2 None admin] RBAC: Authorizing `identity:get_project(project_id=f5159196cf6c47c79e3bf91601a42a40)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:02.245857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6bbeb4-d260-4692-aea3-cf5a8647a6b2 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:02.247977 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 197/393] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:58:02 2022] GET /identity/v3/projects/f5159196cf6c47c79e3bf91601a42a40 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:58:02.259456 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73f041-de9c-40a8-a259-c3cf82961823 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:02.310560 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:02.417354 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73f041-de9c-40a8-a259-c3cf82961823 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:02.453569 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ce134-2c05-4d42-ab41-9b8d4796436a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:02.454508 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ce134-2c05-4d42-ab41-9b8d4796436a None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:02.454797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ce134-2c05-4d42-ab41-9b8d4796436a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:02.455085 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ce134-2c05-4d42-ab41-9b8d4796436a None admin] PATH_INFO: `/v3/projects/f5159196cf6c47c79e3bf91601a42a40/groups/6baf459f92a34fd18e9e3800c50eeb9d/roles/a34eb11c5d95402e94c1bc45e635e387` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:02.457358 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238ce134-2c05-4d42-ab41-9b8d4796436a None admin] RBAC: Authorizing `identity:create_grant(project_id=f5159196cf6c47c79e3bf91601a42a40, group_id=6baf459f92a34fd18e9e3800c50eeb9d, role_id=a34eb11c5d95402e94c1bc45e635e387)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:02.458867 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238ce134-2c05-4d42-ab41-9b8d4796436a None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:02.485145 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 197/394] 10.222.0.49 () {58 vars in 1442 bytes} [Mon Jul 4 03:58:02 2022] PUT /identity/v3/projects/f5159196cf6c47c79e3bf91601a42a40/groups/6baf459f92a34fd18e9e3800c50eeb9d/roles/a34eb11c5d95402e94c1bc45e635e387 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 03:58:02.646577 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c49c4-86c1-4a7f-8ee3-e4aab1376e7b None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:02.646769 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c49c4-86c1-4a7f-8ee3-e4aab1376e7b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:02.647055 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c49c4-86c1-4a7f-8ee3-e4aab1376e7b None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:02.648472 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 198/395] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:02.654075 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83713d03-e173-45cf-bc56-75c2394ee07a None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:02.654396 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83713d03-e173-45cf-bc56-75c2394ee07a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:02.654754 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83713d03-e173-45cf-bc56-75c2394ee07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:02.675836 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-83713d03-e173-45cf-bc56-75c2394ee07a None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:02.677038 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-83713d03-e173-45cf-bc56-75c2394ee07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:02.763269 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 198/396] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:58:02.785330 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c49c4-86c1-4a7f-8ee3-e4aab1376e7b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:02.813725 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:02.912612 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c49c4-86c1-4a7f-8ee3-e4aab1376e7b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:02.951740 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb3a58-111f-42ca-8e6c-9b6792b39ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:02.952557 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb3a58-111f-42ca-8e6c-9b6792b39ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:02.952844 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb3a58-111f-42ca-8e6c-9b6792b39ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:02.953125 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb3a58-111f-42ca-8e6c-9b6792b39ef2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:02.965216 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb3a58-111f-42ca-8e6c-9b6792b39ef2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:58:02.973238 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-60eb3a58-111f-42ca-8e6c-9b6792b39ef2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 03:58:02.973238 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:02.973238 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:02.973238 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:02.973238 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:02.973238 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:02.973238 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:02.973238 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:02.973238 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:02.973238 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:02.973238 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:02.973238 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:02.973238 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:58:02.973238 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:58:02.973238 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:58:02.973238 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:58:02.975293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:58:02.975293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:58:02.975293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:58:02.975293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:58:02.975293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:02.975293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:02.975293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:02.975293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:02.975293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:02.975293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:02.975293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:02.975293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:02.975293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:02.975293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:02.975293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:02.975293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:02.976133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:02.976133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:02.976133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:02.976133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:02.976133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:58:02.976133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:58:02.976133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:58:02.976133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:58:02.976133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:58:02.976133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:58:02.976133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 03:58:02.976133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:02.976133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 199/397] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:58:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:02.980710 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83713d03-e173-45cf-bc56-75c2394ee07a None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:02.999995 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:03.087330 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83713d03-e173-45cf-bc56-75c2394ee07a None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:03.123429 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd3b67-3512-46bd-8efe-894dc427139e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:03.124120 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd3b67-3512-46bd-8efe-894dc427139e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:03.124407 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd3b67-3512-46bd-8efe-894dc427139e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:03.124694 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd3b67-3512-46bd-8efe-894dc427139e None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:03.125467 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd3b67-3512-46bd-8efe-894dc427139e None admin] RBAC: Adding query filter params (name=member) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:03.125781 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd3b67-3512-46bd-8efe-894dc427139e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:03.127229 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd3b67-3512-46bd-8efe-894dc427139e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:03.137243 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 199/398] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Jul 4 03:58:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:58:03.142714 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb3a58-111f-42ca-8e6c-9b6792b39ef2 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:03.230371 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:03.250430 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb3a58-111f-42ca-8e6c-9b6792b39ef2 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:03.291659 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f4541-1304-44d2-bd8c-54ec8f62f1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:03.292540 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f4541-1304-44d2-bd8c-54ec8f62f1a4 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:03.292827 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f4541-1304-44d2-bd8c-54ec8f62f1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:03.293108 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f4541-1304-44d2-bd8c-54ec8f62f1a4 None admin] PATH_INFO: `/v3/groups/6baf459f92a34fd18e9e3800c50eeb9d` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:03.294394 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f4541-1304-44d2-bd8c-54ec8f62f1a4 None admin] RBAC: Authorizing `identity:get_group(group_id=6baf459f92a34fd18e9e3800c50eeb9d)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:03.295932 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f4541-1304-44d2-bd8c-54ec8f62f1a4 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:03.297914 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 200/399] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Jul 4 03:58:03 2022] GET /identity/v3/groups/6baf459f92a34fd18e9e3800c50eeb9d => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:03.303205 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd3b67-3512-46bd-8efe-894dc427139e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:03.414620 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:03.425571 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd3b67-3512-46bd-8efe-894dc427139e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:03.460563 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b751fc1-f530-4a34-af03-797ddbb80803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:03.461501 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b751fc1-f530-4a34-af03-797ddbb80803 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:03.461791 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b751fc1-f530-4a34-af03-797ddbb80803 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:03.462077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b751fc1-f530-4a34-af03-797ddbb80803 None admin] PATH_INFO: `/v3/projects/f5bcfb30168d4753a6b0048a7935c78f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:03.464659 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39bed66-719e-4bfd-8a5f-92e01c4007b9 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:03.464950 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39bed66-719e-4bfd-8a5f-92e01c4007b9 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:03.465234 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39bed66-719e-4bfd-8a5f-92e01c4007b9 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:03.466900 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 201/400] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:03.467700 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b751fc1-f530-4a34-af03-797ddbb80803 None admin] RBAC: Authorizing `identity:get_project(project_id=f5bcfb30168d4753a6b0048a7935c78f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:03.469201 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b751fc1-f530-4a34-af03-797ddbb80803 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:03.471540 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed243abe-a160-4523-8901-5788edbc5a17 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:03.471831 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed243abe-a160-4523-8901-5788edbc5a17 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:03.472110 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed243abe-a160-4523-8901-5788edbc5a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:03.478990 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 200/401] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:58:03 2022] GET /identity/v3/projects/f5bcfb30168d4753a6b0048a7935c78f => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:03.485883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b751fc1-f530-4a34-af03-797ddbb80803 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:03.499807 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ed243abe-a160-4523-8901-5788edbc5a17 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:03.501059 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ed243abe-a160-4523-8901-5788edbc5a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:03.609270 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b751fc1-f530-4a34-af03-797ddbb80803 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:03.644730 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f01f96-127f-4fcf-8028-297eeb7f1bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:03.645880 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f01f96-127f-4fcf-8028-297eeb7f1bd0 None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:03.646382 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f01f96-127f-4fcf-8028-297eeb7f1bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:03.646807 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f01f96-127f-4fcf-8028-297eeb7f1bd0 None admin] PATH_INFO: `/v3/projects/f5bcfb30168d4753a6b0048a7935c78f/groups/6baf459f92a34fd18e9e3800c50eeb9d/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:03.649160 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f01f96-127f-4fcf-8028-297eeb7f1bd0 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5bcfb30168d4753a6b0048a7935c78f, group_id=6baf459f92a34fd18e9e3800c50eeb9d, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:03.650942 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f01f96-127f-4fcf-8028-297eeb7f1bd0 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:03.659434 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 202/402] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:58:03.670109 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 201/403] 10.222.0.49 () {58 vars in 1442 bytes} [Mon Jul 4 03:58:03 2022] PUT /identity/v3/projects/f5bcfb30168d4753a6b0048a7935c78f/groups/6baf459f92a34fd18e9e3800c50eeb9d/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 03:58:03.687575 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed243abe-a160-4523-8901-5788edbc5a17 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:03.705427 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b302957-4e6d-458d-b6b4-6a2199ceff84 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:03.706069 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b302957-4e6d-458d-b6b4-6a2199ceff84 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:03.706586 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b302957-4e6d-458d-b6b4-6a2199ceff84 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:03.708202 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 202/404] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 03:58:03.714064 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dc3a1-1273-40e7-a29d-6e8c716a9349 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:03.714732 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dc3a1-1273-40e7-a29d-6e8c716a9349 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:03.715203 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dc3a1-1273-40e7-a29d-6e8c716a9349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:03.729567 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:03.734086 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-9a5dc3a1-1273-40e7-a29d-6e8c716a9349 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:03.735675 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9a5dc3a1-1273-40e7-a29d-6e8c716a9349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:03.798752 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:03.818760 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 203/405] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 03:58:03.822208 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed243abe-a160-4523-8901-5788edbc5a17 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:03.842964 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dc3a1-1273-40e7-a29d-6e8c716a9349 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:03.861082 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b65d7a-94c4-4fb4-b0da-f7a74103b1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:03.861912 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b65d7a-94c4-4fb4-b0da-f7a74103b1e3 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:03.862234 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b65d7a-94c4-4fb4-b0da-f7a74103b1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:03.862519 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b65d7a-94c4-4fb4-b0da-f7a74103b1e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:03.878261 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b65d7a-94c4-4fb4-b0da-f7a74103b1e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:58:03.887619 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-62b65d7a-94c4-4fb4-b0da-f7a74103b1e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:58:03.887619 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:03.887619 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:03.887619 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:03.887619 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:03.887619 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:03.887619 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:03.887619 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:03.887619 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:03.887619 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:03.887619 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:03.887619 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:03.887619 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:58:03.887619 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:58:03.887619 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:58:03.887619 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:58:03.888700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:58:03.888700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:58:03.888700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:58:03.888700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:58:03.888700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:03.888700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:03.888700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:03.888700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:03.888700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:03.888700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:03.888700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:03.888700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:03.888700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:03.888700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:03.888700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:03.888700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:03.889481 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:03.889481 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:03.889481 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:03.889481 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:03.889481 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:58:03.889481 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:58:03.889481 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:58:03.889481 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:58:03.889481 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:58:03.889481 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:58:03.889481 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:58:03.889481 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:03.889481 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 203/406] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Jul 4 03:58:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:03.896737 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b65d7a-94c4-4fb4-b0da-f7a74103b1e3 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:03.991900 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dc3a1-1273-40e7-a29d-6e8c716a9349 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:04.034418 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b65d7a-94c4-4fb4-b0da-f7a74103b1e3 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:04.043451 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e790b-4b7b-4fe1-87ae-9490c5cacb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:04.046237 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e790b-4b7b-4fe1-87ae-9490c5cacb56 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:04.046739 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e790b-4b7b-4fe1-87ae-9490c5cacb56 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:04.047236 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e790b-4b7b-4fe1-87ae-9490c5cacb56 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:04.052700 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:04.064794 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e790b-4b7b-4fe1-87ae-9490c5cacb56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:58:04.076641 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-2d1e790b-4b7b-4fe1-87ae-9490c5cacb56 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 03:58:04.076641 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:04.076641 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:04.076641 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:04.076641 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:04.076641 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:04.076641 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:04.076641 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:04.076641 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:04.076641 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:04.076641 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:04.076641 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:04.076641 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:58:04.076641 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:58:04.076641 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:58:04.076641 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:58:04.077576 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:58:04.077576 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:58:04.077576 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:58:04.077576 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:58:04.077576 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:04.077576 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:04.077576 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:04.077576 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:04.077576 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:04.077576 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:04.077576 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:04.077576 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:04.077576 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:04.077576 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:04.077576 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:04.077576 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:04.078432 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:04.078432 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:04.078432 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:04.078432 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:04.078432 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:58:04.078432 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:58:04.078432 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:58:04.078432 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:58:04.078432 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:58:04.078432 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:58:04.078432 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 03:58:04.078432 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:04.080265 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbbee4e-a7b5-4de6-88f1-cbc656bbb465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:04.080955 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbbee4e-a7b5-4de6-88f1-cbc656bbb465 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:04.081243 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbbee4e-a7b5-4de6-88f1-cbc656bbb465 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:04.081522 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbbee4e-a7b5-4de6-88f1-cbc656bbb465 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:04.082131 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 204/407] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Jul 4 03:58:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:58:04.082353 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbbee4e-a7b5-4de6-88f1-cbc656bbb465 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:04.082672 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbbee4e-a7b5-4de6-88f1-cbc656bbb465 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:04.084016 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbbee4e-a7b5-4de6-88f1-cbc656bbb465 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:04.091401 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:04.092668 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e790b-4b7b-4fe1-87ae-9490c5cacb56 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:04.096169 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 204/408] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:58:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:58:04.101511 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbbee4e-a7b5-4de6-88f1-cbc656bbb465 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:04.219397 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e790b-4b7b-4fe1-87ae-9490c5cacb56 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:04.260245 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6172dd5-5aa6-4e5d-bd75-8db45d26563b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:04.260940 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6172dd5-5aa6-4e5d-bd75-8db45d26563b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:04.261544 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6172dd5-5aa6-4e5d-bd75-8db45d26563b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:04.261825 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6172dd5-5aa6-4e5d-bd75-8db45d26563b None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:04.262628 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6172dd5-5aa6-4e5d-bd75-8db45d26563b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:04.262941 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6172dd5-5aa6-4e5d-bd75-8db45d26563b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:04.264421 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6172dd5-5aa6-4e5d-bd75-8db45d26563b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:04.272316 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbbee4e-a7b5-4de6-88f1-cbc656bbb465 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:04.273531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 205/409] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:58:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:58:04.279178 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6172dd5-5aa6-4e5d-bd75-8db45d26563b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:04.354952 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:04.363693 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6884efaa-5f47-4b1e-9411-6ac0d6e2a904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:04.364567 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884efaa-5f47-4b1e-9411-6ac0d6e2a904 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:04.364850 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884efaa-5f47-4b1e-9411-6ac0d6e2a904 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:04.365131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884efaa-5f47-4b1e-9411-6ac0d6e2a904 None admin] PATH_INFO: `/v3/groups/36c04050dfd044cdbde09d6c1849cd5f` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:04.366864 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6884efaa-5f47-4b1e-9411-6ac0d6e2a904 None admin] RBAC: Authorizing `identity:get_group(group_id=36c04050dfd044cdbde09d6c1849cd5f)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:04.371046 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6884efaa-5f47-4b1e-9411-6ac0d6e2a904 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:04.379325 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 205/410] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Jul 4 03:58:04 2022] GET /identity/v3/groups/36c04050dfd044cdbde09d6c1849cd5f => generated 229 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:58:04.381751 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6884efaa-5f47-4b1e-9411-6ac0d6e2a904 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:04.438418 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6172dd5-5aa6-4e5d-bd75-8db45d26563b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:04.498254 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbeb6e3-3171-4180-9dbb-7454b8faf57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:04.498973 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:04.499154 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbeb6e3-3171-4180-9dbb-7454b8faf57e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:04.499776 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbeb6e3-3171-4180-9dbb-7454b8faf57e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:04.500060 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbeb6e3-3171-4180-9dbb-7454b8faf57e None admin] PATH_INFO: `/v3/groups/6baf459f92a34fd18e9e3800c50eeb9d` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:04.501361 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbeb6e3-3171-4180-9dbb-7454b8faf57e None admin] RBAC: Authorizing `identity:get_group(group_id=6baf459f92a34fd18e9e3800c50eeb9d)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:04.503182 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbeb6e3-3171-4180-9dbb-7454b8faf57e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:04.505139 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 206/411] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Jul 4 03:58:04 2022] GET /identity/v3/groups/6baf459f92a34fd18e9e3800c50eeb9d => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:04.510713 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbeb6e3-3171-4180-9dbb-7454b8faf57e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:04.559554 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6884efaa-5f47-4b1e-9411-6ac0d6e2a904 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:04.638426 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbeb6e3-3171-4180-9dbb-7454b8faf57e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:04.655438 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb3ff2-6da5-4cf4-b093-07a6886e8c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:04.656326 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb3ff2-6da5-4cf4-b093-07a6886e8c14 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:04.656607 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb3ff2-6da5-4cf4-b093-07a6886e8c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:04.656880 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb3ff2-6da5-4cf4-b093-07a6886e8c14 None admin] PATH_INFO: `/v3/projects/a178190dbd1b4a75a7550013812afce1` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:04.658077 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb3ff2-6da5-4cf4-b093-07a6886e8c14 None admin] RBAC: Authorizing `identity:get_project(project_id=a178190dbd1b4a75a7550013812afce1)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:04.659575 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb3ff2-6da5-4cf4-b093-07a6886e8c14 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:04.661283 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 206/412] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:58:04 2022] GET /identity/v3/projects/a178190dbd1b4a75a7550013812afce1 => generated 344 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:04.670539 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:04.671100 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb3ff2-6da5-4cf4-b093-07a6886e8c14 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:04.683152 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d8612-3c9c-49b7-8a75-90e9d4148756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:04.684058 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d8612-3c9c-49b7-8a75-90e9d4148756 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:04.684351 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d8612-3c9c-49b7-8a75-90e9d4148756 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:04.684730 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d8612-3c9c-49b7-8a75-90e9d4148756 None admin] PATH_INFO: `/v3/projects/f5bcfb30168d4753a6b0048a7935c78f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:04.686026 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d8612-3c9c-49b7-8a75-90e9d4148756 None admin] RBAC: Authorizing `identity:get_project(project_id=f5bcfb30168d4753a6b0048a7935c78f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:04.687564 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d8612-3c9c-49b7-8a75-90e9d4148756 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:04.689648 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 207/413] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:58:04 2022] GET /identity/v3/projects/f5bcfb30168d4753a6b0048a7935c78f => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:04.697069 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d8612-3c9c-49b7-8a75-90e9d4148756 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:04.869953 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb3ff2-6da5-4cf4-b093-07a6886e8c14 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:04.894495 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d8612-3c9c-49b7-8a75-90e9d4148756 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:04.946625 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41dcfb-affb-45da-a630-8a243a202b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:04.947534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41dcfb-affb-45da-a630-8a243a202b58 None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:04.947821 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41dcfb-affb-45da-a630-8a243a202b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:04.948103 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41dcfb-affb-45da-a630-8a243a202b58 None admin] PATH_INFO: `/v3/projects/f5bcfb30168d4753a6b0048a7935c78f/groups/6baf459f92a34fd18e9e3800c50eeb9d/roles/a34eb11c5d95402e94c1bc45e635e387` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:04.952360 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41dcfb-affb-45da-a630-8a243a202b58 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5bcfb30168d4753a6b0048a7935c78f, group_id=6baf459f92a34fd18e9e3800c50eeb9d, role_id=a34eb11c5d95402e94c1bc45e635e387)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:04.953841 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41dcfb-affb-45da-a630-8a243a202b58 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:04.958476 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371500d-0bf2-4e9f-be74-9cba3a6b2c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:04.959381 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371500d-0bf2-4e9f-be74-9cba3a6b2c19 None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:04.959705 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371500d-0bf2-4e9f-be74-9cba3a6b2c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:04.960482 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371500d-0bf2-4e9f-be74-9cba3a6b2c19 None admin] PATH_INFO: `/v3/projects/a178190dbd1b4a75a7550013812afce1/groups/36c04050dfd044cdbde09d6c1849cd5f/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:04.977547 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7371500d-0bf2-4e9f-be74-9cba3a6b2c19 None admin] RBAC: Authorizing `identity:create_grant(project_id=a178190dbd1b4a75a7550013812afce1, group_id=36c04050dfd044cdbde09d6c1849cd5f, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:04.977547 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7371500d-0bf2-4e9f-be74-9cba3a6b2c19 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:04.978202 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:04.994542 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 207/414] 10.222.0.49 () {58 vars in 1442 bytes} [Mon Jul 4 03:58:04 2022] PUT /identity/v3/projects/a178190dbd1b4a75a7550013812afce1/groups/36c04050dfd044cdbde09d6c1849cd5f/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 03:58:05.001005 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 208/415] 10.222.0.49 () {58 vars in 1442 bytes} [Mon Jul 4 03:58:04 2022] PUT /identity/v3/projects/f5bcfb30168d4753a6b0048a7935c78f/groups/6baf459f92a34fd18e9e3800c50eeb9d/roles/a34eb11c5d95402e94c1bc45e635e387 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 03:58:05.046871 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd5b90-d446-47b6-b258-9d9c175219df None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:05.047545 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd5b90-d446-47b6-b258-9d9c175219df None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:05.048098 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd5b90-d446-47b6-b258-9d9c175219df None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:05.050145 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 208/416] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:05.056506 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef8be1-6ef1-42e4-a87d-6350a40aceb0 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:05.057142 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef8be1-6ef1-42e4-a87d-6350a40aceb0 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:05.057653 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef8be1-6ef1-42e4-a87d-6350a40aceb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:05.077020 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-d7ef8be1-6ef1-42e4-a87d-6350a40aceb0 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:05.078646 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d7ef8be1-6ef1-42e4-a87d-6350a40aceb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:05.139412 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:05.165478 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 209/417] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:58:05.184709 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd5b90-d446-47b6-b258-9d9c175219df None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:05.280823 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b2806-00ad-4e82-93dd-35b95131528b None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:05.281133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b2806-00ad-4e82-93dd-35b95131528b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:05.281421 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b2806-00ad-4e82-93dd-35b95131528b None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:05.283125 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 210/418] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 03:58:05.289349 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee18cf-bf3f-4622-b0db-359b11acdbc1 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:05.289674 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee18cf-bf3f-4622-b0db-359b11acdbc1 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:05.289918 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee18cf-bf3f-4622-b0db-359b11acdbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:05.314949 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-92ee18cf-bf3f-4622-b0db-359b11acdbc1 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:05.316687 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-92ee18cf-bf3f-4622-b0db-359b11acdbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:05.329781 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd5b90-d446-47b6-b258-9d9c175219df None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:05.367811 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02366709-6ab5-490e-98a0-23a01b84f9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:05.368720 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02366709-6ab5-490e-98a0-23a01b84f9be None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:05.369055 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02366709-6ab5-490e-98a0-23a01b84f9be None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:05.369350 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02366709-6ab5-490e-98a0-23a01b84f9be None admin] PATH_INFO: `/v3/roles/member` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:05.381188 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02366709-6ab5-490e-98a0-23a01b84f9be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:58:05.390133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-02366709-6ab5-490e-98a0-23a01b84f9be None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 03:58:05.390133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:05.390133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:05.390133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:05.390133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:05.390133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:05.390133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:05.390133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:05.390133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:05.390133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:05.390133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:05.390133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:05.390133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:58:05.390133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:58:05.390133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:58:05.390133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:58:05.391053 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:58:05.391053 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:58:05.391053 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:58:05.391053 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:58:05.391053 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:05.391053 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:05.391053 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:05.391053 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:05.391053 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:05.391053 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:05.391053 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:05.391053 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:05.391053 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:05.391053 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:05.391053 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:05.391053 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:05.391855 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:05.391855 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:05.391855 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:05.391855 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:05.391855 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:58:05.391855 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:58:05.391855 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:58:05.391855 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:58:05.391855 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:58:05.391855 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:58:05.391855 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 03:58:05.391855 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:05.392945 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 211/420] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 03:58:05.394227 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 209/420] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:58:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:05.397881 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee18cf-bf3f-4622-b0db-359b11acdbc1 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:05.417306 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02366709-6ab5-490e-98a0-23a01b84f9be None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:05.504096 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:05.545420 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee18cf-bf3f-4622-b0db-359b11acdbc1 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:05.570054 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:05.583967 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02366709-6ab5-490e-98a0-23a01b84f9be None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:05.619434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66af483-57cf-471d-ba91-6ae07e6f2d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:05.621194 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66af483-57cf-471d-ba91-6ae07e6f2d87 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:05.621849 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66af483-57cf-471d-ba91-6ae07e6f2d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:05.623527 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66af483-57cf-471d-ba91-6ae07e6f2d87 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:05.625082 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66af483-57cf-471d-ba91-6ae07e6f2d87 None admin] RBAC: Adding query filter params (name=member) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:05.625779 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66af483-57cf-471d-ba91-6ae07e6f2d87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:05.629403 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66af483-57cf-471d-ba91-6ae07e6f2d87 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:05.642457 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc8c46-29c5-445c-b640-13bb1c9fd843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:05.643615 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc8c46-29c5-445c-b640-13bb1c9fd843 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:05.644114 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc8c46-29c5-445c-b640-13bb1c9fd843 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:05.644651 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc8c46-29c5-445c-b640-13bb1c9fd843 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:05.649656 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 212/421] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Jul 4 03:58:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:58:05.657383 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66af483-57cf-471d-ba91-6ae07e6f2d87 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:05.674674 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc8c46-29c5-445c-b640-13bb1c9fd843 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:58:05.691227 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-4ecc8c46-29c5-445c-b640-13bb1c9fd843 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 03:58:05.691227 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:05.691227 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:05.691227 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:05.691227 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:05.691227 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:05.691227 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:05.691227 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:05.691227 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:05.691227 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:05.691227 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:05.691227 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:05.691227 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:58:05.691227 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:58:05.691227 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:58:05.691227 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:58:05.692159 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:58:05.692159 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:58:05.692159 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:58:05.692159 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:58:05.692159 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:05.692159 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:05.692159 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:05.692159 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:05.692159 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:05.692159 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:05.692159 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:05.692159 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:05.692159 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:05.692159 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:05.692159 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:05.692159 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:05.692965 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:05.692965 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:05.692965 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:05.692965 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:05.692965 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:58:05.692965 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:58:05.692965 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:58:05.692965 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:58:05.692965 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:58:05.692965 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:58:05.692965 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 03:58:05.692965 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:05.699193 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 210/422] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Jul 4 03:58:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:58:05.713993 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc8c46-29c5-445c-b640-13bb1c9fd843 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:05.851375 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66af483-57cf-471d-ba91-6ae07e6f2d87 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:05.855775 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc8c46-29c5-445c-b640-13bb1c9fd843 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:05.894268 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:05.923856 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f41b2-d23e-4448-a054-ede4dab3b50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:05.924891 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c2061-326c-424f-826b-ca70559872bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:05.925789 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f41b2-d23e-4448-a054-ede4dab3b50e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:05.926678 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c2061-326c-424f-826b-ca70559872bc None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:05.927163 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f41b2-d23e-4448-a054-ede4dab3b50e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:05.927669 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c2061-326c-424f-826b-ca70559872bc None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:05.928169 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f41b2-d23e-4448-a054-ede4dab3b50e None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:05.928640 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c2061-326c-424f-826b-ca70559872bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:05.929607 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f41b2-d23e-4448-a054-ede4dab3b50e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:05.931170 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f41b2-d23e-4448-a054-ede4dab3b50e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:05.934707 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f41b2-d23e-4448-a054-ede4dab3b50e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:05.944070 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 211/423] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:58:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:58:05.955164 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f41b2-d23e-4448-a054-ede4dab3b50e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:05.986486 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:06.009676 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c2061-326c-424f-826b-ca70559872bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:06.011588 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c2061-326c-424f-826b-ca70559872bc None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:06.130065 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f41b2-d23e-4448-a054-ede4dab3b50e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:06.190094 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684836fe-b604-4b57-a7f1-55d3d1a7d9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:06.190691 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684836fe-b604-4b57-a7f1-55d3d1a7d9b1 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:06.190977 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684836fe-b604-4b57-a7f1-55d3d1a7d9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:06.191254 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684836fe-b604-4b57-a7f1-55d3d1a7d9b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:06.208941 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 213/424] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:58:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 03:58:06.215910 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c2061-326c-424f-826b-ca70559872bc None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:06.261803 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:06.287896 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684836fe-b604-4b57-a7f1-55d3d1a7d9b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:06.289424 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684836fe-b604-4b57-a7f1-55d3d1a7d9b1 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:06.335398 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:06.361439 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c2061-326c-424f-826b-ca70559872bc None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:06.396005 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 212/425] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:58:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 03:58:06.398026 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fe2ef-5c73-4673-b178-2308601fed5f None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:06.398599 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fe2ef-5c73-4673-b178-2308601fed5f None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:06.399099 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fe2ef-5c73-4673-b178-2308601fed5f None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:06.400875 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 213/426] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:06.401840 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2fe2ef-5c73-4673-b178-2308601fed5f None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:06.402750 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99bd4d-bf48-4c97-8b45-c3808fff246d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:06.403619 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99bd4d-bf48-4c97-8b45-c3808fff246d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:06.403905 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99bd4d-bf48-4c97-8b45-c3808fff246d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:06.404184 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99bd4d-bf48-4c97-8b45-c3808fff246d None admin] PATH_INFO: `/v3/projects/f5159196cf6c47c79e3bf91601a42a40` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:06.405471 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99bd4d-bf48-4c97-8b45-c3808fff246d None admin] RBAC: Authorizing `identity:get_project(project_id=f5159196cf6c47c79e3bf91601a42a40)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:06.407229 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99bd4d-bf48-4c97-8b45-c3808fff246d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:06.409070 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 214/427] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:58:06 2022] GET /identity/v3/projects/f5159196cf6c47c79e3bf91601a42a40 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:58:06.410198 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74002026-53dc-4870-bab4-fac963576dee None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:06.410470 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74002026-53dc-4870-bab4-fac963576dee None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:06.410752 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74002026-53dc-4870-bab4-fac963576dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:06.428381 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-74002026-53dc-4870-bab4-fac963576dee None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:06.429702 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-74002026-53dc-4870-bab4-fac963576dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:06.485924 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:06.503896 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 215/428] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:58:06.504983 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74002026-53dc-4870-bab4-fac963576dee None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:06.511650 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2fe2ef-5c73-4673-b178-2308601fed5f None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:06.551945 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc3e9a-0dfc-41f5-af3d-da3f28211b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:06.553572 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc3e9a-0dfc-41f5-af3d-da3f28211b52 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:06.554066 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc3e9a-0dfc-41f5-af3d-da3f28211b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:06.554646 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc3e9a-0dfc-41f5-af3d-da3f28211b52 None admin] PATH_INFO: `/v3/projects/f5159196cf6c47c79e3bf91601a42a40` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:06.556365 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc3e9a-0dfc-41f5-af3d-da3f28211b52 None admin] RBAC: Authorizing `identity:get_project(project_id=f5159196cf6c47c79e3bf91601a42a40)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:06.558327 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc3e9a-0dfc-41f5-af3d-da3f28211b52 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:06.560603 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 214/429] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:58:06 2022] GET /identity/v3/projects/f5159196cf6c47c79e3bf91601a42a40 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:06.561669 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc3e9a-0dfc-41f5-af3d-da3f28211b52 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:06.588618 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:06.617303 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74002026-53dc-4870-bab4-fac963576dee None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:06.652072 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a398f615-8744-47d1-9e13-6d0c04bae7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:06.652948 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398f615-8744-47d1-9e13-6d0c04bae7e4 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:06.653239 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398f615-8744-47d1-9e13-6d0c04bae7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:06.653518 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a398f615-8744-47d1-9e13-6d0c04bae7e4 None admin] PATH_INFO: `/v3/groups/6baf459f92a34fd18e9e3800c50eeb9d` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:06.654738 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a398f615-8744-47d1-9e13-6d0c04bae7e4 None admin] RBAC: Authorizing `identity:get_group(group_id=6baf459f92a34fd18e9e3800c50eeb9d)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:06.656264 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a398f615-8744-47d1-9e13-6d0c04bae7e4 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:06.658314 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 216/430] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Jul 4 03:58:06 2022] GET /identity/v3/groups/6baf459f92a34fd18e9e3800c50eeb9d => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:06.659151 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a398f615-8744-47d1-9e13-6d0c04bae7e4 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:06.682550 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc3e9a-0dfc-41f5-af3d-da3f28211b52 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:06.719507 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeff64f-fd0b-48d1-b5a7-b2bda7929632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:06.720620 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeff64f-fd0b-48d1-b5a7-b2bda7929632 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:06.721208 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeff64f-fd0b-48d1-b5a7-b2bda7929632 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:06.721505 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeff64f-fd0b-48d1-b5a7-b2bda7929632 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:06.736238 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeff64f-fd0b-48d1-b5a7-b2bda7929632 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:58:06.746328 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-8aeff64f-fd0b-48d1-b5a7-b2bda7929632 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 04 03:58:06.746328 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:06.746328 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:06.746328 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:06.746328 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:06.746328 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:06.746328 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:06.746328 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:06.746328 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:06.746328 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:06.746328 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:06.746328 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:06.746328 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:58:06.746328 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:58:06.746328 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:58:06.746328 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:58:06.747228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:58:06.747228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:58:06.747228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:58:06.747228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:58:06.747228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:06.747228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:06.747228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:06.747228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:06.747228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:06.747228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:06.747228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:06.747228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:06.747228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:06.747228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:06.747228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:06.747228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:06.748037 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:06.748037 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:06.748037 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:06.748037 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:06.748037 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:58:06.748037 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:58:06.748037 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:58:06.748037 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:58:06.748037 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:58:06.748037 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:58:06.748037 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 04 03:58:06.748037 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:06.748639 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 215/431] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:58:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:06.749189 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeff64f-fd0b-48d1-b5a7-b2bda7929632 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:06.762580 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:06.781137 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a398f615-8744-47d1-9e13-6d0c04bae7e4 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:06.816683 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18fda9-77be-4b91-9d68-3a00282aecfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:06.817560 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18fda9-77be-4b91-9d68-3a00282aecfe None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:06.817848 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18fda9-77be-4b91-9d68-3a00282aecfe None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:06.818127 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18fda9-77be-4b91-9d68-3a00282aecfe None admin] PATH_INFO: `/v3/groups/6baf459f92a34fd18e9e3800c50eeb9d` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:06.819367 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e18fda9-77be-4b91-9d68-3a00282aecfe None admin] RBAC: Authorizing `identity:get_group(group_id=6baf459f92a34fd18e9e3800c50eeb9d)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:06.821083 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e18fda9-77be-4b91-9d68-3a00282aecfe None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:06.826398 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 217/432] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Jul 4 03:58:06 2022] GET /identity/v3/groups/6baf459f92a34fd18e9e3800c50eeb9d => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:06.827224 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18fda9-77be-4b91-9d68-3a00282aecfe None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:06.841348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:06.882448 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeff64f-fd0b-48d1-b5a7-b2bda7929632 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:06.923560 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ab23f-ee5e-47e0-a338-c3dd0a1a8c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:06.924219 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ab23f-ee5e-47e0-a338-c3dd0a1a8c56 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:06.924507 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ab23f-ee5e-47e0-a338-c3dd0a1a8c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:06.924790 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ab23f-ee5e-47e0-a338-c3dd0a1a8c56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:06.925631 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ab23f-ee5e-47e0-a338-c3dd0a1a8c56 None admin] RBAC: Adding query filter params (group.id=6baf459f92a34fd18e9e3800c50eeb9d, role.id=8d92e2d53a9441a9b6ddaaad264ac4c9, scope.project.id=f5159196cf6c47c79e3bf91601a42a40) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:06.925967 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ab23f-ee5e-47e0-a338-c3dd0a1a8c56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:06.927518 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ab23f-ee5e-47e0-a338-c3dd0a1a8c56 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:06.939014 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 216/433] 10.222.0.49 () {56 vars in 1376 bytes} [Mon Jul 4 03:58:06 2022] GET /identity/v3/role_assignments?group.id=6baf459f92a34fd18e9e3800c50eeb9d&scope.project.id=f5159196cf6c47c79e3bf91601a42a40&role.id=8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 611 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:06.939014 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ab23f-ee5e-47e0-a338-c3dd0a1a8c56 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:06.968259 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18fda9-77be-4b91-9d68-3a00282aecfe None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:07.006957 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77515e8d-abe0-4284-adee-eb4aca134c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:07.007534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77515e8d-abe0-4284-adee-eb4aca134c3e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:07.007906 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77515e8d-abe0-4284-adee-eb4aca134c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:07.008178 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77515e8d-abe0-4284-adee-eb4aca134c3e None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:07.008948 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77515e8d-abe0-4284-adee-eb4aca134c3e None admin] RBAC: Adding query filter params (name=member) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:07.009262 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77515e8d-abe0-4284-adee-eb4aca134c3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:07.010743 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77515e8d-abe0-4284-adee-eb4aca134c3e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:07.020773 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 218/434] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Jul 4 03:58:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:07.026352 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77515e8d-abe0-4284-adee-eb4aca134c3e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:07.054459 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:07.091204 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ab23f-ee5e-47e0-a338-c3dd0a1a8c56 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:07.128668 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ec2a4-6fce-4d8e-9cfe-1ae20e46bf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:07.129344 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ec2a4-6fce-4d8e-9cfe-1ae20e46bf96 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:07.129635 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ec2a4-6fce-4d8e-9cfe-1ae20e46bf96 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:07.129916 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ec2a4-6fce-4d8e-9cfe-1ae20e46bf96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:07.130806 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ec2a4-6fce-4d8e-9cfe-1ae20e46bf96 None admin] RBAC: Adding query filter params (group.id=6baf459f92a34fd18e9e3800c50eeb9d, role.id=a34eb11c5d95402e94c1bc45e635e387, scope.project.id=f5159196cf6c47c79e3bf91601a42a40) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:07.131126 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ec2a4-6fce-4d8e-9cfe-1ae20e46bf96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:07.132833 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ec2a4-6fce-4d8e-9cfe-1ae20e46bf96 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:07.140393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 217/435] 10.222.0.49 () {56 vars in 1376 bytes} [Mon Jul 4 03:58:06 2022] GET /identity/v3/role_assignments?group.id=6baf459f92a34fd18e9e3800c50eeb9d&scope.project.id=f5159196cf6c47c79e3bf91601a42a40&role.id=a34eb11c5d95402e94c1bc45e635e387 => generated 611 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:07.188335 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:07.224652 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77515e8d-abe0-4284-adee-eb4aca134c3e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:07.263197 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ca33d-f4fb-43de-8a59-8ef754ad6d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:07.263787 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ca33d-f4fb-43de-8a59-8ef754ad6d5a None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:07.264077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ca33d-f4fb-43de-8a59-8ef754ad6d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:07.264359 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ca33d-f4fb-43de-8a59-8ef754ad6d5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:07.340821 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ca33d-f4fb-43de-8a59-8ef754ad6d5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:07.342362 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ca33d-f4fb-43de-8a59-8ef754ad6d5a None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:07.363875 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dcd84d-1ab1-417d-bf53-f78839ecaf90 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:07.364169 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dcd84d-1ab1-417d-bf53-f78839ecaf90 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:07.364436 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dcd84d-1ab1-417d-bf53-f78839ecaf90 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:07.365963 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 218/436] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 03:58:07.372253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0b082-01f7-4033-ae36-08d7f2b4fad0 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:07.372548 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0b082-01f7-4033-ae36-08d7f2b4fad0 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:07.372831 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0b082-01f7-4033-ae36-08d7f2b4fad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:07.394021 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-cfb0b082-01f7-4033-ae36-08d7f2b4fad0 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:07.395401 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-cfb0b082-01f7-4033-ae36-08d7f2b4fad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:07.423254 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:07.462359 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 219/437] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:58:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 03:58:07.466962 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ca33d-f4fb-43de-8a59-8ef754ad6d5a None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:07.498177 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 219/438] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 03:58:07.519614 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0b082-01f7-4033-ae36-08d7f2b4fad0 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:07.592157 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ca33d-f4fb-43de-8a59-8ef754ad6d5a None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:07.602783 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:07.630431 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27fd1a5-0d4e-4a6c-b625-55f0fd998478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:07.631501 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fd1a5-0d4e-4a6c-b625-55f0fd998478 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:07.631616 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fd1a5-0d4e-4a6c-b625-55f0fd998478 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:07.631872 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fd1a5-0d4e-4a6c-b625-55f0fd998478 None admin] PATH_INFO: `/v3/projects/f5bcfb30168d4753a6b0048a7935c78f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:07.633116 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27fd1a5-0d4e-4a6c-b625-55f0fd998478 None admin] RBAC: Authorizing `identity:get_project(project_id=f5bcfb30168d4753a6b0048a7935c78f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:07.634634 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27fd1a5-0d4e-4a6c-b625-55f0fd998478 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:07.636729 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 220/439] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:58:07 2022] GET /identity/v3/projects/f5bcfb30168d4753a6b0048a7935c78f => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:58:07.637935 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65af53d-5397-4e14-bc4f-728f25721557 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:07.638254 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65af53d-5397-4e14-bc4f-728f25721557 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:07.638529 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65af53d-5397-4e14-bc4f-728f25721557 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:07.639768 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 221/440] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:07.647502 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb2927-19c1-4b34-9611-764fe800aa52 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:07.647790 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb2927-19c1-4b34-9611-764fe800aa52 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:07.648066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb2927-19c1-4b34-9611-764fe800aa52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:07.650614 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0b082-01f7-4033-ae36-08d7f2b4fad0 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:07.666031 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-96eb2927-19c1-4b34-9611-764fe800aa52 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:07.667442 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-96eb2927-19c1-4b34-9611-764fe800aa52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:07.691836 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44384be9-e51e-487d-850a-32d330d82402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:07.692663 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44384be9-e51e-487d-850a-32d330d82402 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:07.692953 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44384be9-e51e-487d-850a-32d330d82402 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:07.693236 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44384be9-e51e-487d-850a-32d330d82402 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:07.706321 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44384be9-e51e-487d-850a-32d330d82402 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:58:07.707635 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:07.715173 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-44384be9-e51e-487d-850a-32d330d82402 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 03:58:07.715173 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:07.715173 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:07.715173 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:07.715173 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:07.715173 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:07.715173 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:07.715173 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:07.715173 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:07.715173 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:07.715173 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:07.715173 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:07.715173 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:58:07.715173 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:58:07.715173 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:58:07.715173 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:58:07.716089 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:58:07.716089 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:58:07.716089 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:58:07.716089 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:58:07.716089 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:07.716089 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:07.716089 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:07.716089 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:07.716089 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:07.716089 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:07.716089 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:07.716089 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:07.716089 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:07.716089 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:07.716089 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:07.716089 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:07.716886 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:07.716886 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:07.716886 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:07.716886 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:07.716886 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:58:07.716886 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:58:07.716886 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:58:07.716886 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:58:07.716886 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:58:07.716886 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:58:07.716886 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 03:58:07.716886 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:07.716886 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 220/441] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Jul 4 03:58:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:58:07.717581 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44384be9-e51e-487d-850a-32d330d82402 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:07.752914 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 222/442] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 03:58:07.754202 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb2927-19c1-4b34-9611-764fe800aa52 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:07.837363 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44384be9-e51e-487d-850a-32d330d82402 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:07.859437 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:07.864924 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb2927-19c1-4b34-9611-764fe800aa52 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:07.870308 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84060d-f5be-4bdd-baf1-a1f10cd88a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:07.871175 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84060d-f5be-4bdd-baf1-a1f10cd88a36 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:07.871459 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84060d-f5be-4bdd-baf1-a1f10cd88a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:07.871736 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84060d-f5be-4bdd-baf1-a1f10cd88a36 None admin] PATH_INFO: `/v3/groups/6baf459f92a34fd18e9e3800c50eeb9d` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:07.872913 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab84060d-f5be-4bdd-baf1-a1f10cd88a36 None admin] RBAC: Authorizing `identity:get_group(group_id=6baf459f92a34fd18e9e3800c50eeb9d)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:07.874402 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab84060d-f5be-4bdd-baf1-a1f10cd88a36 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:07.880839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 221/443] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Jul 4 03:58:07 2022] GET /identity/v3/groups/6baf459f92a34fd18e9e3800c50eeb9d => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:07.880839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84060d-f5be-4bdd-baf1-a1f10cd88a36 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:07.900555 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd064a85-a291-4851-b98d-45effd417057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:07.901235 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd064a85-a291-4851-b98d-45effd417057 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:07.901519 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd064a85-a291-4851-b98d-45effd417057 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:07.901797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd064a85-a291-4851-b98d-45effd417057 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:07.902593 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd064a85-a291-4851-b98d-45effd417057 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:07.902907 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd064a85-a291-4851-b98d-45effd417057 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:07.904322 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd064a85-a291-4851-b98d-45effd417057 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:07.912627 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 223/444] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:58:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:07.913455 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd064a85-a291-4851-b98d-45effd417057 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:07.944627 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:07.987440 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84060d-f5be-4bdd-baf1-a1f10cd88a36 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:08.013422 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd064a85-a291-4851-b98d-45effd417057 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:08.021248 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a4ec6-38c5-4634-9a59-dec9ac005ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:08.022042 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a4ec6-38c5-4634-9a59-dec9ac005ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:08.022370 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a4ec6-38c5-4634-9a59-dec9ac005ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:08.022677 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a4ec6-38c5-4634-9a59-dec9ac005ea3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:08.033603 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7a4ec6-38c5-4634-9a59-dec9ac005ea3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:58:08.041239 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-fa7a4ec6-38c5-4634-9a59-dec9ac005ea3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:58:08.041239 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:08.041239 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:08.041239 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:08.041239 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:08.041239 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:08.041239 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:08.041239 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:08.041239 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:08.041239 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:08.041239 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:08.041239 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:08.041239 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:58:08.041239 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:58:08.041239 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:58:08.041239 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:58:08.042340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:58:08.042340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:58:08.042340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:58:08.042340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:58:08.042340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:08.042340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:08.042340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:08.042340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:08.042340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:08.042340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:08.042340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:08.042340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:08.042340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:08.042340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:08.042340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:08.042340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:08.043161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:08.043161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:08.043161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:08.043161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:08.043161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:58:08.043161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:58:08.043161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:58:08.043161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:58:08.043161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:58:08.043161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:58:08.043161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:58:08.043161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:08.043161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 222/445] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Jul 4 03:58:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:08.043818 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a4ec6-38c5-4634-9a59-dec9ac005ea3 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:08.049286 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d0bea-dbc5-4113-aeda-594060642394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:08.049956 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d0bea-dbc5-4113-aeda-594060642394 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:08.050267 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d0bea-dbc5-4113-aeda-594060642394 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:08.050546 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d0bea-dbc5-4113-aeda-594060642394 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:08.051415 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d0bea-dbc5-4113-aeda-594060642394 None admin] RBAC: Adding query filter params (group.id=6baf459f92a34fd18e9e3800c50eeb9d, role.id=8d92e2d53a9441a9b6ddaaad264ac4c9, scope.project.id=f5bcfb30168d4753a6b0048a7935c78f) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:08.051729 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d0bea-dbc5-4113-aeda-594060642394 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:08.053196 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d0bea-dbc5-4113-aeda-594060642394 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:08.059182 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 224/446] 10.222.0.49 () {56 vars in 1376 bytes} [Mon Jul 4 03:58:07 2022] GET /identity/v3/role_assignments?group.id=6baf459f92a34fd18e9e3800c50eeb9d&scope.project.id=f5bcfb30168d4753a6b0048a7935c78f&role.id=8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:08.059949 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d0bea-dbc5-4113-aeda-594060642394 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:08.104823 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:08.160985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a4ec6-38c5-4634-9a59-dec9ac005ea3 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:08.168286 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:08.175810 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d0bea-dbc5-4113-aeda-594060642394 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:08.206706 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e6606-e6ac-42f5-9c52-b0156a24d51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:08.207809 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e6606-e6ac-42f5-9c52-b0156a24d51d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:08.208116 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e6606-e6ac-42f5-9c52-b0156a24d51d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:08.208544 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e6606-e6ac-42f5-9c52-b0156a24d51d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:08.212374 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372e78a-d926-408e-a55b-6536bd44741e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:08.213402 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372e78a-d926-408e-a55b-6536bd44741e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:08.213402 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372e78a-d926-408e-a55b-6536bd44741e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:08.213591 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372e78a-d926-408e-a55b-6536bd44741e None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:08.214394 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372e78a-d926-408e-a55b-6536bd44741e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:08.214708 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372e78a-d926-408e-a55b-6536bd44741e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:08.216128 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372e78a-d926-408e-a55b-6536bd44741e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:08.224682 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 225/447] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:58:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:08.231121 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372e78a-d926-408e-a55b-6536bd44741e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:08.292073 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e6606-e6ac-42f5-9c52-b0156a24d51d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:08.293495 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e6606-e6ac-42f5-9c52-b0156a24d51d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:08.356760 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372e78a-d926-408e-a55b-6536bd44741e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:08.360074 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:08.396447 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd8c38-122f-4434-a3fe-a0e2af7f291c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:08.397103 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd8c38-122f-4434-a3fe-a0e2af7f291c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:08.397389 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd8c38-122f-4434-a3fe-a0e2af7f291c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:08.397676 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd8c38-122f-4434-a3fe-a0e2af7f291c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:08.419773 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 223/448] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:58:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 03:58:08.425280 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e6606-e6ac-42f5-9c52-b0156a24d51d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:08.425393 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:08.466567 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd8c38-122f-4434-a3fe-a0e2af7f291c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:08.468055 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd8c38-122f-4434-a3fe-a0e2af7f291c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:08.522328 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e6606-e6ac-42f5-9c52-b0156a24d51d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:08.556652 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6d615-3e26-4eee-aedb-b6c279ba9d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:08.557516 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6d615-3e26-4eee-aedb-b6c279ba9d1a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:08.557782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6d615-3e26-4eee-aedb-b6c279ba9d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:08.558073 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6d615-3e26-4eee-aedb-b6c279ba9d1a None admin] PATH_INFO: `/v3/projects/f5bcfb30168d4753a6b0048a7935c78f` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:08.559310 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f6d615-3e26-4eee-aedb-b6c279ba9d1a None admin] RBAC: Authorizing `identity:get_project(project_id=f5bcfb30168d4753a6b0048a7935c78f)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:08.560775 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f6d615-3e26-4eee-aedb-b6c279ba9d1a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:08.562510 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 224/449] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:58:08 2022] GET /identity/v3/projects/f5bcfb30168d4753a6b0048a7935c78f => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:58:08.565311 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 226/450] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:58:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 03:58:08.567902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6d615-3e26-4eee-aedb-b6c279ba9d1a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:08.570614 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd8c38-122f-4434-a3fe-a0e2af7f291c None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:08.588458 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:08.628315 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:08.663682 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6d615-3e26-4eee-aedb-b6c279ba9d1a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:08.671177 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd8c38-122f-4434-a3fe-a0e2af7f291c None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:08.697260 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1de759-66ce-4bb9-908d-28cd30824b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:08.698147 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1de759-66ce-4bb9-908d-28cd30824b88 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:08.698463 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1de759-66ce-4bb9-908d-28cd30824b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:08.698751 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1de759-66ce-4bb9-908d-28cd30824b88 None admin] PATH_INFO: `/v3/groups/6baf459f92a34fd18e9e3800c50eeb9d` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:08.699954 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1de759-66ce-4bb9-908d-28cd30824b88 None admin] RBAC: Authorizing `identity:get_group(group_id=6baf459f92a34fd18e9e3800c50eeb9d)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:08.701401 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1de759-66ce-4bb9-908d-28cd30824b88 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:08.703057 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 225/451] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Jul 4 03:58:08 2022] GET /identity/v3/groups/6baf459f92a34fd18e9e3800c50eeb9d => generated 226 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:08.704348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c1f44-d609-4657-ab31-6278325a198c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:08.705218 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c1f44-d609-4657-ab31-6278325a198c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:08.705497 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c1f44-d609-4657-ab31-6278325a198c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:08.705774 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c1f44-d609-4657-ab31-6278325a198c None admin] PATH_INFO: `/v3/projects/a178190dbd1b4a75a7550013812afce1` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:08.706997 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c1f44-d609-4657-ab31-6278325a198c None admin] RBAC: Authorizing `identity:get_project(project_id=a178190dbd1b4a75a7550013812afce1)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:08.708487 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c1f44-d609-4657-ab31-6278325a198c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:08.709093 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1de759-66ce-4bb9-908d-28cd30824b88 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:08.710200 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 227/452] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:58:08 2022] GET /identity/v3/projects/a178190dbd1b4a75a7550013812afce1 => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:08.715384 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c1f44-d609-4657-ab31-6278325a198c None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:08.798489 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:08.810591 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1de759-66ce-4bb9-908d-28cd30824b88 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:08.814852 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c1f44-d609-4657-ab31-6278325a198c None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:08.842011 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:08.844600 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123ab7c-ec58-4380-abab-7d18df03d0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:08.845259 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123ab7c-ec58-4380-abab-7d18df03d0cc None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:08.845545 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123ab7c-ec58-4380-abab-7d18df03d0cc None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:08.845828 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123ab7c-ec58-4380-abab-7d18df03d0cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:08.846955 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0123ab7c-ec58-4380-abab-7d18df03d0cc None admin] RBAC: Adding query filter params (group.id=6baf459f92a34fd18e9e3800c50eeb9d, role.id=a34eb11c5d95402e94c1bc45e635e387, scope.project.id=f5bcfb30168d4753a6b0048a7935c78f) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:08.847067 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0123ab7c-ec58-4380-abab-7d18df03d0cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:08.848450 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0123ab7c-ec58-4380-abab-7d18df03d0cc None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:08.851635 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c99117-80d3-4ac9-a2a8-6d67f4ccfb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:08.852512 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c99117-80d3-4ac9-a2a8-6d67f4ccfb5a None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:08.852799 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c99117-80d3-4ac9-a2a8-6d67f4ccfb5a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:08.853079 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c99117-80d3-4ac9-a2a8-6d67f4ccfb5a None admin] PATH_INFO: `/v3/groups/36c04050dfd044cdbde09d6c1849cd5f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:08.854313 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c99117-80d3-4ac9-a2a8-6d67f4ccfb5a None admin] RBAC: Authorizing `identity:get_group(group_id=36c04050dfd044cdbde09d6c1849cd5f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:08.854585 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 226/453] 10.222.0.49 () {56 vars in 1376 bytes} [Mon Jul 4 03:58:08 2022] GET /identity/v3/role_assignments?group.id=6baf459f92a34fd18e9e3800c50eeb9d&scope.project.id=f5bcfb30168d4753a6b0048a7935c78f&role.id=a34eb11c5d95402e94c1bc45e635e387 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:58:08.855785 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c99117-80d3-4ac9-a2a8-6d67f4ccfb5a None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:08.861919 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 228/454] 10.222.0.49 () {56 vars in 1180 bytes} [Mon Jul 4 03:58:08 2022] GET /identity/v3/groups/36c04050dfd044cdbde09d6c1849cd5f => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:08.863389 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123ab7c-ec58-4380-abab-7d18df03d0cc None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:08.976252 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123ab7c-ec58-4380-abab-7d18df03d0cc None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:09.014450 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0162c-a302-41a1-903d-bf16434de709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:09.015368 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0162c-a302-41a1-903d-bf16434de709 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:09.015368 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0162c-a302-41a1-903d-bf16434de709 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:09.015658 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0162c-a302-41a1-903d-bf16434de709 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:09.016501 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0162c-a302-41a1-903d-bf16434de709 None admin] RBAC: Adding query filter params (group.id=36c04050dfd044cdbde09d6c1849cd5f, role.id=2eee98054d42475bb7e22a8487ab235e, scope.project.id=a178190dbd1b4a75a7550013812afce1) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:09.016827 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0162c-a302-41a1-903d-bf16434de709 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:09.018322 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0162c-a302-41a1-903d-bf16434de709 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:09.024780 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 227/455] 10.222.0.49 () {56 vars in 1376 bytes} [Mon Jul 4 03:58:08 2022] GET /identity/v3/role_assignments?group.id=36c04050dfd044cdbde09d6c1849cd5f&scope.project.id=a178190dbd1b4a75a7550013812afce1&role.id=2eee98054d42475bb7e22a8487ab235e => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:11.537107 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d1ec2-70ad-48cb-a1fd-f727f21f6a97 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:11.537661 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d1ec2-70ad-48cb-a1fd-f727f21f6a97 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:11.537661 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d1ec2-70ad-48cb-a1fd-f727f21f6a97 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:11.539502 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 229/456] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:11.544685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8095b-3229-45eb-b033-39e6a5d57de5 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:11.545117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8095b-3229-45eb-b033-39e6a5d57de5 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:11.545287 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8095b-3229-45eb-b033-39e6a5d57de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:11.571182 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-e3a8095b-3229-45eb-b033-39e6a5d57de5 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:11.572403 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e3a8095b-3229-45eb-b033-39e6a5d57de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:11.584184 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:11.668951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 228/457] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:58:11.707121 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d1ec2-70ad-48cb-a1fd-f727f21f6a97 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:11.730545 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd099dbb-753d-4fcd-9fdd-9999d3366b70 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:11.730872 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd099dbb-753d-4fcd-9fdd-9999d3366b70 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:11.731120 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd099dbb-753d-4fcd-9fdd-9999d3366b70 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:11.732513 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 229/458] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 03:58:11.737716 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2964e5-0a77-460c-abb1-497475ae4372 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:11.738012 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2964e5-0a77-460c-abb1-497475ae4372 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:11.738362 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2964e5-0a77-460c-abb1-497475ae4372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:11.763262 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-3a2964e5-0a77-460c-abb1-497475ae4372 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:11.764843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3a2964e5-0a77-460c-abb1-497475ae4372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:11.860345 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 230/459] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 03:58:11.860508 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d1ec2-70ad-48cb-a1fd-f727f21f6a97 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:11.862112 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc123bb0-ccb9-4ddf-9b59-12d7b541153a None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:11.862636 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc123bb0-ccb9-4ddf-9b59-12d7b541153a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:11.863115 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc123bb0-ccb9-4ddf-9b59-12d7b541153a None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:11.864591 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 231/460] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:11.875988 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f1a0c-0cc4-4b5c-8734-5d8078a2869b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:11.876633 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f1a0c-0cc4-4b5c-8734-5d8078a2869b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:11.877124 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f1a0c-0cc4-4b5c-8734-5d8078a2869b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:11.910241 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-803f1a0c-0cc4-4b5c-8734-5d8078a2869b None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:11.912647 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-803f1a0c-0cc4-4b5c-8734-5d8078a2869b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:11.937348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06698ef4-6d08-4e5b-b0a1-d4c6cfece649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:11.938446 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06698ef4-6d08-4e5b-b0a1-d4c6cfece649 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:11.938575 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06698ef4-6d08-4e5b-b0a1-d4c6cfece649 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:11.938991 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06698ef4-6d08-4e5b-b0a1-d4c6cfece649 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:11.950689 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06698ef4-6d08-4e5b-b0a1-d4c6cfece649 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:11.952366 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06698ef4-6d08-4e5b-b0a1-d4c6cfece649 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:11.976778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-06698ef4-6d08-4e5b-b0a1-d4c6cfece649 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:11.976778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:11.976778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:11.976778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:11.976778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:11.976778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:11.976778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:11.976778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:11.976778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:11.976778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:11.976778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:11.976778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:11.976778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:11.976778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:11.976778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:11.977642 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:11.977642 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:11.977642 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:11.977642 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:11.977642 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:11.977642 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:11.977642 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:11.977642 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:11.977642 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:11.977642 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:11.977642 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:11.977642 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:11.977642 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:11.977642 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:11.977642 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:11.977642 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:11.977642 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:11.978541 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:11.978541 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:11.978541 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:11.978541 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:11.978541 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 230/461] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:11.979284 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06698ef4-6d08-4e5b-b0a1-d4c6cfece649 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:12.009518 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 232/462] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 03:58:12.010840 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f1a0c-0cc4-4b5c-8734-5d8078a2869b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:12.020005 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:12.052015 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:12.111704 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06698ef4-6d08-4e5b-b0a1-d4c6cfece649 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:12.137660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f1a0c-0cc4-4b5c-8734-5d8078a2869b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:12.147548 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec9181-cf15-45a9-af33-69f193a3a92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:12.148446 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec9181-cf15-45a9-af33-69f193a3a92f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:12.148731 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec9181-cf15-45a9-af33-69f193a3a92f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:12.149007 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec9181-cf15-45a9-af33-69f193a3a92f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:12.159702 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec9181-cf15-45a9-af33-69f193a3a92f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:12.161196 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec9181-cf15-45a9-af33-69f193a3a92f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:12.174884 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849adaba-9925-4b5b-8f54-98bbfdc3f970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:12.175885 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849adaba-9925-4b5b-8f54-98bbfdc3f970 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:12.176372 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849adaba-9925-4b5b-8f54-98bbfdc3f970 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:12.176849 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849adaba-9925-4b5b-8f54-98bbfdc3f970 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:12.177780 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849adaba-9925-4b5b-8f54-98bbfdc3f970 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:12.178326 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849adaba-9925-4b5b-8f54-98bbfdc3f970 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:12.179125 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-c8ec9181-cf15-45a9-af33-69f193a3a92f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:12.179125 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:12.179125 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:12.179125 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:12.179125 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:12.179125 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:12.179125 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:12.179125 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:12.179125 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:12.179125 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:12.179125 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:12.179125 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:12.179125 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:12.179125 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:12.179125 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:12.179991 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:12.179991 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:12.179991 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:12.179991 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:12.179991 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:12.179991 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:12.179991 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:12.179991 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:12.179991 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:12.179991 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:12.179991 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:12.179991 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:12.179991 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:12.179991 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:12.179991 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:12.179991 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:12.179991 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:12.180883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:12.180883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:12.180883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:12.180883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:12.182425 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849adaba-9925-4b5b-8f54-98bbfdc3f970 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:12.185246 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 231/463] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:12.186095 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec9181-cf15-45a9-af33-69f193a3a92f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:12.202048 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 233/464] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:12.203207 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849adaba-9925-4b5b-8f54-98bbfdc3f970 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:12.273171 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:12.288313 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:12.292883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec9181-cf15-45a9-af33-69f193a3a92f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:12.310945 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849adaba-9925-4b5b-8f54-98bbfdc3f970 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:12.330605 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9fb14e-3201-4ff0-ab03-edc4d0d2cbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:12.331422 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fb14e-3201-4ff0-ab03-edc4d0d2cbec None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:12.331705 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fb14e-3201-4ff0-ab03-edc4d0d2cbec None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:12.331986 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fb14e-3201-4ff0-ab03-edc4d0d2cbec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:12.342993 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9fb14e-3201-4ff0-ab03-edc4d0d2cbec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:12.344585 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9fb14e-3201-4ff0-ab03-edc4d0d2cbec None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:12.347787 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94907058-7a92-46b6-865c-b74bcacb4e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:12.348513 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94907058-7a92-46b6-865c-b74bcacb4e8f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:12.348846 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94907058-7a92-46b6-865c-b74bcacb4e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:12.349131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94907058-7a92-46b6-865c-b74bcacb4e8f None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:12.349960 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94907058-7a92-46b6-865c-b74bcacb4e8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:12.350318 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94907058-7a92-46b6-865c-b74bcacb4e8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:12.352116 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94907058-7a92-46b6-865c-b74bcacb4e8f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:12.368617 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 234/465] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:12.368617 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94907058-7a92-46b6-865c-b74bcacb4e8f None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:12.374942 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-0a9fb14e-3201-4ff0-ab03-edc4d0d2cbec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:12.374942 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:12.374942 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:12.374942 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:12.374942 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:12.374942 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:12.374942 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:12.374942 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:12.374942 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:12.374942 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:12.374942 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:12.374942 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:12.374942 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:12.374942 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:12.374942 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:12.375797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:12.375797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:12.375797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:12.375797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:12.375797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:12.375797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:12.375797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:12.375797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:12.375797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:12.375797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:12.375797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:12.375797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:12.375797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:12.375797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:12.375797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:12.375797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:12.375797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:12.376662 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:12.376662 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:12.376662 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:12.376662 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:12.376870 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 232/466] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:12.378131 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1e6ea-7c92-443a-a262-79bcb8ccd1ca None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:12.378624 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1e6ea-7c92-443a-a262-79bcb8ccd1ca None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:12.379299 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1e6ea-7c92-443a-a262-79bcb8ccd1ca None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:12.385998 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 233/467] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:12.387133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c1e6ea-7c92-443a-a262-79bcb8ccd1ca None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:12.476227 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94907058-7a92-46b6-865c-b74bcacb4e8f None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:12.513326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c1e6ea-7c92-443a-a262-79bcb8ccd1ca None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:12.519664 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:12.535424 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea17f5-c57f-44f7-9918-37f6931c38b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:12.536105 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea17f5-c57f-44f7-9918-37f6931c38b6 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:12.536393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea17f5-c57f-44f7-9918-37f6931c38b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:12.536673 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea17f5-c57f-44f7-9918-37f6931c38b6 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:12.537393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea17f5-c57f-44f7-9918-37f6931c38b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:12.538977 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea17f5-c57f-44f7-9918-37f6931c38b6 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:12.558534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d114a-9952-41a7-8129-a0311bc73e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:12.559288 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d114a-9952-41a7-8129-a0311bc73e34 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:12.559611 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d114a-9952-41a7-8129-a0311bc73e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:12.559877 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d114a-9952-41a7-8129-a0311bc73e34 None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:12.560636 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d114a-9952-41a7-8129-a0311bc73e34 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:12.562535 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d114a-9952-41a7-8129-a0311bc73e34 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:12.567520 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 235/468] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Jul 4 03:58:12 2022] POST /identity/v3/users => generated 248 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 03:58:12.579331 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea17f5-c57f-44f7-9918-37f6931c38b6 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:12.599971 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 234/469] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Jul 4 03:58:12 2022] POST /identity/v3/users => generated 246 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 03:58:12.601450 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e95d34-fca4-4820-ab5c-2f0586a01834 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:12.601800 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e95d34-fca4-4820-ab5c-2f0586a01834 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:12.602065 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e95d34-fca4-4820-ab5c-2f0586a01834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:12.621567 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:12.634428 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-d8e95d34-fca4-4820-ab5c-2f0586a01834 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:12.636819 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d8e95d34-fca4-4820-ab5c-2f0586a01834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:12.776575 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 235/470] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:58:12.810517 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e95d34-fca4-4820-ab5c-2f0586a01834 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:12.863379 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea17f5-c57f-44f7-9918-37f6931c38b6 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:12.914697 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f1de1-8a55-4454-834f-346af60f6521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:12.915381 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f1de1-8a55-4454-834f-346af60f6521 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:12.915670 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f1de1-8a55-4454-834f-346af60f6521 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:12.915947 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f1de1-8a55-4454-834f-346af60f6521 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:12.916697 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f1de1-8a55-4454-834f-346af60f6521 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:12.917002 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f1de1-8a55-4454-834f-346af60f6521 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:12.918512 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f1de1-8a55-4454-834f-346af60f6521 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:12.931391 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 236/471] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:12.932738 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93e4b0-0928-4ed8-91df-bd90de6a4894 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:12.933030 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93e4b0-0928-4ed8-91df-bd90de6a4894 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:12.933381 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93e4b0-0928-4ed8-91df-bd90de6a4894 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:12.936526 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 237/472] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:12.941732 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83fa29-285b-43c9-9b9e-b8dd351172d1 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:12.942029 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83fa29-285b-43c9-9b9e-b8dd351172d1 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:12.943680 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83fa29-285b-43c9-9b9e-b8dd351172d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:12.967273 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-fb83fa29-285b-43c9-9b9e-b8dd351172d1 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:12.968490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-fb83fa29-285b-43c9-9b9e-b8dd351172d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:12.990899 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e95d34-fca4-4820-ab5c-2f0586a01834 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:13.009385 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:13.049270 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 238/473] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:58:13.050170 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83fa29-285b-43c9-9b9e-b8dd351172d1 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:13.051728 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c3991-cf65-46f6-a1da-ba962b34a24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:13.052660 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c3991-cf65-46f6-a1da-ba962b34a24c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:13.052957 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c3991-cf65-46f6-a1da-ba962b34a24c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:13.053339 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c3991-cf65-46f6-a1da-ba962b34a24c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:13.057377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:13.074283 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c3991-cf65-46f6-a1da-ba962b34a24c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:13.076855 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c3991-cf65-46f6-a1da-ba962b34a24c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:13.110086 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-df8c3991-cf65-46f6-a1da-ba962b34a24c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:13.110086 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:13.110086 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:13.110086 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:13.110086 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:13.110086 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:13.110086 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:13.110086 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:13.110086 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:13.110086 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:13.110086 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:13.110086 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:13.110086 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:13.110086 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:13.110086 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:13.111058 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:13.111058 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:13.111058 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:13.111058 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:13.111058 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:13.111058 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:13.111058 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:13.111058 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:13.111058 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:13.111058 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:13.111058 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:13.111058 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:13.111058 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:13.111058 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:13.111058 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:13.111058 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:13.111058 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:13.111906 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:13.111906 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:13.111906 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:13.111906 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:13.111906 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 236/474] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:13.112174 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c3991-cf65-46f6-a1da-ba962b34a24c None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:13.168863 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83fa29-285b-43c9-9b9e-b8dd351172d1 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:13.203742 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6990378a-83cf-4699-a4f8-86c69eac1828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:13.204551 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990378a-83cf-4699-a4f8-86c69eac1828 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:13.204904 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990378a-83cf-4699-a4f8-86c69eac1828 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:13.205309 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990378a-83cf-4699-a4f8-86c69eac1828 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:13.206209 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6990378a-83cf-4699-a4f8-86c69eac1828 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:13.207741 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6990378a-83cf-4699-a4f8-86c69eac1828 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:13.222126 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c3991-cf65-46f6-a1da-ba962b34a24c None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:13.238305 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 239/475] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Jul 4 03:58:13 2022] POST /identity/v3/users => generated 248 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 03:58:13.239323 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6990378a-83cf-4699-a4f8-86c69eac1828 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:13.285785 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:13.286207 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8afb8-191b-4f9f-9e73-360d15207c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:13.287619 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8afb8-191b-4f9f-9e73-360d15207c90 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:13.288459 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8afb8-191b-4f9f-9e73-360d15207c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:13.289027 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8afb8-191b-4f9f-9e73-360d15207c90 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:13.290085 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a8afb8-191b-4f9f-9e73-360d15207c90 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:13.302185 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a8afb8-191b-4f9f-9e73-360d15207c90 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:13.315860 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.sql.core [None req-55a8afb8-191b-4f9f-9e73-360d15207c90 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 04 03:58:13.315860 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 04 03:58:13.315860 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [parameters: {'id': 'a9742286c662456cb0a7cd2e1da023d7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 04 03:58:13.315860 dv-cinder-742162-5-smb devstack@keystone.service[80363]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80363) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 04 03:58:13.343191 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-55a8afb8-191b-4f9f-9e73-360d15207c90 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 04 03:58:13.343191 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:13.343191 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 04 03:58:13.343191 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 04 03:58:13.343191 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 04 03:58:13.343191 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 04 03:58:13.343191 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 04 03:58:13.343191 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application result = self._query(query) Jul 04 03:58:13.343191 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 04 03:58:13.343191 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application conn.query(q) Jul 04 03:58:13.343191 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 04 03:58:13.343191 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 04 03:58:13.343191 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 04 03:58:13.343191 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application result.read() Jul 04 03:58:13.343191 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 04 03:58:13.344153 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 04 03:58:13.344153 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 04 03:58:13.344153 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 04 03:58:13.344153 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 04 03:58:13.344153 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 04 03:58:13.344153 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 04 03:58:13.344153 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 04 03:58:13.344153 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 04 03:58:13.344153 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:13.344153 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 04 03:58:13.344153 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:13.344153 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:13.344153 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 04 03:58:13.344153 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 04 03:58:13.344153 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 04 03:58:13.344153 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return ref.to_dict() Jul 04 03:58:13.344153 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 04 03:58:13.344153 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application next(self.gen) Jul 04 03:58:13.345120 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 04 03:58:13.345120 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application yield resource Jul 04 03:58:13.345120 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 04 03:58:13.345120 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application next(self.gen) Jul 04 03:58:13.345120 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 04 03:58:13.345120 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self.session.rollback() Jul 04 03:58:13.345120 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 04 03:58:13.345120 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self.force_reraise() Jul 04 03:58:13.345120 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 04 03:58:13.345120 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise self.value Jul 04 03:58:13.345120 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 04 03:58:13.345120 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 04 03:58:13.345120 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 04 03:58:13.345120 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application session.commit() Jul 04 03:58:13.345120 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 04 03:58:13.345120 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 04 03:58:13.345120 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 04 03:58:13.346001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._prepare_impl() Jul 04 03:58:13.346001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 04 03:58:13.346001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self.session.flush() Jul 04 03:58:13.346001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 04 03:58:13.346001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._flush(objects) Jul 04 03:58:13.346001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 04 03:58:13.346001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 04 03:58:13.346001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 04 03:58:13.346001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application compat.raise_( Jul 04 03:58:13.346001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 04 03:58:13.346001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception Jul 04 03:58:13.346001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 04 03:58:13.346001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application flush_context.execute() Jul 04 03:58:13.346001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 04 03:58:13.346001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rec.execute(self) Jul 04 03:58:13.346001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 04 03:58:13.346001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 04 03:58:13.351969 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 04 03:58:13.351969 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 04 03:58:13.351969 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 04 03:58:13.351969 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 04 03:58:13.351969 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 04 03:58:13.351969 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 04 03:58:13.351969 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 04 03:58:13.351969 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 04 03:58:13.351969 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 04 03:58:13.351969 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 04 03:58:13.351969 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 04 03:58:13.351969 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 04 03:58:13.351969 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 04 03:58:13.351969 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 04 03:58:13.351969 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 04 03:58:13.351969 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception Jul 04 03:58:13.352801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 04 03:58:13.352801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 04 03:58:13.352801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 04 03:58:13.352801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 04 03:58:13.352801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 04 03:58:13.352801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application result = self._query(query) Jul 04 03:58:13.352801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 04 03:58:13.352801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application conn.query(q) Jul 04 03:58:13.352801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 04 03:58:13.352801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 04 03:58:13.352801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 04 03:58:13.352801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application result.read() Jul 04 03:58:13.352801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 04 03:58:13.352801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 04 03:58:13.352801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 04 03:58:13.352801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 04 03:58:13.353591 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 04 03:58:13.353591 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 04 03:58:13.353591 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 04 03:58:13.353591 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 04 03:58:13.353591 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 04 03:58:13.353591 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 04 03:58:13.353591 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [parameters: {'id': 'a9742286c662456cb0a7cd2e1da023d7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 04 03:58:13.353591 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 04 03:58:13.353591 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:13.353591 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 03:58:13.353591 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:13.353591 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:13.353591 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:13.353591 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:13.353591 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:13.353591 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:13.355238 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:13.355238 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:13.355238 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:13.355238 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:13.355238 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:13.355238 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:13.355238 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 04 03:58:13.355238 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 04 03:58:13.355238 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:13.355238 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:13.355238 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 04 03:58:13.355238 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 04 03:58:13.355238 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 04 03:58:13.355238 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 04 03:58:13.355238 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 04 03:58:13.355238 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:13.357170 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 237/476] 10.222.0.49 () {60 vars in 1131 bytes} [Mon Jul 4 03:58:13 2022] POST /identity/v3/roles => generated 144 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:13.362051 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8afb8-191b-4f9f-9e73-360d15207c90 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:13.448870 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6990378a-83cf-4699-a4f8-86c69eac1828 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:13.456471 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:13.490254 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b3c22-c500-4226-88ae-29abca5d645f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:13.491305 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b3c22-c500-4226-88ae-29abca5d645f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:13.491846 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b3c22-c500-4226-88ae-29abca5d645f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:13.492411 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b3c22-c500-4226-88ae-29abca5d645f None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:13.493340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b3c22-c500-4226-88ae-29abca5d645f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:13.493895 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b3c22-c500-4226-88ae-29abca5d645f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:13.495699 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b3c22-c500-4226-88ae-29abca5d645f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:13.511096 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 240/477] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:13.515155 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8afb8-191b-4f9f-9e73-360d15207c90 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:13.517451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b3c22-c500-4226-88ae-29abca5d645f None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:13.549730 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56995509-11e1-4515-8fed-218b1c2c3660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:13.550647 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56995509-11e1-4515-8fed-218b1c2c3660 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:13.550936 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56995509-11e1-4515-8fed-218b1c2c3660 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:13.551260 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56995509-11e1-4515-8fed-218b1c2c3660 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:13.562292 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56995509-11e1-4515-8fed-218b1c2c3660 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:58:13.570302 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-56995509-11e1-4515-8fed-218b1c2c3660 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 03:58:13.570302 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:13.570302 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:13.570302 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:13.570302 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:13.570302 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:13.570302 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:13.570302 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:13.570302 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:13.570302 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:13.570302 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:13.570302 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:13.570302 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:58:13.570302 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:58:13.570302 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:58:13.570302 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:58:13.571208 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:58:13.571208 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:58:13.571208 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:58:13.571208 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:58:13.571208 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:13.571208 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:13.571208 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:13.571208 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:13.571208 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:13.571208 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:13.571208 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:13.571208 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:13.571208 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:13.571208 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:13.571208 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:13.571208 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:13.572009 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:13.572009 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:13.572009 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:13.572009 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:13.572009 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:58:13.572009 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:58:13.572009 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:58:13.572009 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:58:13.572009 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:58:13.572009 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:58:13.572009 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 04 03:58:13.572009 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:13.572009 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 238/478] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Jul 4 03:58:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:13.584568 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56995509-11e1-4515-8fed-218b1c2c3660 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:13.622142 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:13.635915 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b3c22-c500-4226-88ae-29abca5d645f None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:13.683392 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f9a930-89bf-4f60-99e6-f8907da33443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:13.684424 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9a930-89bf-4f60-99e6-f8907da33443 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:13.684909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9a930-89bf-4f60-99e6-f8907da33443 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:13.685412 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9a930-89bf-4f60-99e6-f8907da33443 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:13.686370 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f9a930-89bf-4f60-99e6-f8907da33443 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:13.690112 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f9a930-89bf-4f60-99e6-f8907da33443 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:13.738692 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 241/479] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Jul 4 03:58:13 2022] POST /identity/v3/users => generated 249 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 03:58:13.781192 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56995509-11e1-4515-8fed-218b1c2c3660 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:13.806181 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:13.836599 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05ef43-23f1-42f3-be4e-bcb66f4fd754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:13.837654 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05ef43-23f1-42f3-be4e-bcb66f4fd754 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:13.838140 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05ef43-23f1-42f3-be4e-bcb66f4fd754 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:13.838653 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05ef43-23f1-42f3-be4e-bcb66f4fd754 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:13.839669 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a05ef43-23f1-42f3-be4e-bcb66f4fd754 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:13.840326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a05ef43-23f1-42f3-be4e-bcb66f4fd754 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:13.841964 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a05ef43-23f1-42f3-be4e-bcb66f4fd754 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:13.857706 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 239/480] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:58:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:14.999062 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907142f1-4cfb-4782-b7c4-281a389d3ea1 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:14.999569 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907142f1-4cfb-4782-b7c4-281a389d3ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:14.999643 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907142f1-4cfb-4782-b7c4-281a389d3ea1 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:15.001258 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 242/481] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:15.006816 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97946375-0256-4e26-9cdb-e3411e752e7e None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:15.007240 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97946375-0256-4e26-9cdb-e3411e752e7e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:15.007442 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97946375-0256-4e26-9cdb-e3411e752e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:15.031411 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-97946375-0256-4e26-9cdb-e3411e752e7e None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:15.032612 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-97946375-0256-4e26-9cdb-e3411e752e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:15.097123 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de821bd-44f1-4d47-99a4-5e7af4514efe None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:15.097469 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de821bd-44f1-4d47-99a4-5e7af4514efe None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:15.097692 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de821bd-44f1-4d47-99a4-5e7af4514efe None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:15.099370 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 243/482] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 03:58:15.104084 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbe70c-4e80-4357-9176-7512ebae78d5 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:15.104377 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbe70c-4e80-4357-9176-7512ebae78d5 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:15.104662 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbe70c-4e80-4357-9176-7512ebae78d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:15.116362 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 240/483] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:58:15.139587 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-bddbe70c-4e80-4357-9176-7512ebae78d5 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:15.140783 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-bddbe70c-4e80-4357-9176-7512ebae78d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:15.146710 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97946375-0256-4e26-9cdb-e3411e752e7e None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:15.253474 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 244/484] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 03:58:15.278087 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97946375-0256-4e26-9cdb-e3411e752e7e None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:15.290690 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:15.292625 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddbe70c-4e80-4357-9176-7512ebae78d5 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:15.321110 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d58c7c-6c54-442c-a22a-071d0b6226de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:15.321934 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d58c7c-6c54-442c-a22a-071d0b6226de None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:15.322242 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d58c7c-6c54-442c-a22a-071d0b6226de None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:15.322525 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d58c7c-6c54-442c-a22a-071d0b6226de None admin] PATH_INFO: `/v3/roles/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:15.343135 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d58c7c-6c54-442c-a22a-071d0b6226de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:58:15.351554 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-83d58c7c-6c54-442c-a22a-071d0b6226de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 03:58:15.351554 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:15.351554 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:15.351554 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:15.351554 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:15.351554 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:15.351554 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:15.351554 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:15.351554 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:15.351554 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:15.351554 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:15.351554 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:15.351554 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:58:15.351554 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:58:15.351554 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:58:15.351554 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:58:15.352639 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:58:15.352639 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:58:15.352639 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:58:15.352639 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:58:15.352639 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:15.352639 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:15.352639 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:15.352639 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:15.352639 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:15.352639 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:15.352639 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:15.352639 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:15.352639 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:15.352639 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:15.352639 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:15.352639 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:15.353660 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:15.353660 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:15.353660 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:15.353660 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:15.353660 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:58:15.353660 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:58:15.353660 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:58:15.353660 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:58:15.353660 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:58:15.353660 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:58:15.353660 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 03:58:15.353660 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:15.358696 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 241/485] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Jul 4 03:58:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:15.365238 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d58c7c-6c54-442c-a22a-071d0b6226de None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:15.392117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:15.423343 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddbe70c-4e80-4357-9176-7512ebae78d5 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:15.485642 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d58c7c-6c54-442c-a22a-071d0b6226de None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:15.500227 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef1215-a21b-4c0c-88b5-a8a88cb56f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:15.501042 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef1215-a21b-4c0c-88b5-a8a88cb56f86 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:15.501331 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef1215-a21b-4c0c-88b5-a8a88cb56f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:15.501613 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef1215-a21b-4c0c-88b5-a8a88cb56f86 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:15.524537 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99fceee-d590-4d74-a74b-ee3439639da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:15.525282 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fceee-d590-4d74-a74b-ee3439639da3 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:15.525666 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fceee-d590-4d74-a74b-ee3439639da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:15.526058 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fceee-d590-4d74-a74b-ee3439639da3 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:15.527374 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99fceee-d590-4d74-a74b-ee3439639da3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:15.527780 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99fceee-d590-4d74-a74b-ee3439639da3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:15.529485 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99fceee-d590-4d74-a74b-ee3439639da3 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:15.535540 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef1215-a21b-4c0c-88b5-a8a88cb56f86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:58:15.538688 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 242/486] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Jul 4 03:58:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:15.550865 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99fceee-d590-4d74-a74b-ee3439639da3 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:15.551311 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-13ef1215-a21b-4c0c-88b5-a8a88cb56f86 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 03:58:15.551311 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:15.551311 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:15.551311 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:15.551311 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:15.551311 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:15.551311 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:15.551311 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:15.551311 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:15.551311 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:15.551311 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:15.551311 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:15.551311 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:58:15.551311 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:58:15.551311 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:58:15.551311 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:58:15.552162 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:58:15.552162 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:58:15.552162 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:58:15.552162 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:58:15.552162 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:15.552162 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:15.552162 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:15.552162 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:15.552162 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:15.552162 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:15.552162 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:15.552162 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:15.552162 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:15.552162 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:15.552162 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:15.552162 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:15.552961 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:15.552961 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:15.552961 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:15.552961 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:15.552961 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:58:15.552961 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:58:15.552961 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:58:15.552961 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:58:15.552961 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:58:15.552961 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:58:15.552961 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 03:58:15.552961 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:15.557263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 245/487] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Jul 4 03:58:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:15.558431 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef1215-a21b-4c0c-88b5-a8a88cb56f86 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:15.609687 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:15.738350 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99fceee-d590-4d74-a74b-ee3439639da3 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:15.743149 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef1215-a21b-4c0c-88b5-a8a88cb56f86 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:15.798961 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90992e-675f-45cd-a313-9372648bd62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:15.800038 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90992e-675f-45cd-a313-9372648bd62b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:15.800326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90992e-675f-45cd-a313-9372648bd62b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:15.800613 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90992e-675f-45cd-a313-9372648bd62b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:15.802398 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da04aa1-45f0-47a0-8904-f8731ad3da68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:15.803067 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da04aa1-45f0-47a0-8904-f8731ad3da68 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:15.803351 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da04aa1-45f0-47a0-8904-f8731ad3da68 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:15.803628 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da04aa1-45f0-47a0-8904-f8731ad3da68 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:15.804451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da04aa1-45f0-47a0-8904-f8731ad3da68 None admin] RBAC: Adding query filter params (name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:15.804769 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da04aa1-45f0-47a0-8904-f8731ad3da68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:15.806186 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da04aa1-45f0-47a0-8904-f8731ad3da68 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:15.808830 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:15.824312 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90992e-675f-45cd-a313-9372648bd62b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:15.825816 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90992e-675f-45cd-a313-9372648bd62b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:15.826864 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 246/488] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Jul 4 03:58:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:15.832418 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da04aa1-45f0-47a0-8904-f8731ad3da68 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:15.856039 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-9f90992e-675f-45cd-a313-9372648bd62b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:15.856039 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:15.856039 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:15.856039 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:15.856039 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:15.856039 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:15.856039 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:15.856039 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:15.856039 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:15.856039 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:15.856039 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:15.856039 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:15.856039 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:15.856039 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:15.856039 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:15.856980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:15.856980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:15.856980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:15.856980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:15.856980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:15.856980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:15.856980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:15.856980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:15.856980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:15.856980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:15.856980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:15.856980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:15.856980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:15.856980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:15.856980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:15.856980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:15.856980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:15.857814 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:15.857814 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:15.857814 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:15.857814 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:15.860411 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 243/489] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:58:15.867475 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90992e-675f-45cd-a313-9372648bd62b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:15.956696 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:15.978914 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90992e-675f-45cd-a313-9372648bd62b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:15.986821 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da04aa1-45f0-47a0-8904-f8731ad3da68 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:16.013617 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9249cddc-98dc-44bf-870d-c50b22a02e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:16.014342 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249cddc-98dc-44bf-870d-c50b22a02e5c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:16.014635 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249cddc-98dc-44bf-870d-c50b22a02e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:16.014920 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249cddc-98dc-44bf-870d-c50b22a02e5c None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:16.015656 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9249cddc-98dc-44bf-870d-c50b22a02e5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:16.015975 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9249cddc-98dc-44bf-870d-c50b22a02e5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:16.017407 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9249cddc-98dc-44bf-870d-c50b22a02e5c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:16.026240 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8a96c-e6cf-49ab-a664-1b758513de91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:16.027637 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8a96c-e6cf-49ab-a664-1b758513de91 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:16.028066 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8a96c-e6cf-49ab-a664-1b758513de91 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:16.028487 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8a96c-e6cf-49ab-a664-1b758513de91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:16.034679 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 244/490] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:16.036269 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e589e0f-eb1e-486e-b306-f1a4f06e77e7 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:16.036457 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e589e0f-eb1e-486e-b306-f1a4f06e77e7 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:16.036745 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e589e0f-eb1e-486e-b306-f1a4f06e77e7 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:16.038575 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 245/491] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:16.039606 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e589e0f-eb1e-486e-b306-f1a4f06e77e7 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:16.041183 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc8a96c-e6cf-49ab-a664-1b758513de91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:16.043077 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc8a96c-e6cf-49ab-a664-1b758513de91 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:16.062490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-dfc8a96c-e6cf-49ab-a664-1b758513de91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:16.062490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:16.062490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:16.062490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:16.062490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:16.062490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:16.062490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:16.062490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:16.062490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:16.062490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:16.062490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:16.062490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:16.062490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:16.062490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:16.062490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:16.063356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:16.063356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:16.063356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:16.063356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:16.063356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:16.063356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:16.063356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:16.063356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:16.063356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:16.063356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:16.063356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:16.063356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:16.063356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:16.063356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:16.063356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:16.063356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:16.063356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:16.064209 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:16.064209 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:16.064209 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:16.064209 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:16.066628 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 247/492] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:58:16.068027 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5691ee-9901-4c51-afb9-164cf31c33c6 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:16.068540 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5691ee-9901-4c51-afb9-164cf31c33c6 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:16.069098 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5691ee-9901-4c51-afb9-164cf31c33c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:16.086849 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-7e5691ee-9901-4c51-afb9-164cf31c33c6 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:16.088444 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7e5691ee-9901-4c51-afb9-164cf31c33c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:16.137321 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:16.150697 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e589e0f-eb1e-486e-b306-f1a4f06e77e7 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:16.164879 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 248/493] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:58:16.166135 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5691ee-9901-4c51-afb9-164cf31c33c6 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:16.194956 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378367e-d895-4142-837a-65ca9e7def0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:16.195844 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378367e-d895-4142-837a-65ca9e7def0f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:16.196134 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378367e-d895-4142-837a-65ca9e7def0f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:16.196468 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378367e-d895-4142-837a-65ca9e7def0f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:16.204551 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378367e-d895-4142-837a-65ca9e7def0f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:16.206054 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378367e-d895-4142-837a-65ca9e7def0f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:16.208536 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:16.224436 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-5378367e-d895-4142-837a-65ca9e7def0f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 03:58:16.224436 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:16.224436 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:16.224436 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:16.224436 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:16.224436 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:16.224436 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:16.224436 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:16.224436 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:16.224436 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:16.224436 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:16.224436 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:16.224436 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 03:58:16.224436 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 03:58:16.224436 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 03:58:16.224436 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 03:58:16.225409 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:16.225409 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:16.225409 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 03:58:16.225409 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:16.225409 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 03:58:16.225409 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:16.225409 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:16.225409 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:16.225409 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:16.225409 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:16.225409 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:16.225409 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:16.225409 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:16.225409 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:16.225409 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:16.225409 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:16.225409 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:16.225409 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:16.226491 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:16.226491 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:16.226491 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 03:58:16.226491 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 03:58:16.226491 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 03:58:16.226491 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 03:58:16.226491 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 03:58:16.226491 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 03:58:16.226491 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 03:58:16.226491 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:16.230560 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 246/494] 10.222.0.49 () {56 vars in 1093 bytes} [Mon Jul 4 03:58:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:58:16.231443 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378367e-d895-4142-837a-65ca9e7def0f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:16.296052 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5691ee-9901-4c51-afb9-164cf31c33c6 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:16.334552 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2c666-cf7c-4829-a58c-793a12cdb9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:16.335137 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2c666-cf7c-4829-a58c-793a12cdb9ef None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:16.335423 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2c666-cf7c-4829-a58c-793a12cdb9ef None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:16.335732 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2c666-cf7c-4829-a58c-793a12cdb9ef None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:16.335929 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378367e-d895-4142-837a-65ca9e7def0f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:16.336462 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2c666-cf7c-4829-a58c-793a12cdb9ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:16.336770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2c666-cf7c-4829-a58c-793a12cdb9ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:16.338197 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2c666-cf7c-4829-a58c-793a12cdb9ef None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:16.350085 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 249/495] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:16.350762 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2c666-cf7c-4829-a58c-793a12cdb9ef None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:16.376547 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca1e94-b05b-4417-b4fe-29d63b10e3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:16.377683 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca1e94-b05b-4417-b4fe-29d63b10e3d4 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:16.378185 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca1e94-b05b-4417-b4fe-29d63b10e3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:16.378732 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca1e94-b05b-4417-b4fe-29d63b10e3d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:16.390413 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca1e94-b05b-4417-b4fe-29d63b10e3d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:58:16.390896 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:16.399040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-1fca1e94-b05b-4417-b4fe-29d63b10e3d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 03:58:16.399040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:16.399040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:16.399040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:16.399040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:16.399040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:16.399040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:16.399040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:16.399040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:16.399040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:16.399040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:16.399040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:16.399040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:58:16.399040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:58:16.399040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:58:16.399040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:58:16.399971 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:58:16.399971 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:58:16.399971 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:58:16.399971 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:58:16.399971 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:16.399971 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:16.399971 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:16.399971 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:16.399971 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:16.399971 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:16.399971 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:16.399971 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:16.399971 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:16.399971 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:16.399971 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:16.399971 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:16.400765 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:16.400765 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:16.400765 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:16.400765 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:16.400765 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:58:16.400765 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:58:16.400765 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:58:16.400765 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:58:16.400765 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:58:16.400765 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:58:16.400765 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 03:58:16.400765 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:16.400765 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 247/496] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Jul 4 03:58:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:16.401973 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41e6c7-07fc-48bc-97ff-f03f320069ac None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:16.401973 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41e6c7-07fc-48bc-97ff-f03f320069ac None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:16.402101 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41e6c7-07fc-48bc-97ff-f03f320069ac None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:16.403444 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 248/497] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:16.407873 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41e6c7-07fc-48bc-97ff-f03f320069ac None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:16.457482 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2c666-cf7c-4829-a58c-793a12cdb9ef None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:16.474113 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:16.490633 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abe290-e93c-4438-85b5-9f934afc6aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:16.491310 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abe290-e93c-4438-85b5-9f934afc6aec None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:16.491599 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abe290-e93c-4438-85b5-9f934afc6aec None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:16.491932 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abe290-e93c-4438-85b5-9f934afc6aec None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:16.492781 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05abe290-e93c-4438-85b5-9f934afc6aec None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:16.493101 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05abe290-e93c-4438-85b5-9f934afc6aec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:16.494595 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05abe290-e93c-4438-85b5-9f934afc6aec None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:16.520223 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41e6c7-07fc-48bc-97ff-f03f320069ac None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:16.531313 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 250/498] 10.222.0.49 () {56 vars in 1133 bytes} [Mon Jul 4 03:58:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:16.532197 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abe290-e93c-4438-85b5-9f934afc6aec None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:16.563813 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6c040-d022-478e-8e53-633f92704658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:16.565102 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6c040-d022-478e-8e53-633f92704658 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:16.565629 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6c040-d022-478e-8e53-633f92704658 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:16.566134 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6c040-d022-478e-8e53-633f92704658 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:16.575092 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c6c040-d022-478e-8e53-633f92704658 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:16.576807 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c6c040-d022-478e-8e53-633f92704658 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:16.593611 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-e7c6c040-d022-478e-8e53-633f92704658 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 04 03:58:16.593611 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:16.593611 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:16.593611 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:16.593611 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:16.593611 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:16.593611 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:16.593611 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:16.593611 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:16.593611 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:16.593611 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:16.593611 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:16.593611 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 03:58:16.593611 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 03:58:16.593611 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 03:58:16.593611 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 03:58:16.595226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:16.595226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:16.595226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 03:58:16.595226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:16.595226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 03:58:16.595226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:16.595226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:16.595226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:16.595226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:16.595226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:16.595226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:16.595226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:16.595226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:16.595226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:16.595226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:16.595226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:16.595226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:16.595226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:16.596424 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:16.596424 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:16.596424 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 03:58:16.596424 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 03:58:16.596424 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 03:58:16.596424 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 03:58:16.596424 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 03:58:16.596424 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 03:58:16.596424 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 04 03:58:16.596424 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:16.596424 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 249/499] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:58:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:16.596982 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53086ea4-e11d-4991-b248-1475bb4681b9 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:16.597468 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53086ea4-e11d-4991-b248-1475bb4681b9 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:16.597618 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53086ea4-e11d-4991-b248-1475bb4681b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:16.614065 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-53086ea4-e11d-4991-b248-1475bb4681b9 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:16.615271 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-53086ea4-e11d-4991-b248-1475bb4681b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:16.641254 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:16.647491 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abe290-e93c-4438-85b5-9f934afc6aec None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:16.682426 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042994a6-070d-4cc7-989d-6c5f844f2f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:16.682969 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 250/500] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:58:16.683081 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042994a6-070d-4cc7-989d-6c5f844f2f75 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:16.683354 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042994a6-070d-4cc7-989d-6c5f844f2f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:16.683617 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53086ea4-e11d-4991-b248-1475bb4681b9 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:16.683724 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042994a6-070d-4cc7-989d-6c5f844f2f75 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:16.684361 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042994a6-070d-4cc7-989d-6c5f844f2f75 None admin] RBAC: Adding query filter params (name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:16.684668 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042994a6-070d-4cc7-989d-6c5f844f2f75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:16.686073 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042994a6-070d-4cc7-989d-6c5f844f2f75 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:16.701023 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 251/501] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Jul 4 03:58:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:16.701836 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042994a6-070d-4cc7-989d-6c5f844f2f75 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:16.736810 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:16.789547 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53086ea4-e11d-4991-b248-1475bb4681b9 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:16.801084 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042994a6-070d-4cc7-989d-6c5f844f2f75 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:16.825400 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca42a44-42df-49f7-9fbf-e72114837b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:16.826056 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca42a44-42df-49f7-9fbf-e72114837b30 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:16.826447 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca42a44-42df-49f7-9fbf-e72114837b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:16.826731 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca42a44-42df-49f7-9fbf-e72114837b30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:16.834227 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35c872-5295-4de0-83b1-6f458e165158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:16.834897 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35c872-5295-4de0-83b1-6f458e165158 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:16.835186 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35c872-5295-4de0-83b1-6f458e165158 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:16.835466 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35c872-5295-4de0-83b1-6f458e165158 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:16.836363 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb35c872-5295-4de0-83b1-6f458e165158 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:16.836683 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb35c872-5295-4de0-83b1-6f458e165158 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:16.838130 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb35c872-5295-4de0-83b1-6f458e165158 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:16.855622 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 252/502] 10.222.0.49 () {56 vars in 1137 bytes} [Mon Jul 4 03:58:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:16.858115 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae441fca-acd9-4d21-b9e4-09565268e5df None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:16.858436 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae441fca-acd9-4d21-b9e4-09565268e5df None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:16.858710 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae441fca-acd9-4d21-b9e4-09565268e5df None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:16.862196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 253/503] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:16.862196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae441fca-acd9-4d21-b9e4-09565268e5df None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:16.879867 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:16.897101 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca42a44-42df-49f7-9fbf-e72114837b30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:16.898679 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca42a44-42df-49f7-9fbf-e72114837b30 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:16.944378 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:16.961029 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae441fca-acd9-4d21-b9e4-09565268e5df None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:16.998123 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 251/504] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:58:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 03:58:16.998347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd71283-c495-435e-95c2-ed9c094bd3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:16.998971 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd71283-c495-435e-95c2-ed9c094bd3a7 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:16.999066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca42a44-42df-49f7-9fbf-e72114837b30 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:16.999254 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd71283-c495-435e-95c2-ed9c094bd3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:16.999534 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd71283-c495-435e-95c2-ed9c094bd3a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:17.010255 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd71283-c495-435e-95c2-ed9c094bd3a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:17.012039 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd71283-c495-435e-95c2-ed9c094bd3a7 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:17.029185 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-9fd71283-c495-435e-95c2-ed9c094bd3a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:17.029185 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:17.029185 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:17.029185 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:17.029185 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:17.029185 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:17.029185 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:17.029185 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:17.029185 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:17.029185 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:17.029185 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:17.029185 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:17.029185 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:17.029185 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:17.029185 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:17.030502 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:17.030502 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:17.030502 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:17.030502 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:17.030502 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:17.030502 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:17.030502 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:17.030502 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:17.030502 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:17.030502 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:17.030502 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:17.030502 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:17.030502 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:17.030502 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:17.030502 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:17.030502 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:17.030502 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:17.031324 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:17.031324 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:17.031324 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:17.031324 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:17.031324 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 254/505] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:17.031324 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd71283-c495-435e-95c2-ed9c094bd3a7 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:17.095493 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:17.102633 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca42a44-42df-49f7-9fbf-e72114837b30 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:17.129526 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd71283-c495-435e-95c2-ed9c094bd3a7 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:17.137614 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a288d-991a-42ed-a1ff-48e8a710e4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:17.138438 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a288d-991a-42ed-a1ff-48e8a710e4ed None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:17.138730 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a288d-991a-42ed-a1ff-48e8a710e4ed None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:17.139016 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a288d-991a-42ed-a1ff-48e8a710e4ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:17.149036 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a288d-991a-42ed-a1ff-48e8a710e4ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:17.150543 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a288d-991a-42ed-a1ff-48e8a710e4ed None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:17.158917 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:17.163365 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ffb77-ca0f-4897-a17d-7077b67ebb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:17.164043 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ffb77-ca0f-4897-a17d-7077b67ebb49 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:17.164307 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ffb77-ca0f-4897-a17d-7077b67ebb49 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:17.164586 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ffb77-ca0f-4897-a17d-7077b67ebb49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:17.168846 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-525a288d-991a-42ed-a1ff-48e8a710e4ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:17.168846 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:17.168846 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:17.168846 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:17.168846 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:17.168846 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:17.168846 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:17.168846 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:17.168846 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:17.168846 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:17.168846 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:17.168846 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:17.168846 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:17.168846 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:17.168846 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:17.169882 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:17.169882 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:17.169882 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:17.169882 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:17.169882 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:17.169882 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:17.169882 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:17.169882 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:17.169882 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:17.169882 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:17.169882 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:17.169882 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:17.169882 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:17.169882 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:17.169882 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:17.169882 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:17.169882 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:17.170812 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:17.170812 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:17.170812 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:17.170812 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:17.170812 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 252/506] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:17.171591 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c4137-1279-445a-8d9a-fd903dd78d5b None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:17.171878 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c4137-1279-445a-8d9a-fd903dd78d5b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:17.172158 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c4137-1279-445a-8d9a-fd903dd78d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:17.188439 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e30c4137-1279-445a-8d9a-fd903dd78d5b None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:17.189646 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e30c4137-1279-445a-8d9a-fd903dd78d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:17.231731 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ffb77-ca0f-4897-a17d-7077b67ebb49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:17.233258 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ffb77-ca0f-4897-a17d-7077b67ebb49 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:17.258652 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 253/507] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:58:17.259475 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c4137-1279-445a-8d9a-fd903dd78d5b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:17.312945 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:17.348597 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 255/508] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:58:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 03:58:17.349460 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ffb77-ca0f-4897-a17d-7077b67ebb49 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:17.359525 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c4137-1279-445a-8d9a-fd903dd78d5b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:17.388240 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:17.394458 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4659100a-654e-418e-8bb4-cc8307103748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:17.395274 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659100a-654e-418e-8bb4-cc8307103748 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:17.395558 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659100a-654e-418e-8bb4-cc8307103748 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:17.395839 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659100a-654e-418e-8bb4-cc8307103748 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:17.406064 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4659100a-654e-418e-8bb4-cc8307103748 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:17.407595 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4659100a-654e-418e-8bb4-cc8307103748 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:17.425246 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-4659100a-654e-418e-8bb4-cc8307103748 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:17.425246 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:17.425246 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:17.425246 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:17.425246 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:17.425246 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:17.425246 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:17.425246 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:17.425246 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:17.425246 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:17.425246 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:17.425246 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:17.425246 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:17.425246 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:17.425246 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:17.426117 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:17.426117 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:17.426117 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:17.426117 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:17.426117 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:17.426117 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:17.426117 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:17.426117 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:17.426117 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:17.426117 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:17.426117 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:17.426117 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:17.426117 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:17.426117 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:17.426117 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:17.426117 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:17.426117 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:17.427010 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:17.427010 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:17.427010 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:17.427010 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:17.427010 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 254/509] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:17.427274 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4659100a-654e-418e-8bb4-cc8307103748 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:17.450848 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ffb77-ca0f-4897-a17d-7077b67ebb49 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:17.484848 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab18319-88e5-48eb-865e-8e1e0dab6700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:17.485512 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab18319-88e5-48eb-865e-8e1e0dab6700 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:17.485787 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab18319-88e5-48eb-865e-8e1e0dab6700 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:17.486065 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab18319-88e5-48eb-865e-8e1e0dab6700 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:17.486814 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab18319-88e5-48eb-865e-8e1e0dab6700 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:17.487120 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab18319-88e5-48eb-865e-8e1e0dab6700 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:17.488516 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab18319-88e5-48eb-865e-8e1e0dab6700 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:17.499470 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 256/510] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:17.500340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab18319-88e5-48eb-865e-8e1e0dab6700 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:17.525243 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4659100a-654e-418e-8bb4-cc8307103748 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:17.530135 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:17.558981 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903586f-0f2c-48ff-bdd3-146488bd674c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:17.559650 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903586f-0f2c-48ff-bdd3-146488bd674c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:17.559940 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903586f-0f2c-48ff-bdd3-146488bd674c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:17.560222 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903586f-0f2c-48ff-bdd3-146488bd674c None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:17.560942 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8903586f-0f2c-48ff-bdd3-146488bd674c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:17.561248 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8903586f-0f2c-48ff-bdd3-146488bd674c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:17.562701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8903586f-0f2c-48ff-bdd3-146488bd674c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:17.573650 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 255/511] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:17.574463 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903586f-0f2c-48ff-bdd3-146488bd674c None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:17.600638 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab18319-88e5-48eb-865e-8e1e0dab6700 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:17.619584 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:17.637992 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a259a-081d-45da-af8f-3d337d03055f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:17.639156 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a259a-081d-45da-af8f-3d337d03055f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:17.639384 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a259a-081d-45da-af8f-3d337d03055f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:17.639670 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a259a-081d-45da-af8f-3d337d03055f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:17.652692 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a259a-081d-45da-af8f-3d337d03055f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:58:17.660513 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-777a259a-081d-45da-af8f-3d337d03055f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 03:58:17.660513 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:17.660513 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:17.660513 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:17.660513 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:17.660513 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:17.660513 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:17.660513 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:17.660513 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:17.660513 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:17.660513 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:17.660513 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:17.660513 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:58:17.660513 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:58:17.660513 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:58:17.660513 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:58:17.661442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:58:17.661442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:58:17.661442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:58:17.661442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:58:17.661442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:17.661442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:17.661442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:17.661442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:17.661442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:17.661442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:17.661442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:17.661442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:17.661442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:17.661442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:17.661442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:17.661442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:17.662263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:17.662263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:17.662263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:17.662263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:17.662263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:58:17.662263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:58:17.662263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:58:17.662263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:58:17.662263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:58:17.662263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:58:17.662263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 03:58:17.662263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:17.662263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 257/512] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Jul 4 03:58:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:17.663142 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a259a-081d-45da-af8f-3d337d03055f None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:17.685649 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903586f-0f2c-48ff-bdd3-146488bd674c None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:17.722601 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95855e20-290f-452a-8a82-425f3460d787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:17.723402 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95855e20-290f-452a-8a82-425f3460d787 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:17.723693 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95855e20-290f-452a-8a82-425f3460d787 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:17.723966 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95855e20-290f-452a-8a82-425f3460d787 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:17.734422 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95855e20-290f-452a-8a82-425f3460d787 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:17.735936 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95855e20-290f-452a-8a82-425f3460d787 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:17.752597 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-95855e20-290f-452a-8a82-425f3460d787 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:17.752597 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:17.752597 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:17.752597 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:17.752597 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:17.752597 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:17.752597 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:17.752597 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:17.752597 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:17.752597 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:17.752597 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:17.752597 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:17.752597 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:17.752597 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:17.752597 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:17.753461 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:17.753461 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:17.753461 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:17.753461 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:17.753461 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:17.753461 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:17.753461 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:17.753461 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:17.753461 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:17.753461 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:17.753461 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:17.753461 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:17.753461 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:17.753461 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:17.753461 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:17.753461 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:17.753461 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:17.754322 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:17.754322 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:17.754322 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:17.754322 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:17.754322 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 256/513] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:17.754598 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95855e20-290f-452a-8a82-425f3460d787 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:17.762623 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:17.775540 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a259a-081d-45da-af8f-3d337d03055f None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:17.809710 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6fc30-fa10-482c-8bae-f4cd481c8ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:17.810407 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6fc30-fa10-482c-8bae-f4cd481c8ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:17.810687 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6fc30-fa10-482c-8bae-f4cd481c8ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:17.810974 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6fc30-fa10-482c-8bae-f4cd481c8ad3 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:17.811703 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6fc30-fa10-482c-8bae-f4cd481c8ad3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:17.812021 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6fc30-fa10-482c-8bae-f4cd481c8ad3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:17.813442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6fc30-fa10-482c-8bae-f4cd481c8ad3 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:17.825117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 258/514] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:17.825883 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6fc30-fa10-482c-8bae-f4cd481c8ad3 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:17.852028 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:17.859602 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95855e20-290f-452a-8a82-425f3460d787 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:17.893610 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafbed08-15f3-4d9e-8284-ea88c6c6aa4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:17.894485 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbed08-15f3-4d9e-8284-ea88c6c6aa4d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:17.894778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbed08-15f3-4d9e-8284-ea88c6c6aa4d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:17.895062 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbed08-15f3-4d9e-8284-ea88c6c6aa4d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:17.902530 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafbed08-15f3-4d9e-8284-ea88c6c6aa4d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:17.904019 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafbed08-15f3-4d9e-8284-ea88c6c6aa4d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:17.918111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-aafbed08-15f3-4d9e-8284-ea88c6c6aa4d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 04 03:58:17.918111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:17.918111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:17.918111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:17.918111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:17.918111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:17.918111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:17.918111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:17.918111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:17.918111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:17.918111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:17.918111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:17.918111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 03:58:17.918111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 03:58:17.918111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 03:58:17.918111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 03:58:17.919031 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:17.919031 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:17.919031 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 03:58:17.919031 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:17.919031 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 03:58:17.919031 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:17.919031 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:17.919031 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:17.919031 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:17.919031 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:17.919031 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:17.919031 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:17.919031 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:17.919031 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:17.919031 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:17.919031 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:17.919031 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:17.919031 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:17.919930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:17.919930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:17.919930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 03:58:17.919930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 03:58:17.919930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 03:58:17.919930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 03:58:17.919930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 03:58:17.919930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 03:58:17.919930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 04 03:58:17.919930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:17.919930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 257/515] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:58:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:17.921458 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafbed08-15f3-4d9e-8284-ea88c6c6aa4d None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:17.926436 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6fc30-fa10-482c-8bae-f4cd481c8ad3 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:17.968359 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5137d6aa-b0cb-4b3b-b711-7a2afbae3732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:17.969581 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137d6aa-b0cb-4b3b-b711-7a2afbae3732 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:17.970445 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137d6aa-b0cb-4b3b-b711-7a2afbae3732 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:17.970445 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137d6aa-b0cb-4b3b-b711-7a2afbae3732 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:17.971320 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5137d6aa-b0cb-4b3b-b711-7a2afbae3732 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:17.973087 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5137d6aa-b0cb-4b3b-b711-7a2afbae3732 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:17.993766 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 259/516] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Jul 4 03:58:17 2022] POST /identity/v3/users => generated 247 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 03:58:17.994636 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5137d6aa-b0cb-4b3b-b711-7a2afbae3732 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:18.009998 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:18.041329 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafbed08-15f3-4d9e-8284-ea88c6c6aa4d None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:18.080630 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8ac8e-4596-425e-9f0c-03441e156284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:18.081333 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8ac8e-4596-425e-9f0c-03441e156284 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:18.081622 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8ac8e-4596-425e-9f0c-03441e156284 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:18.081952 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8ac8e-4596-425e-9f0c-03441e156284 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:18.082773 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e8ac8e-4596-425e-9f0c-03441e156284 None admin] RBAC: Adding query filter params (name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:18.083095 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e8ac8e-4596-425e-9f0c-03441e156284 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:18.084544 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e8ac8e-4596-425e-9f0c-03441e156284 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:18.093639 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 258/517] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Jul 4 03:58:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:18.094558 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8ac8e-4596-425e-9f0c-03441e156284 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:18.115771 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:18.134477 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5137d6aa-b0cb-4b3b-b711-7a2afbae3732 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:18.181472 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b252052-d3bd-40d1-8901-9d0e500e0c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:18.182725 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b252052-d3bd-40d1-8901-9d0e500e0c0b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:18.183014 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b252052-d3bd-40d1-8901-9d0e500e0c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:18.183295 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b252052-d3bd-40d1-8901-9d0e500e0c0b None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:18.184394 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b252052-d3bd-40d1-8901-9d0e500e0c0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:18.184733 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b252052-d3bd-40d1-8901-9d0e500e0c0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:18.186762 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b252052-d3bd-40d1-8901-9d0e500e0c0b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:18.201785 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 260/518] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:18.202730 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b252052-d3bd-40d1-8901-9d0e500e0c0b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:18.213772 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8ac8e-4596-425e-9f0c-03441e156284 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:18.251040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b880a-a47e-4485-b227-a564147b937e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:18.251871 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b880a-a47e-4485-b227-a564147b937e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:18.252158 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b880a-a47e-4485-b227-a564147b937e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:18.252439 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b880a-a47e-4485-b227-a564147b937e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:18.259884 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b880a-a47e-4485-b227-a564147b937e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:18.261746 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b880a-a47e-4485-b227-a564147b937e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:18.278989 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:18.280813 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-5e5b880a-a47e-4485-b227-a564147b937e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:18.280813 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:18.280813 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:18.280813 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:18.280813 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:18.280813 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:18.280813 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:18.280813 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:18.280813 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:18.280813 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:18.280813 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:18.280813 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:18.280813 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 03:58:18.280813 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 03:58:18.280813 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 03:58:18.281728 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 03:58:18.281728 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:18.281728 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:18.281728 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:18.281728 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:18.281728 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:18.281728 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:18.281728 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:18.281728 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:18.281728 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:18.281728 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:18.281728 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:18.281728 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:18.281728 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:18.281728 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:18.281728 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:18.281728 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:18.282603 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 03:58:18.282603 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 03:58:18.282603 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 03:58:18.282603 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 03:58:18.282603 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 03:58:18.282603 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 03:58:18.282603 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:18.282603 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:18.282603 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 259/519] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:58:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:18.283638 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b880a-a47e-4485-b227-a564147b937e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:18.325290 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b252052-d3bd-40d1-8901-9d0e500e0c0b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:18.365147 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1119f-8950-4ec8-96f9-aecc1212cbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:18.365829 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1119f-8950-4ec8-96f9-aecc1212cbf2 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:18.366116 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1119f-8950-4ec8-96f9-aecc1212cbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:18.366417 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1119f-8950-4ec8-96f9-aecc1212cbf2 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:18.367307 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef1119f-8950-4ec8-96f9-aecc1212cbf2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:18.367622 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef1119f-8950-4ec8-96f9-aecc1212cbf2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:18.369076 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef1119f-8950-4ec8-96f9-aecc1212cbf2 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:18.369949 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:18.394496 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b880a-a47e-4485-b227-a564147b937e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:18.394839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 261/520] 10.222.0.49 () {56 vars in 1137 bytes} [Mon Jul 4 03:58:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:18.396012 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1119f-8950-4ec8-96f9-aecc1212cbf2 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:18.429217 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45845577-ee9c-4a7e-a925-ec10973aaf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:18.430050 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45845577-ee9c-4a7e-a925-ec10973aaf04 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:18.430370 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45845577-ee9c-4a7e-a925-ec10973aaf04 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:18.430653 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45845577-ee9c-4a7e-a925-ec10973aaf04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:18.441918 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45845577-ee9c-4a7e-a925-ec10973aaf04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:18.443368 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45845577-ee9c-4a7e-a925-ec10973aaf04 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:18.461474 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-45845577-ee9c-4a7e-a925-ec10973aaf04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:18.461474 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:18.461474 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:18.461474 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:18.461474 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:18.461474 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:18.461474 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:18.461474 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:18.461474 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:18.461474 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:18.461474 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:18.461474 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:18.461474 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:18.461474 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:18.461474 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:18.462534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:18.462534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:18.462534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:18.462534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:18.462534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:18.462534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:18.462534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:18.462534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:18.462534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:18.462534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:18.462534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:18.462534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:18.462534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:18.462534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:18.462534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:18.462534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:18.462534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:18.463406 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:18.463406 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:18.463406 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:18.463406 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:18.463406 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 260/521] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:18.463843 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45845577-ee9c-4a7e-a925-ec10973aaf04 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:18.513730 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1119f-8950-4ec8-96f9-aecc1212cbf2 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:18.540110 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:18.553009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70156312-dad6-46dc-aeeb-9e9b9456fd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:18.554123 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70156312-dad6-46dc-aeeb-9e9b9456fd69 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:18.554624 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70156312-dad6-46dc-aeeb-9e9b9456fd69 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:18.555147 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70156312-dad6-46dc-aeeb-9e9b9456fd69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:18.563624 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70156312-dad6-46dc-aeeb-9e9b9456fd69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:18.565323 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70156312-dad6-46dc-aeeb-9e9b9456fd69 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:18.569405 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45845577-ee9c-4a7e-a925-ec10973aaf04 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:18.581090 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-70156312-dad6-46dc-aeeb-9e9b9456fd69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:18.581090 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:18.581090 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:18.581090 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:18.581090 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:18.581090 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:18.581090 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:18.581090 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:18.581090 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:18.581090 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:18.581090 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:18.581090 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:18.581090 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 03:58:18.581090 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 03:58:18.581090 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 03:58:18.582117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 03:58:18.582117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:18.582117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:18.582117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:18.582117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:18.582117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:18.582117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:18.582117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:18.582117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:18.582117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:18.582117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:18.582117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:18.582117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:18.582117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:18.582117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:18.582117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:18.582117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:18.583006 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 03:58:18.583006 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 03:58:18.583006 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 03:58:18.583006 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 03:58:18.583006 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 03:58:18.583006 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 03:58:18.583006 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:18.583006 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:18.583537 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 262/522] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:58:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:18.584284 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70156312-dad6-46dc-aeeb-9e9b9456fd69 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:18.601548 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:18.612302 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01d9e9-5077-4525-8f0c-8d738826e959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:18.612974 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01d9e9-5077-4525-8f0c-8d738826e959 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:18.613259 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01d9e9-5077-4525-8f0c-8d738826e959 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:18.613539 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01d9e9-5077-4525-8f0c-8d738826e959 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:18.614374 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01d9e9-5077-4525-8f0c-8d738826e959 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:18.614785 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01d9e9-5077-4525-8f0c-8d738826e959 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:18.616142 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01d9e9-5077-4525-8f0c-8d738826e959 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:18.639411 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 261/523] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Jul 4 03:58:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:18.639411 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01d9e9-5077-4525-8f0c-8d738826e959 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:18.707653 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70156312-dad6-46dc-aeeb-9e9b9456fd69 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:18.748674 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90bfd2a-56ff-4c33-a37c-be02423332c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:18.749332 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bfd2a-56ff-4c33-a37c-be02423332c6 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:18.749625 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bfd2a-56ff-4c33-a37c-be02423332c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:18.749903 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bfd2a-56ff-4c33-a37c-be02423332c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:18.760000 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01d9e9-5077-4525-8f0c-8d738826e959 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:18.799874 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f5ecc-4208-4563-8c22-d4b84cf99c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:18.800548 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f5ecc-4208-4563-8c22-d4b84cf99c6a None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:18.800829 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f5ecc-4208-4563-8c22-d4b84cf99c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:18.801100 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f5ecc-4208-4563-8c22-d4b84cf99c6a None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:18.801894 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f5ecc-4208-4563-8c22-d4b84cf99c6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:18.802242 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f5ecc-4208-4563-8c22-d4b84cf99c6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:18.803642 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f5ecc-4208-4563-8c22-d4b84cf99c6a None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:18.805294 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:18.817530 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 262/524] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:18.818796 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f5ecc-4208-4563-8c22-d4b84cf99c6a None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:18.831776 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90bfd2a-56ff-4c33-a37c-be02423332c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:18.833257 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90bfd2a-56ff-4c33-a37c-be02423332c6 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:18.874642 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:18.929207 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f5ecc-4208-4563-8c22-d4b84cf99c6a None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:18.943105 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 263/525] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:58:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 03:58:18.943105 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90bfd2a-56ff-4c33-a37c-be02423332c6 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:18.973926 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11c8fa-b7d9-4c33-8596-31a7f89dfdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:18.975196 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11c8fa-b7d9-4c33-8596-31a7f89dfdb9 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:18.975644 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11c8fa-b7d9-4c33-8596-31a7f89dfdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:18.975931 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11c8fa-b7d9-4c33-8596-31a7f89dfdb9 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:18.977304 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af11c8fa-b7d9-4c33-8596-31a7f89dfdb9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:18.977840 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af11c8fa-b7d9-4c33-8596-31a7f89dfdb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:18.979530 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af11c8fa-b7d9-4c33-8596-31a7f89dfdb9 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:18.993351 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 263/526] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Jul 4 03:58:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:18.994183 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11c8fa-b7d9-4c33-8596-31a7f89dfdb9 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:19.033733 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:19.053587 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90bfd2a-56ff-4c33-a37c-be02423332c6 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:19.096331 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11c8fa-b7d9-4c33-8596-31a7f89dfdb9 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:19.096508 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656cbf1d-35e0-4ab6-86d6-357c67337981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:19.097152 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656cbf1d-35e0-4ab6-86d6-357c67337981 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:19.097473 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656cbf1d-35e0-4ab6-86d6-357c67337981 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:19.097985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656cbf1d-35e0-4ab6-86d6-357c67337981 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:19.099646 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656cbf1d-35e0-4ab6-86d6-357c67337981 None admin] RBAC: Adding query filter params (role.id=7fd75ec0129248b28b5254e00d4f6f0b, scope.project.id=424a145a22434ef7a14b6108e6118ccb, user.id=8334e75253f843a980b01c6f0cda6015) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:19.099974 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656cbf1d-35e0-4ab6-86d6-357c67337981 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:19.101485 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656cbf1d-35e0-4ab6-86d6-357c67337981 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:19.109235 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:19.109398 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 264/527] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:58:18 2022] GET /identity/v3/role_assignments?user.id=8334e75253f843a980b01c6f0cda6015&scope.project.id=424a145a22434ef7a14b6108e6118ccb&role.id=7fd75ec0129248b28b5254e00d4f6f0b => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:19.109857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656cbf1d-35e0-4ab6-86d6-357c67337981 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:19.141436 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab53ae2-285b-4293-b576-60738bbee180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:19.142479 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab53ae2-285b-4293-b576-60738bbee180 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:19.142871 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab53ae2-285b-4293-b576-60738bbee180 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:19.143257 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab53ae2-285b-4293-b576-60738bbee180 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:19.152476 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab53ae2-285b-4293-b576-60738bbee180 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:19.154276 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab53ae2-285b-4293-b576-60738bbee180 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:19.170939 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-7ab53ae2-285b-4293-b576-60738bbee180 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 04 03:58:19.170939 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:19.170939 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:19.170939 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:19.170939 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:19.170939 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:19.170939 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:19.170939 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:19.170939 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:19.170939 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:19.170939 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:19.170939 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:19.170939 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 03:58:19.170939 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 03:58:19.170939 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 03:58:19.170939 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 03:58:19.172111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:19.172111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:19.172111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 03:58:19.172111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:19.172111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 03:58:19.172111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:19.172111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:19.172111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:19.172111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:19.172111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:19.172111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:19.172111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:19.172111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:19.172111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:19.172111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:19.172111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:19.172111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:19.172111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:19.173243 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:19.173243 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:19.173243 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 03:58:19.173243 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 03:58:19.173243 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 03:58:19.173243 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 03:58:19.173243 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 03:58:19.173243 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 03:58:19.173243 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 04 03:58:19.173243 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:19.175258 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 264/528] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Jul 4 03:58:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:19.176312 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab53ae2-285b-4293-b576-60738bbee180 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:19.264614 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656cbf1d-35e0-4ab6-86d6-357c67337981 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:19.290753 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab53ae2-285b-4293-b576-60738bbee180 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:19.307923 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f71a5-a17a-4945-8e0b-e5d8c7208789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:19.309226 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f71a5-a17a-4945-8e0b-e5d8c7208789 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:19.309663 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f71a5-a17a-4945-8e0b-e5d8c7208789 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:19.310233 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f71a5-a17a-4945-8e0b-e5d8c7208789 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:19.324888 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f71a5-a17a-4945-8e0b-e5d8c7208789 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:19.326284 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ec0a7-b530-4e1a-b754-16508f459549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:19.326774 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f71a5-a17a-4945-8e0b-e5d8c7208789 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:19.327153 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ec0a7-b530-4e1a-b754-16508f459549 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:19.327535 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ec0a7-b530-4e1a-b754-16508f459549 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:19.327907 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ec0a7-b530-4e1a-b754-16508f459549 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:19.328850 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ec0a7-b530-4e1a-b754-16508f459549 None admin] RBAC: Adding query filter params (role.id=7fd75ec0129248b28b5254e00d4f6f0b, scope.project.id=424a145a22434ef7a14b6108e6118ccb, user.id=60e29ce1e3d64431bc7aa80d55787ae5) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:19.329267 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ec0a7-b530-4e1a-b754-16508f459549 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:19.330860 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ec0a7-b530-4e1a-b754-16508f459549 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:19.335671 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:19.346695 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 265/529] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:58:19 2022] GET /identity/v3/role_assignments?user.id=60e29ce1e3d64431bc7aa80d55787ae5&scope.project.id=424a145a22434ef7a14b6108e6118ccb&role.id=7fd75ec0129248b28b5254e00d4f6f0b => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:19.348385 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ec0a7-b530-4e1a-b754-16508f459549 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:19.351335 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-f23f71a5-a17a-4945-8e0b-e5d8c7208789 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:19.351335 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:19.351335 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:19.351335 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:19.351335 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:19.351335 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:19.351335 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:19.351335 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:19.351335 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:19.351335 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:19.351335 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:19.351335 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:19.351335 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:19.351335 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:19.351335 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:19.352229 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:19.352229 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:19.352229 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:19.352229 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:19.352229 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:19.352229 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:19.352229 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:19.352229 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:19.352229 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:19.352229 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:19.352229 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:19.352229 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:19.352229 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:19.352229 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:19.352229 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:19.352229 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:19.352229 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:19.353109 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:19.353109 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:19.353109 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:19.353109 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:19.355546 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 265/530] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:19.360608 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f71a5-a17a-4945-8e0b-e5d8c7208789 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:19.436941 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:19.487952 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f71a5-a17a-4945-8e0b-e5d8c7208789 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:19.530011 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a244c49-d625-470d-8beb-a2017e8f947a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:19.531072 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a244c49-d625-470d-8beb-a2017e8f947a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:19.531561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a244c49-d625-470d-8beb-a2017e8f947a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:19.532040 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a244c49-d625-470d-8beb-a2017e8f947a None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:19.533026 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a244c49-d625-470d-8beb-a2017e8f947a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:19.533545 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a244c49-d625-470d-8beb-a2017e8f947a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:19.535745 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a244c49-d625-470d-8beb-a2017e8f947a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:19.551036 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 266/531] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:58:19.556431 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a244c49-d625-470d-8beb-a2017e8f947a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:19.612158 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ec0a7-b530-4e1a-b754-16508f459549 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:19.631148 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:19.653209 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75cdfb2-3596-49fa-bd4f-02d7a8d6d3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:19.653955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75cdfb2-3596-49fa-bd4f-02d7a8d6d3b9 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:19.654300 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75cdfb2-3596-49fa-bd4f-02d7a8d6d3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:19.654587 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75cdfb2-3596-49fa-bd4f-02d7a8d6d3b9 None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:19.655444 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75cdfb2-3596-49fa-bd4f-02d7a8d6d3b9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:19.656087 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75cdfb2-3596-49fa-bd4f-02d7a8d6d3b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:19.657224 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75cdfb2-3596-49fa-bd4f-02d7a8d6d3b9 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:19.688617 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a244c49-d625-470d-8beb-a2017e8f947a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:19.714468 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 266/532] 10.222.0.49 () {56 vars in 1139 bytes} [Mon Jul 4 03:58:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:19.723213 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75cdfb2-3596-49fa-bd4f-02d7a8d6d3b9 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:19.771819 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbd76f-83a8-4df3-8055-b61fda508c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:19.773548 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbd76f-83a8-4df3-8055-b61fda508c1a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:19.773846 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbd76f-83a8-4df3-8055-b61fda508c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:19.774135 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbd76f-83a8-4df3-8055-b61fda508c1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:19.787845 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecbd76f-83a8-4df3-8055-b61fda508c1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:19.791843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecbd76f-83a8-4df3-8055-b61fda508c1a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:19.815881 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-9ecbd76f-83a8-4df3-8055-b61fda508c1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:19.815881 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:19.815881 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:19.815881 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:19.815881 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:19.815881 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:19.815881 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:19.815881 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:19.815881 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:19.815881 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:19.815881 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:19.815881 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:19.815881 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 03:58:19.815881 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 03:58:19.815881 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 03:58:19.816814 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 03:58:19.816814 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:19.816814 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:19.816814 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:19.816814 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:19.816814 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:19.816814 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:19.816814 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:19.816814 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:19.816814 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:19.816814 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:19.816814 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:19.816814 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:19.816814 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:19.816814 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:19.816814 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:19.816814 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:19.818048 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 03:58:19.818048 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 03:58:19.818048 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 03:58:19.818048 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 03:58:19.818048 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 03:58:19.818048 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 03:58:19.818048 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:19.818048 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:19.818048 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 267/533] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:58:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:58:19.822858 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbd76f-83a8-4df3-8055-b61fda508c1a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:19.924972 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:19.927027 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbd76f-83a8-4df3-8055-b61fda508c1a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:19.941033 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75cdfb2-3596-49fa-bd4f-02d7a8d6d3b9 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:19.945857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:19.968067 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b52c8-1241-4473-8377-76fb7e91d066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:19.974721 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b52c8-1241-4473-8377-76fb7e91d066 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:19.974721 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b52c8-1241-4473-8377-76fb7e91d066 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:19.974721 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b52c8-1241-4473-8377-76fb7e91d066 None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:19.974721 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179b52c8-1241-4473-8377-76fb7e91d066 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:19.974721 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179b52c8-1241-4473-8377-76fb7e91d066 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:19.974721 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179b52c8-1241-4473-8377-76fb7e91d066 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:19.981975 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f6972-30f4-44c2-ae2a-06f5c9ff9f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:19.982772 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f6972-30f4-44c2-ae2a-06f5c9ff9f40 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:19.983147 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f6972-30f4-44c2-ae2a-06f5c9ff9f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:19.983494 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f6972-30f4-44c2-ae2a-06f5c9ff9f40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:19.992576 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 268/534] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Jul 4 03:58:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:19.998326 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b52c8-1241-4473-8377-76fb7e91d066 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:20.054362 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f6972-30f4-44c2-ae2a-06f5c9ff9f40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:20.055902 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f6972-30f4-44c2-ae2a-06f5c9ff9f40 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:20.104880 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b52c8-1241-4473-8377-76fb7e91d066 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:20.146178 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36952021-3e0c-4efe-b5f6-8f501034c855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:20.146178 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36952021-3e0c-4efe-b5f6-8f501034c855 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:20.146178 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36952021-3e0c-4efe-b5f6-8f501034c855 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:20.146178 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36952021-3e0c-4efe-b5f6-8f501034c855 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:20.146547 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36952021-3e0c-4efe-b5f6-8f501034c855 None admin] RBAC: Adding query filter params (role.id=7fd75ec0129248b28b5254e00d4f6f0b, scope.project.id=424a145a22434ef7a14b6108e6118ccb, user.id=9d20ab1d200447c098d32ebfa130c5de) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:20.146547 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36952021-3e0c-4efe-b5f6-8f501034c855 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:20.146547 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36952021-3e0c-4efe-b5f6-8f501034c855 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:20.152088 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 269/535] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:58:19 2022] GET /identity/v3/role_assignments?user.id=9d20ab1d200447c098d32ebfa130c5de&scope.project.id=424a145a22434ef7a14b6108e6118ccb&role.id=7fd75ec0129248b28b5254e00d4f6f0b => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:58:20.238101 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:20.251606 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 267/536] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:58:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 03:58:20.257439 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36952021-3e0c-4efe-b5f6-8f501034c855 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:20.295048 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ceadfd-2061-490e-abeb-fc472e7b7757 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:20.295576 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ceadfd-2061-490e-abeb-fc472e7b7757 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:20.296002 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ceadfd-2061-490e-abeb-fc472e7b7757 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:20.297820 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 268/537] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 03:58:20.311953 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ed213-8684-45af-946f-31fd6bb1b01f None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:20.312477 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ed213-8684-45af-946f-31fd6bb1b01f None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:20.312906 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ed213-8684-45af-946f-31fd6bb1b01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:20.316055 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:20.346034 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e00ed213-8684-45af-946f-31fd6bb1b01f None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:20.347306 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e00ed213-8684-45af-946f-31fd6bb1b01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:20.397293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36952021-3e0c-4efe-b5f6-8f501034c855 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:20.433208 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21bbd9-81f2-4950-8740-4e3e05a91855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:20.434007 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21bbd9-81f2-4950-8740-4e3e05a91855 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:20.434324 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21bbd9-81f2-4950-8740-4e3e05a91855 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:20.434610 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21bbd9-81f2-4950-8740-4e3e05a91855 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:20.446081 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb21bbd9-81f2-4950-8740-4e3e05a91855 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:20.447569 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb21bbd9-81f2-4950-8740-4e3e05a91855 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:20.465341 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-cb21bbd9-81f2-4950-8740-4e3e05a91855 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:20.465341 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:20.465341 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:20.465341 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:20.465341 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:20.465341 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:20.465341 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:20.465341 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:20.465341 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:20.465341 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:20.465341 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:20.465341 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:20.465341 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:20.465341 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:20.465341 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:20.466235 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:20.466235 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:20.466235 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:20.466235 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:20.466235 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:20.466235 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:20.466235 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:20.466235 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:20.466235 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:20.466235 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:20.466235 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:20.466235 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:20.466235 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:20.466235 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:20.466235 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:20.466235 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:20.466235 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:20.467081 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:20.467081 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:20.467081 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:20.467081 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:20.467081 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 270/538] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:20.472316 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21bbd9-81f2-4950-8740-4e3e05a91855 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:20.480243 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 269/539] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:58:20.528147 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ed213-8684-45af-946f-31fd6bb1b01f None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:20.572264 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:20.579119 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21bbd9-81f2-4950-8740-4e3e05a91855 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:20.615418 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c0fa1-7b42-4c28-8da3-dc3edd5b021e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:20.616182 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c0fa1-7b42-4c28-8da3-dc3edd5b021e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:20.616555 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c0fa1-7b42-4c28-8da3-dc3edd5b021e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:20.616872 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c0fa1-7b42-4c28-8da3-dc3edd5b021e None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:20.617596 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c0fa1-7b42-4c28-8da3-dc3edd5b021e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:20.617906 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c0fa1-7b42-4c28-8da3-dc3edd5b021e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:20.619321 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c0fa1-7b42-4c28-8da3-dc3edd5b021e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:20.631549 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 271/540] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:58:20.637258 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c0fa1-7b42-4c28-8da3-dc3edd5b021e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:20.654836 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ed213-8684-45af-946f-31fd6bb1b01f None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:20.675395 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:20.689498 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392dd40-e614-498d-b370-157d65122995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:20.690410 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392dd40-e614-498d-b370-157d65122995 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:20.690699 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392dd40-e614-498d-b370-157d65122995 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:20.690974 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392dd40-e614-498d-b370-157d65122995 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:20.701945 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d392dd40-e614-498d-b370-157d65122995 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:58:20.709806 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-d392dd40-e614-498d-b370-157d65122995 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 03:58:20.709806 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:20.709806 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:20.709806 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:20.709806 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:20.709806 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:20.709806 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:20.709806 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:20.709806 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:20.709806 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:20.709806 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:20.709806 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:20.709806 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:58:20.709806 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:58:20.709806 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:58:20.709806 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:58:20.710778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:58:20.710778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:58:20.710778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:58:20.710778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:58:20.710778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:20.710778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:20.710778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:20.710778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:20.710778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:20.710778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:20.710778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:20.710778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:20.710778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:20.710778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:20.710778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:20.710778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:20.711607 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:20.711607 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:20.711607 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:20.711607 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:20.711607 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:58:20.711607 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:58:20.711607 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:58:20.711607 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:58:20.711607 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:58:20.711607 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:58:20.711607 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 03:58:20.711607 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:20.711607 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 270/541] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Jul 4 03:58:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:20.717139 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392dd40-e614-498d-b370-157d65122995 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:20.741520 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c0fa1-7b42-4c28-8da3-dc3edd5b021e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:20.824419 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392dd40-e614-498d-b370-157d65122995 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:20.832941 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae77ed-e5f4-4e83-9f9b-9e0bda3a9c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:20.833754 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae77ed-e5f4-4e83-9f9b-9e0bda3a9c52 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:20.834143 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae77ed-e5f4-4e83-9f9b-9e0bda3a9c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:20.834446 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae77ed-e5f4-4e83-9f9b-9e0bda3a9c52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:20.845574 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae77ed-e5f4-4e83-9f9b-9e0bda3a9c52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:20.847115 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae77ed-e5f4-4e83-9f9b-9e0bda3a9c52 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:20.860085 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c7866-93b7-45e5-8c7c-011dd6c4d839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:20.860814 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c7866-93b7-45e5-8c7c-011dd6c4d839 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:20.861105 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c7866-93b7-45e5-8c7c-011dd6c4d839 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:20.861386 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c7866-93b7-45e5-8c7c-011dd6c4d839 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:20.862167 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c7866-93b7-45e5-8c7c-011dd6c4d839 None admin] RBAC: Adding query filter params (name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:20.862489 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c7866-93b7-45e5-8c7c-011dd6c4d839 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:20.863899 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c7866-93b7-45e5-8c7c-011dd6c4d839 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:20.872980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 271/542] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Jul 4 03:58:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:20.878426 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c7866-93b7-45e5-8c7c-011dd6c4d839 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:20.882226 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-53ae77ed-e5f4-4e83-9f9b-9e0bda3a9c52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:20.882226 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:20.882226 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:20.882226 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:20.882226 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:20.882226 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:20.882226 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:20.882226 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:20.882226 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:20.882226 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:20.882226 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:20.882226 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:20.882226 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 03:58:20.882226 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 03:58:20.882226 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 03:58:20.883130 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 03:58:20.883130 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:20.883130 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:20.883130 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:20.883130 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:20.883130 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:20.883130 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:20.883130 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:20.883130 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:20.883130 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:20.883130 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:20.883130 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:20.883130 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:20.883130 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:20.883130 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:20.883130 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:20.883130 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:20.883961 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 03:58:20.883961 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 03:58:20.883961 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 03:58:20.883961 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 03:58:20.883961 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 03:58:20.883961 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 03:58:20.883961 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:20.883961 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:20.889786 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 272/543] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:58:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:58:20.890684 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae77ed-e5f4-4e83-9f9b-9e0bda3a9c52 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:20.927235 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:20.928923 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:20.984807 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c7866-93b7-45e5-8c7c-011dd6c4d839 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:21.020900 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25dd6fa-fc63-40c4-83ff-ac11ceac7808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:21.021908 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25dd6fa-fc63-40c4-83ff-ac11ceac7808 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:21.022322 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25dd6fa-fc63-40c4-83ff-ac11ceac7808 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:21.022700 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25dd6fa-fc63-40c4-83ff-ac11ceac7808 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:21.045693 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25dd6fa-fc63-40c4-83ff-ac11ceac7808 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:21.048326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25dd6fa-fc63-40c4-83ff-ac11ceac7808 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:21.081249 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-d25dd6fa-fc63-40c4-83ff-ac11ceac7808 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:21.081249 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:21.081249 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:21.081249 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:21.081249 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:21.081249 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:21.081249 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:21.081249 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:21.081249 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:21.081249 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:21.081249 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:21.081249 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:21.081249 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:21.081249 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:21.081249 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:21.082143 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:21.082143 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:21.082143 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:21.082143 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:21.082143 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:21.082143 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:21.082143 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:21.082143 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:21.082143 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:21.082143 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:21.082143 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:21.082143 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:21.082143 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:21.082143 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:21.082143 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:21.082143 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:21.082143 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:21.083038 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:21.083038 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:21.083038 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:21.083038 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:21.086291 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 272/544] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:21.091938 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25dd6fa-fc63-40c4-83ff-ac11ceac7808 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:21.134242 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae77ed-e5f4-4e83-9f9b-9e0bda3a9c52 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:21.189554 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:21.197284 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25dd6fa-fc63-40c4-83ff-ac11ceac7808 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:21.202880 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229902b-c540-4c5c-852f-da779566765b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:21.203563 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229902b-c540-4c5c-852f-da779566765b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:21.203852 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229902b-c540-4c5c-852f-da779566765b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:21.204131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229902b-c540-4c5c-852f-da779566765b None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:21.204934 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d229902b-c540-4c5c-852f-da779566765b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:21.205251 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d229902b-c540-4c5c-852f-da779566765b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:21.206757 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d229902b-c540-4c5c-852f-da779566765b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:21.232211 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 273/545] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Jul 4 03:58:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:21.233530 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d94121-0b92-401b-ac24-1d325230c2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:21.234234 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d94121-0b92-401b-ac24-1d325230c2c5 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:21.234526 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d94121-0b92-401b-ac24-1d325230c2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:21.234806 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d94121-0b92-401b-ac24-1d325230c2c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:21.235532 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d94121-0b92-401b-ac24-1d325230c2c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:21.235844 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d94121-0b92-401b-ac24-1d325230c2c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:21.237587 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d94121-0b92-401b-ac24-1d325230c2c5 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:21.239123 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229902b-c540-4c5c-852f-da779566765b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:21.251311 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 273/546] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:21.256606 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d94121-0b92-401b-ac24-1d325230c2c5 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:21.350635 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:21.358709 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229902b-c540-4c5c-852f-da779566765b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:21.360241 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d94121-0b92-401b-ac24-1d325230c2c5 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:21.393784 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5024d0-22ac-4206-89b4-c869c1642bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:21.394488 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5024d0-22ac-4206-89b4-c869c1642bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:21.394776 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5024d0-22ac-4206-89b4-c869c1642bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:21.395060 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5024d0-22ac-4206-89b4-c869c1642bf8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:21.395905 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5024d0-22ac-4206-89b4-c869c1642bf8 None admin] RBAC: Adding query filter params (role.id=7fd75ec0129248b28b5254e00d4f6f0b, scope.project.id=424a145a22434ef7a14b6108e6118ccb, user.id=b36a8402144c458fa98f80d7e3516127) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:21.396227 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5024d0-22ac-4206-89b4-c869c1642bf8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:21.397225 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c3ae0-5712-4d13-8bc1-ea5271381c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:21.397695 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5024d0-22ac-4206-89b4-c869c1642bf8 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:21.398127 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c3ae0-5712-4d13-8bc1-ea5271381c1f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:21.398454 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c3ae0-5712-4d13-8bc1-ea5271381c1f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:21.398770 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c3ae0-5712-4d13-8bc1-ea5271381c1f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:21.403692 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 274/547] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:58:21 2022] GET /identity/v3/role_assignments?user.id=b36a8402144c458fa98f80d7e3516127&scope.project.id=424a145a22434ef7a14b6108e6118ccb&role.id=7fd75ec0129248b28b5254e00d4f6f0b => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:21.406564 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c3ae0-5712-4d13-8bc1-ea5271381c1f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:21.408068 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c3ae0-5712-4d13-8bc1-ea5271381c1f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:21.424667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-0d9c3ae0-5712-4d13-8bc1-ea5271381c1f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 04 03:58:21.424667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:21.424667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:21.424667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:21.424667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:21.424667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:21.424667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:21.424667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:21.424667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:21.424667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:21.424667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:21.424667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:21.424667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 03:58:21.424667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 03:58:21.424667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 03:58:21.424667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 03:58:21.425634 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:21.425634 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:21.425634 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 03:58:21.425634 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:21.425634 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 03:58:21.425634 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:21.425634 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:21.425634 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:21.425634 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:21.425634 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:21.425634 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:21.425634 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:21.425634 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:21.425634 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:21.425634 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:21.425634 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:21.425634 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:21.425634 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:21.427137 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:21.427137 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:21.427137 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 03:58:21.427137 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 03:58:21.427137 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 03:58:21.427137 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 03:58:21.427137 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 03:58:21.427137 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 03:58:21.427137 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 04 03:58:21.427137 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:21.427137 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 274/548] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Jul 4 03:58:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:58:21.432335 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5024d0-22ac-4206-89b4-c869c1642bf8 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:21.502280 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0452c-813b-4888-aa08-98264feaad63 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:21.502602 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0452c-813b-4888-aa08-98264feaad63 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:21.502857 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0452c-813b-4888-aa08-98264feaad63 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:21.504598 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 275/549] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:21.514871 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a4315-b4a8-4600-9aec-b2169ea39ecd None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:21.515263 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a4315-b4a8-4600-9aec-b2169ea39ecd None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:21.515449 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a4315-b4a8-4600-9aec-b2169ea39ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:21.547409 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-ea4a4315-b4a8-4600-9aec-b2169ea39ecd None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:21.548715 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ea4a4315-b4a8-4600-9aec-b2169ea39ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:21.560563 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5024d0-22ac-4206-89b4-c869c1642bf8 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:21.570018 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:21.600448 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293f590-aee1-43b2-a9ce-a415afdbc2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:21.601256 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293f590-aee1-43b2-a9ce-a415afdbc2fe None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:21.601491 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293f590-aee1-43b2-a9ce-a415afdbc2fe None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:21.601775 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293f590-aee1-43b2-a9ce-a415afdbc2fe None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:21.602687 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293f590-aee1-43b2-a9ce-a415afdbc2fe None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:21.602973 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293f590-aee1-43b2-a9ce-a415afdbc2fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:21.604422 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293f590-aee1-43b2-a9ce-a415afdbc2fe None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:21.624738 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 275/550] 10.222.0.49 () {56 vars in 1135 bytes} [Mon Jul 4 03:58:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:21.625511 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:21.633239 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293f590-aee1-43b2-a9ce-a415afdbc2fe None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:21.682056 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 276/551] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:58:21.717640 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4a4315-b4a8-4600-9aec-b2169ea39ecd None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:21.782990 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293f590-aee1-43b2-a9ce-a415afdbc2fe None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:21.820563 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136098a-9702-4b48-a1b3-8d4a0f5df19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:21.821701 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136098a-9702-4b48-a1b3-8d4a0f5df19e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:21.822212 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136098a-9702-4b48-a1b3-8d4a0f5df19e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:21.822690 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136098a-9702-4b48-a1b3-8d4a0f5df19e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:21.849037 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4a4315-b4a8-4600-9aec-b2169ea39ecd None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:21.889781 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:21.897636 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136098a-9702-4b48-a1b3-8d4a0f5df19e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:21.899525 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136098a-9702-4b48-a1b3-8d4a0f5df19e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:21.910865 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598429f-c092-4a44-9dc9-17d70fc271bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:21.911916 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598429f-c092-4a44-9dc9-17d70fc271bc None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:21.912027 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598429f-c092-4a44-9dc9-17d70fc271bc None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:21.912270 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598429f-c092-4a44-9dc9-17d70fc271bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:21.923306 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1598429f-c092-4a44-9dc9-17d70fc271bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:58:21.931133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-1598429f-c092-4a44-9dc9-17d70fc271bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 03:58:21.931133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:21.931133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:21.931133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:21.931133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:21.931133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:21.931133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:21.931133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:21.931133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:21.931133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:21.931133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:21.931133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:21.931133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:58:21.931133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:58:21.931133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:58:21.931133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:58:21.932084 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:58:21.932084 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:58:21.932084 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:58:21.932084 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:58:21.932084 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:21.932084 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:21.932084 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:21.932084 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:21.932084 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:21.932084 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:21.932084 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:21.932084 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:21.932084 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:21.932084 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:21.932084 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:21.932084 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:21.933032 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:21.933032 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:21.933032 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:21.933032 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:21.933032 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:58:21.933032 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:58:21.933032 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:58:21.933032 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:58:21.933032 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:58:21.933032 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:58:21.933032 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 03:58:21.933032 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:21.933032 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 277/552] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Jul 4 03:58:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:58:21.938268 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598429f-c092-4a44-9dc9-17d70fc271bc None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:21.942860 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:22.053361 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 276/553] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:58:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 04 03:58:22.059620 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136098a-9702-4b48-a1b3-8d4a0f5df19e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:22.118898 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598429f-c092-4a44-9dc9-17d70fc271bc None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:22.163389 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26945642-e688-4bb8-8685-643b7b5511c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:22.164422 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26945642-e688-4bb8-8685-643b7b5511c9 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:22.164786 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26945642-e688-4bb8-8685-643b7b5511c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:22.165139 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26945642-e688-4bb8-8685-643b7b5511c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:22.165971 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26945642-e688-4bb8-8685-643b7b5511c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:22.166386 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26945642-e688-4bb8-8685-643b7b5511c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:22.166810 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:22.167954 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26945642-e688-4bb8-8685-643b7b5511c9 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:22.172295 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136098a-9702-4b48-a1b3-8d4a0f5df19e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:22.177277 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 278/554] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Jul 4 03:58:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:22.178687 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511cd8e-fe19-4765-8869-b137085eafb6 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:22.179054 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511cd8e-fe19-4765-8869-b137085eafb6 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:22.179437 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511cd8e-fe19-4765-8869-b137085eafb6 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:22.180899 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 279/555] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:22.185714 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6511cd8e-fe19-4765-8869-b137085eafb6 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:22.222839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1f1f1-77f6-4ea0-b2d3-d859b7936ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:22.223645 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1f1f1-77f6-4ea0-b2d3-d859b7936ca4 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:22.223931 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1f1f1-77f6-4ea0-b2d3-d859b7936ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:22.224211 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1f1f1-77f6-4ea0-b2d3-d859b7936ca4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:22.239855 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1f1f1-77f6-4ea0-b2d3-d859b7936ca4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:22.241933 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1f1f1-77f6-4ea0-b2d3-d859b7936ca4 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:22.265344 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-90e1f1f1-77f6-4ea0-b2d3-d859b7936ca4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:22.265344 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:22.265344 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:22.265344 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:22.265344 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:22.265344 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:22.265344 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:22.265344 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:22.265344 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:22.265344 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:22.265344 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:22.265344 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:22.265344 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:22.265344 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:22.265344 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:22.266490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:22.266490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:22.266490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:22.266490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:22.266490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:22.266490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:22.266490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:22.266490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:22.266490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:22.266490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:22.266490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:22.266490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:22.266490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:22.266490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:22.266490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:22.266490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:22.266490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:22.267598 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:22.267598 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:22.267598 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:22.267598 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:22.270251 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 277/556] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:22.270571 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:22.271655 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9da10-6366-4907-a4fa-7a403ade35c4 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:22.271840 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9da10-6366-4907-a4fa-7a403ade35c4 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:22.272123 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9da10-6366-4907-a4fa-7a403ade35c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:22.294762 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-b8e9da10-6366-4907-a4fa-7a403ade35c4 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:22.295965 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b8e9da10-6366-4907-a4fa-7a403ade35c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:22.312623 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6511cd8e-fe19-4765-8869-b137085eafb6 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:22.359016 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989fc69-dc27-4e6a-9f35-27e4baeb110e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:22.360092 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989fc69-dc27-4e6a-9f35-27e4baeb110e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:22.360380 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989fc69-dc27-4e6a-9f35-27e4baeb110e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:22.360901 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989fc69-dc27-4e6a-9f35-27e4baeb110e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:22.366266 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 278/557] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:58:22.370944 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9da10-6366-4907-a4fa-7a403ade35c4 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:22.374900 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2989fc69-dc27-4e6a-9f35-27e4baeb110e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:22.376411 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2989fc69-dc27-4e6a-9f35-27e4baeb110e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:22.397077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-2989fc69-dc27-4e6a-9f35-27e4baeb110e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:22.397077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:22.397077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:22.397077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:22.397077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:22.397077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:22.397077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:22.397077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:22.397077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:22.397077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:22.397077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:22.397077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:22.397077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:22.397077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:22.397077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:22.398550 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:22.398550 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:22.398550 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:22.398550 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:22.398550 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:22.398550 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:22.398550 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:22.398550 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:22.398550 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:22.398550 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:22.398550 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:22.398550 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:22.398550 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:22.398550 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:22.398550 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:22.398550 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:22.398550 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:22.399441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:22.399441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:22.399441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:22.399441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:22.399441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 280/558] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:22.405190 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989fc69-dc27-4e6a-9f35-27e4baeb110e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:22.472088 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:22.498335 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9da10-6366-4907-a4fa-7a403ade35c4 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:22.527488 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989fc69-dc27-4e6a-9f35-27e4baeb110e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:22.535353 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0267b9e-f4f0-4fe4-bd61-58b29f49c0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:22.536027 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0267b9e-f4f0-4fe4-bd61-58b29f49c0cf None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:22.536663 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0267b9e-f4f0-4fe4-bd61-58b29f49c0cf None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:22.536964 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0267b9e-f4f0-4fe4-bd61-58b29f49c0cf None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:22.537698 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0267b9e-f4f0-4fe4-bd61-58b29f49c0cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:22.538337 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0267b9e-f4f0-4fe4-bd61-58b29f49c0cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:22.539772 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0267b9e-f4f0-4fe4-bd61-58b29f49c0cf None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:22.544963 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:22.556013 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 279/559] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:22.556778 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0267b9e-f4f0-4fe4-bd61-58b29f49c0cf None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:22.565159 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ed9d7-17f4-4045-b85d-a1b7da403e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:22.566300 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ed9d7-17f4-4045-b85d-a1b7da403e02 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:22.566568 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ed9d7-17f4-4045-b85d-a1b7da403e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:22.566867 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ed9d7-17f4-4045-b85d-a1b7da403e02 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:22.567962 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ed9d7-17f4-4045-b85d-a1b7da403e02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:22.568278 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ed9d7-17f4-4045-b85d-a1b7da403e02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:22.570360 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ed9d7-17f4-4045-b85d-a1b7da403e02 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:22.586853 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 281/560] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:22.588456 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a3a85-68de-4251-aa56-0968d4af8b90 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:22.588750 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a3a85-68de-4251-aa56-0968d4af8b90 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:22.589030 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a3a85-68de-4251-aa56-0968d4af8b90 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:22.592596 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 282/561] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:22.592596 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a3a85-68de-4251-aa56-0968d4af8b90 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:22.660255 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0267b9e-f4f0-4fe4-bd61-58b29f49c0cf None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:22.695582 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d4773-cc5b-45d7-a5f4-82de6036572b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:22.696398 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d4773-cc5b-45d7-a5f4-82de6036572b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:22.696674 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d4773-cc5b-45d7-a5f4-82de6036572b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:22.696956 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d4773-cc5b-45d7-a5f4-82de6036572b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:22.702768 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a3a85-68de-4251-aa56-0968d4af8b90 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:22.704304 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:22.709093 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d4773-cc5b-45d7-a5f4-82de6036572b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:58:22.717253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-eb6d4773-cc5b-45d7-a5f4-82de6036572b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 03:58:22.717253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:22.717253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:22.717253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:22.717253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:22.717253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:22.717253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:22.717253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:22.717253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:22.717253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:22.717253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:22.717253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:22.717253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:58:22.717253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:58:22.717253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:58:22.717253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:58:22.718489 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:58:22.718489 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:58:22.718489 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:58:22.718489 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:58:22.718489 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:22.718489 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:22.718489 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:22.718489 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:22.718489 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:22.718489 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:22.718489 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:22.718489 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:22.718489 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:22.718489 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:22.718489 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:22.718489 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:22.724418 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:22.724418 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:22.724418 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:22.724418 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:22.724418 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:58:22.724418 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:58:22.724418 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:58:22.724418 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:58:22.724418 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:58:22.724418 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:58:22.724418 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 03:58:22.724418 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:22.724418 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 280/562] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Jul 4 03:58:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:22.724418 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d4773-cc5b-45d7-a5f4-82de6036572b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:22.746303 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ad59f-24d8-4bfb-bd16-862111f1c81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:22.747113 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ad59f-24d8-4bfb-bd16-862111f1c81b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:22.747457 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ad59f-24d8-4bfb-bd16-862111f1c81b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:22.747741 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ad59f-24d8-4bfb-bd16-862111f1c81b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:22.755291 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ad59f-24d8-4bfb-bd16-862111f1c81b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:22.756800 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ad59f-24d8-4bfb-bd16-862111f1c81b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:22.772497 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-899ad59f-24d8-4bfb-bd16-862111f1c81b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:22.772497 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:22.772497 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:22.772497 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:22.772497 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:22.772497 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:22.772497 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:22.772497 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:22.772497 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:22.772497 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:22.772497 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:22.772497 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:22.772497 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 03:58:22.772497 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 03:58:22.772497 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 03:58:22.773820 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 03:58:22.773820 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:22.773820 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:22.773820 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:22.773820 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:22.773820 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:22.773820 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:22.773820 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:22.773820 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:22.773820 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:22.773820 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:22.773820 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:22.773820 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:22.773820 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:22.773820 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:22.773820 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:22.773820 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:22.774968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 03:58:22.774968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 03:58:22.774968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 03:58:22.774968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 03:58:22.774968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 03:58:22.774968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 03:58:22.774968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:22.774968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:22.774968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 283/563] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:58:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:22.775457 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da9e4e-1c2e-46d8-9fea-9d09174f3497 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:22.775648 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da9e4e-1c2e-46d8-9fea-9d09174f3497 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:22.775930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da9e4e-1c2e-46d8-9fea-9d09174f3497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:22.792667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-86da9e4e-1c2e-46d8-9fea-9d09174f3497 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:22.793859 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-86da9e4e-1c2e-46d8-9fea-9d09174f3497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:22.827195 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:22.839368 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d4773-cc5b-45d7-a5f4-82de6036572b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:22.878205 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 284/564] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:58:22.878205 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da9e4e-1c2e-46d8-9fea-9d09174f3497 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:22.887212 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc8585-e683-412e-9d5e-378b9ef89870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:22.888132 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc8585-e683-412e-9d5e-378b9ef89870 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:22.888416 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc8585-e683-412e-9d5e-378b9ef89870 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:22.888694 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc8585-e683-412e-9d5e-378b9ef89870 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:22.896749 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc8585-e683-412e-9d5e-378b9ef89870 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:22.898666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc8585-e683-412e-9d5e-378b9ef89870 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:22.915666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-facc8585-e683-412e-9d5e-378b9ef89870 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 03:58:22.915666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:22.915666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:22.915666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:22.915666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:22.915666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:22.915666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:22.915666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:22.915666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:22.915666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:22.915666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:22.915666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:22.915666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 03:58:22.915666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 03:58:22.915666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 03:58:22.915666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 03:58:22.916843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:22.916843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:22.916843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 03:58:22.916843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:22.916843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 03:58:22.916843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:22.916843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:22.916843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:22.916843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:22.916843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:22.916843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:22.916843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:22.916843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:22.916843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:22.916843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:22.916843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:22.916843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:22.916843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:22.918017 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:22.918017 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:22.918017 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 03:58:22.918017 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 03:58:22.918017 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 03:58:22.918017 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 03:58:22.918017 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 03:58:22.918017 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 03:58:22.918017 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 03:58:22.918017 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:22.918017 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 281/565] 10.222.0.49 () {56 vars in 1093 bytes} [Mon Jul 4 03:58:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:22.918017 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc8585-e683-412e-9d5e-378b9ef89870 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:22.979336 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:22.991521 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da9e4e-1c2e-46d8-9fea-9d09174f3497 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:23.025325 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc8585-e683-412e-9d5e-378b9ef89870 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:23.026070 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f99368-1080-4f65-90a8-1c34cf3881ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:23.026844 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f99368-1080-4f65-90a8-1c34cf3881ec None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:23.027139 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f99368-1080-4f65-90a8-1c34cf3881ec None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:23.027421 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f99368-1080-4f65-90a8-1c34cf3881ec None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:23.028180 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f99368-1080-4f65-90a8-1c34cf3881ec None admin] RBAC: Adding query filter params (name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:23.028493 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f99368-1080-4f65-90a8-1c34cf3881ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:23.029895 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f99368-1080-4f65-90a8-1c34cf3881ec None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:23.037827 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 285/566] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Jul 4 03:58:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:23.038711 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f99368-1080-4f65-90a8-1c34cf3881ec None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:23.067385 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c345c-5d41-4069-a7d3-e7f4a2c1a92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:23.068169 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c345c-5d41-4069-a7d3-e7f4a2c1a92e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:23.068542 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c345c-5d41-4069-a7d3-e7f4a2c1a92e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:23.068932 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c345c-5d41-4069-a7d3-e7f4a2c1a92e None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:23.069697 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:23.070678 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c345c-5d41-4069-a7d3-e7f4a2c1a92e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:23.071069 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c345c-5d41-4069-a7d3-e7f4a2c1a92e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:23.072633 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c345c-5d41-4069-a7d3-e7f4a2c1a92e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:23.090790 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 282/567] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Jul 4 03:58:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:23.090790 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c345c-5d41-4069-a7d3-e7f4a2c1a92e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:23.151787 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f99368-1080-4f65-90a8-1c34cf3881ec None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:23.187395 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac97f0c-4a9c-4c23-9b3d-22f9fe5fdb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:23.187606 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c345c-5d41-4069-a7d3-e7f4a2c1a92e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:23.188209 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac97f0c-4a9c-4c23-9b3d-22f9fe5fdb28 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:23.188493 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac97f0c-4a9c-4c23-9b3d-22f9fe5fdb28 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:23.188773 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac97f0c-4a9c-4c23-9b3d-22f9fe5fdb28 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:23.200174 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac97f0c-4a9c-4c23-9b3d-22f9fe5fdb28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:58:23.205393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:23.210919 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-9ac97f0c-4a9c-4c23-9b3d-22f9fe5fdb28 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 03:58:23.210919 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:23.210919 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:23.210919 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:23.210919 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:23.210919 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:23.210919 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:23.210919 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:23.210919 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:23.210919 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:23.210919 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:23.210919 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:23.210919 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:58:23.210919 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:58:23.210919 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:58:23.210919 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:58:23.211934 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:58:23.211934 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:58:23.211934 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:58:23.211934 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:58:23.211934 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:23.211934 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:23.211934 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:23.211934 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:23.211934 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:23.211934 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:23.211934 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:23.211934 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:23.211934 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:23.211934 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:23.211934 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:23.211934 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:23.218103 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:23.218103 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:23.218103 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:23.218103 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:23.218103 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:58:23.218103 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:58:23.218103 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:58:23.218103 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:58:23.218103 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:58:23.218103 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:58:23.218103 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 03:58:23.218103 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:23.218103 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 286/568] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Jul 4 03:58:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:23.218103 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac97f0c-4a9c-4c23-9b3d-22f9fe5fdb28 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:23.222986 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a9b7d-ba6a-40cc-94c7-19ebdbb15e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:23.223672 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a9b7d-ba6a-40cc-94c7-19ebdbb15e87 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:23.223963 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a9b7d-ba6a-40cc-94c7-19ebdbb15e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:23.224248 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a9b7d-ba6a-40cc-94c7-19ebdbb15e87 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:23.225100 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a9b7d-ba6a-40cc-94c7-19ebdbb15e87 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:23.225420 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a9b7d-ba6a-40cc-94c7-19ebdbb15e87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:23.227263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a9b7d-ba6a-40cc-94c7-19ebdbb15e87 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:23.245697 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 283/569] 10.222.0.49 () {56 vars in 1133 bytes} [Mon Jul 4 03:58:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:23.246504 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a9b7d-ba6a-40cc-94c7-19ebdbb15e87 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:23.323757 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:23.335038 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac97f0c-4a9c-4c23-9b3d-22f9fe5fdb28 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:23.367115 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a9b7d-ba6a-40cc-94c7-19ebdbb15e87 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:23.378120 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bbe30-4c68-44b4-aa9f-d268ad5fa5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:23.378963 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bbe30-4c68-44b4-aa9f-d268ad5fa5b5 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:23.379253 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bbe30-4c68-44b4-aa9f-d268ad5fa5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:23.379534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bbe30-4c68-44b4-aa9f-d268ad5fa5b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:23.390912 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1bbe30-4c68-44b4-aa9f-d268ad5fa5b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:23.392414 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1bbe30-4c68-44b4-aa9f-d268ad5fa5b5 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:23.403074 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a2d3c-defe-4c49-bc8a-ee2bf3cee864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:23.403962 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a2d3c-defe-4c49-bc8a-ee2bf3cee864 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:23.404423 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a2d3c-defe-4c49-bc8a-ee2bf3cee864 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:23.404876 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a2d3c-defe-4c49-bc8a-ee2bf3cee864 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:23.405917 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a2d3c-defe-4c49-bc8a-ee2bf3cee864 None admin] RBAC: Adding query filter params (role.id=7fd75ec0129248b28b5254e00d4f6f0b, scope.project.id=424a145a22434ef7a14b6108e6118ccb, user.id=24f93fdc98ff425791da3e2194b3a671) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:23.406444 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a2d3c-defe-4c49-bc8a-ee2bf3cee864 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:23.408062 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a2d3c-defe-4c49-bc8a-ee2bf3cee864 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:23.409676 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-bd1bbe30-4c68-44b4-aa9f-d268ad5fa5b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:23.409676 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:23.409676 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:23.409676 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:23.409676 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:23.409676 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:23.409676 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:23.409676 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:23.409676 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:23.409676 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:23.409676 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:23.409676 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:23.409676 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:23.409676 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:23.409676 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:23.410625 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:23.410625 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:23.410625 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:23.410625 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:23.410625 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:23.410625 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:23.410625 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:23.410625 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:23.410625 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:23.410625 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:23.410625 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:23.410625 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:23.410625 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:23.410625 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:23.410625 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:23.410625 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:23.410625 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:23.411528 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:23.411528 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:23.411528 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:23.411528 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:23.414297 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 287/570] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:23.415202 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 284/571] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:58:23 2022] GET /identity/v3/role_assignments?user.id=24f93fdc98ff425791da3e2194b3a671&scope.project.id=424a145a22434ef7a14b6108e6118ccb&role.id=7fd75ec0129248b28b5254e00d4f6f0b => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:23.415533 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bbe30-4c68-44b4-aa9f-d268ad5fa5b5 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:23.416068 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a2d3c-defe-4c49-bc8a-ee2bf3cee864 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:23.480877 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:23.553254 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bbe30-4c68-44b4-aa9f-d268ad5fa5b5 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:23.559153 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a2d3c-defe-4c49-bc8a-ee2bf3cee864 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:23.599873 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebeddae-1637-4250-83d4-e75051a6abb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:23.600919 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebeddae-1637-4250-83d4-e75051a6abb5 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:23.601937 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebeddae-1637-4250-83d4-e75051a6abb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:23.602574 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebeddae-1637-4250-83d4-e75051a6abb5 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:23.603507 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebeddae-1637-4250-83d4-e75051a6abb5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:23.603907 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebeddae-1637-4250-83d4-e75051a6abb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:23.604654 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8be2d-1082-41ba-9288-d5c481e1298c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:23.605318 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebeddae-1637-4250-83d4-e75051a6abb5 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:23.605912 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8be2d-1082-41ba-9288-d5c481e1298c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:23.606434 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8be2d-1082-41ba-9288-d5c481e1298c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:23.606903 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8be2d-1082-41ba-9288-d5c481e1298c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:23.618233 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 288/572] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Jul 4 03:58:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:23.619440 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebeddae-1637-4250-83d4-e75051a6abb5 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:23.624945 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8be2d-1082-41ba-9288-d5c481e1298c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:23.626990 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:23.628425 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8be2d-1082-41ba-9288-d5c481e1298c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:23.652582 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-ded8be2d-1082-41ba-9288-d5c481e1298c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:23.652582 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:23.652582 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:23.652582 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:23.652582 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:23.652582 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:23.652582 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:23.652582 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:23.652582 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:23.652582 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:23.652582 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:23.652582 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:23.652582 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:23.652582 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:23.652582 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:23.653577 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:23.653577 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:23.653577 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:23.653577 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:23.653577 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:23.653577 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:23.653577 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:23.653577 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:23.653577 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:23.653577 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:23.653577 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:23.653577 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:23.653577 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:23.653577 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:23.653577 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:23.653577 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:23.653577 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:23.654868 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:23.654868 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:23.654868 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:23.654868 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:23.658221 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 285/573] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:23.659325 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8be2d-1082-41ba-9288-d5c481e1298c None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:23.736303 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebeddae-1637-4250-83d4-e75051a6abb5 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:23.764781 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:23.773614 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61b9f9-5d7e-43d4-9593-f39c46eea3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:23.774018 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8be2d-1082-41ba-9288-d5c481e1298c None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:23.774840 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61b9f9-5d7e-43d4-9593-f39c46eea3f2 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:23.775318 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61b9f9-5d7e-43d4-9593-f39c46eea3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:23.775768 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61b9f9-5d7e-43d4-9593-f39c46eea3f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:23.776677 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61b9f9-5d7e-43d4-9593-f39c46eea3f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:23.776990 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61b9f9-5d7e-43d4-9593-f39c46eea3f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:23.778409 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61b9f9-5d7e-43d4-9593-f39c46eea3f2 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:23.794756 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 289/574] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:23.794756 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61b9f9-5d7e-43d4-9593-f39c46eea3f2 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:23.814085 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032480e-2c45-47b9-bce0-3b6146de6b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:23.814932 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032480e-2c45-47b9-bce0-3b6146de6b1a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:23.815288 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032480e-2c45-47b9-bce0-3b6146de6b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:23.815576 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032480e-2c45-47b9-bce0-3b6146de6b1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:23.826457 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032480e-2c45-47b9-bce0-3b6146de6b1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:23.827917 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032480e-2c45-47b9-bce0-3b6146de6b1a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:23.844964 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-e032480e-2c45-47b9-bce0-3b6146de6b1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:23.844964 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:23.844964 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:23.844964 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:23.844964 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:23.844964 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:23.844964 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:23.844964 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:23.844964 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:23.844964 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:23.844964 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:23.844964 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:23.844964 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:23.844964 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:23.844964 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:23.845864 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:23.845864 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:23.845864 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:23.845864 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:23.845864 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:23.845864 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:23.845864 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:23.845864 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:23.845864 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:23.845864 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:23.845864 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:23.845864 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:23.845864 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:23.845864 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:23.845864 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:23.845864 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:23.845864 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:23.846835 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:23.846835 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:23.846835 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:23.846835 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:23.846835 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 286/575] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:23.847451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576fbab9-5cd1-4e90-9bc2-52d07f40447b None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:23.847712 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576fbab9-5cd1-4e90-9bc2-52d07f40447b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:23.847990 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576fbab9-5cd1-4e90-9bc2-52d07f40447b None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:23.853116 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 287/576] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:23.853116 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576fbab9-5cd1-4e90-9bc2-52d07f40447b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:23.861400 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:23.907863 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61b9f9-5d7e-43d4-9593-f39c46eea3f2 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:23.943917 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e3c48-9446-4628-ba12-4925bcebcca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:23.944578 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e3c48-9446-4628-ba12-4925bcebcca2 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:23.945007 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e3c48-9446-4628-ba12-4925bcebcca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:23.945292 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e3c48-9446-4628-ba12-4925bcebcca2 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:23.946013 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e3c48-9446-4628-ba12-4925bcebcca2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:23.946348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e3c48-9446-4628-ba12-4925bcebcca2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:23.947943 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e3c48-9446-4628-ba12-4925bcebcca2 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:23.960045 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576fbab9-5cd1-4e90-9bc2-52d07f40447b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:23.964402 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 290/577] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:23.965335 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e3c48-9446-4628-ba12-4925bcebcca2 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:24.002621 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d892013-c815-4641-aa20-4f0f1b2a2486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:24.003433 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d892013-c815-4641-aa20-4f0f1b2a2486 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:24.003715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d892013-c815-4641-aa20-4f0f1b2a2486 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:24.003992 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d892013-c815-4641-aa20-4f0f1b2a2486 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:24.012977 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d892013-c815-4641-aa20-4f0f1b2a2486 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:24.014819 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d892013-c815-4641-aa20-4f0f1b2a2486 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:24.029685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-0d892013-c815-4641-aa20-4f0f1b2a2486 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 04 03:58:24.029685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:24.029685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:24.029685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:24.029685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:24.029685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:24.029685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:24.029685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:24.029685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:24.029685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:24.029685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:24.029685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:24.029685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 03:58:24.029685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 03:58:24.029685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 03:58:24.029685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 03:58:24.030925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:24.030925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:24.030925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 03:58:24.030925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:24.030925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 03:58:24.030925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:24.030925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:24.030925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:24.030925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:24.030925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:24.030925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:24.030925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:24.030925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:24.030925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:24.030925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:24.030925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:24.030925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:24.030925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:24.036672 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:24.036672 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:24.036672 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 03:58:24.036672 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 03:58:24.036672 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 03:58:24.036672 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 03:58:24.036672 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 03:58:24.036672 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 03:58:24.036672 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 04 03:58:24.036672 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:24.036672 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 288/578] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:58:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:24.036672 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036aad3-8dbc-4b6f-a82c-04cfa038f918 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:24.036672 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036aad3-8dbc-4b6f-a82c-04cfa038f918 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:24.037544 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036aad3-8dbc-4b6f-a82c-04cfa038f918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:24.039720 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:24.050585 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-0036aad3-8dbc-4b6f-a82c-04cfa038f918 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:24.051791 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0036aad3-8dbc-4b6f-a82c-04cfa038f918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:24.082080 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e3c48-9446-4628-ba12-4925bcebcca2 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:24.107185 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:24.119931 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 289/579] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:58:24.120075 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e92c5-b173-4bf0-a62e-507116990a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:24.120788 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e92c5-b173-4bf0-a62e-507116990a47 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:24.121193 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e92c5-b173-4bf0-a62e-507116990a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:24.121525 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036aad3-8dbc-4b6f-a82c-04cfa038f918 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:24.121629 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e92c5-b173-4bf0-a62e-507116990a47 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:24.122366 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e92c5-b173-4bf0-a62e-507116990a47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:24.122737 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e92c5-b173-4bf0-a62e-507116990a47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:24.124204 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e92c5-b173-4bf0-a62e-507116990a47 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:24.143758 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 291/580] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:24.144910 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e92c5-b173-4bf0-a62e-507116990a47 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:24.232390 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036aad3-8dbc-4b6f-a82c-04cfa038f918 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:24.248201 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e92c5-b173-4bf0-a62e-507116990a47 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:24.266982 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db90c9-6f0b-4138-812a-7acd4e0ce7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:24.267770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db90c9-6f0b-4138-812a-7acd4e0ce7ec None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:24.268067 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db90c9-6f0b-4138-812a-7acd4e0ce7ec None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:24.268340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db90c9-6f0b-4138-812a-7acd4e0ce7ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:24.270293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:24.275681 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db90c9-6f0b-4138-812a-7acd4e0ce7ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:24.277409 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db90c9-6f0b-4138-812a-7acd4e0ce7ec None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:24.286858 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10744f07-67e7-4bb5-95fc-d74ebbb4607b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:24.287537 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10744f07-67e7-4bb5-95fc-d74ebbb4607b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:24.287874 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10744f07-67e7-4bb5-95fc-d74ebbb4607b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:24.288147 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10744f07-67e7-4bb5-95fc-d74ebbb4607b None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:24.289068 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10744f07-67e7-4bb5-95fc-d74ebbb4607b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:24.289379 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10744f07-67e7-4bb5-95fc-d74ebbb4607b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:24.290904 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10744f07-67e7-4bb5-95fc-d74ebbb4607b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:24.291243 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-b4db90c9-6f0b-4138-812a-7acd4e0ce7ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:24.291243 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:24.291243 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:24.291243 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:24.291243 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:24.291243 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:24.291243 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:24.291243 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:24.291243 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:24.291243 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:24.291243 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:24.291243 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:24.291243 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 03:58:24.291243 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 03:58:24.291243 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 03:58:24.292161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 03:58:24.292161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:24.292161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:24.292161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:24.292161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:24.292161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:24.292161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:24.292161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:24.292161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:24.292161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:24.292161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:24.292161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:24.292161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:24.292161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:24.292161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:24.292161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:24.292161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:24.293048 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 03:58:24.293048 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 03:58:24.293048 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 03:58:24.293048 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 03:58:24.293048 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 03:58:24.293048 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 03:58:24.293048 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:24.293048 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:24.293048 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 290/581] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:58:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:24.293536 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db90c9-6f0b-4138-812a-7acd4e0ce7ec None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:24.314928 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 292/582] 10.222.0.49 () {56 vars in 1137 bytes} [Mon Jul 4 03:58:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:24.315977 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10744f07-67e7-4bb5-95fc-d74ebbb4607b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:24.360628 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:24.406598 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db90c9-6f0b-4138-812a-7acd4e0ce7ec None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:24.419158 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10744f07-67e7-4bb5-95fc-d74ebbb4607b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:24.442666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13e1af-2438-4759-b751-2f37c22a8db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:24.443474 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13e1af-2438-4759-b751-2f37c22a8db7 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:24.443765 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13e1af-2438-4759-b751-2f37c22a8db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:24.444046 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13e1af-2438-4759-b751-2f37c22a8db7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:24.454748 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa410cf-7455-4cbe-81e9-a392c79b2470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:24.455521 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa410cf-7455-4cbe-81e9-a392c79b2470 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:24.455640 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13e1af-2438-4759-b751-2f37c22a8db7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:58:24.455828 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa410cf-7455-4cbe-81e9-a392c79b2470 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:24.456083 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa410cf-7455-4cbe-81e9-a392c79b2470 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:24.463684 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-4a13e1af-2438-4759-b751-2f37c22a8db7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 03:58:24.463684 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:24.463684 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:24.463684 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:24.463684 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:24.463684 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:24.463684 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:24.463684 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:24.463684 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:24.463684 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:24.463684 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:24.463684 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:24.463684 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:58:24.463684 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:58:24.463684 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:58:24.463684 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:58:24.464592 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:58:24.464592 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:58:24.464592 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:58:24.464592 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:58:24.464592 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:24.464592 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:24.464592 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:24.464592 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:24.464592 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:24.464592 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:24.464592 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:24.464592 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:24.464592 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:24.464592 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:24.464592 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:24.464592 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:24.465433 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:24.465433 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:24.465433 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:24.465433 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:24.465433 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:58:24.465433 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:58:24.465433 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:58:24.465433 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:58:24.465433 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:58:24.465433 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:58:24.465433 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 03:58:24.465433 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:24.466057 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa410cf-7455-4cbe-81e9-a392c79b2470 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:24.466057 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa410cf-7455-4cbe-81e9-a392c79b2470 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:24.469869 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 291/583] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Jul 4 03:58:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:24.470743 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13e1af-2438-4759-b751-2f37c22a8db7 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:24.481395 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-afa410cf-7455-4cbe-81e9-a392c79b2470 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 04 03:58:24.481395 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:24.481395 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:24.481395 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:24.481395 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:24.481395 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:24.481395 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:24.481395 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:24.481395 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:24.481395 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:24.481395 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:24.481395 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:24.481395 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 03:58:24.481395 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 03:58:24.481395 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 03:58:24.481395 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 03:58:24.482626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:24.482626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:24.482626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 03:58:24.482626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:24.482626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 03:58:24.482626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:24.482626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:24.482626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:24.482626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:24.482626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:24.482626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:24.482626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:24.482626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:24.482626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:24.482626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:24.482626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:24.482626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:24.482626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:24.483553 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:24.483553 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:24.483553 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 03:58:24.483553 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 03:58:24.483553 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 03:58:24.483553 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 03:58:24.483553 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 03:58:24.483553 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 03:58:24.483553 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 04 03:58:24.483553 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:24.483553 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 293/584] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:58:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:24.483553 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa410cf-7455-4cbe-81e9-a392c79b2470 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:24.538901 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:24.586984 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13e1af-2438-4759-b751-2f37c22a8db7 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:24.588548 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa410cf-7455-4cbe-81e9-a392c79b2470 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:24.590085 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:24.623299 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e94fe1-8e73-4871-a7ae-404635cdb8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:24.623488 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a435f-7c17-41d4-af30-802ffcec57aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:24.623884 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a435f-7c17-41d4-af30-802ffcec57aa None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:24.624052 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e94fe1-8e73-4871-a7ae-404635cdb8ca None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:24.624206 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a435f-7c17-41d4-af30-802ffcec57aa None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:24.624309 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e94fe1-8e73-4871-a7ae-404635cdb8ca None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:24.624456 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a435f-7c17-41d4-af30-802ffcec57aa None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:24.624547 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e94fe1-8e73-4871-a7ae-404635cdb8ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:24.625218 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a435f-7c17-41d4-af30-802ffcec57aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:24.625527 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a435f-7c17-41d4-af30-802ffcec57aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:24.627128 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a435f-7c17-41d4-af30-802ffcec57aa None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:24.634892 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e94fe1-8e73-4871-a7ae-404635cdb8ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:24.636671 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e94fe1-8e73-4871-a7ae-404635cdb8ca None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:24.644740 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 292/585] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Jul 4 03:58:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:24.645859 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a435f-7c17-41d4-af30-802ffcec57aa None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:24.654403 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-b5e94fe1-8e73-4871-a7ae-404635cdb8ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:24.654403 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:24.654403 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:24.654403 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:24.654403 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:24.654403 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:24.654403 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:24.654403 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:24.654403 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:24.654403 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:24.654403 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:24.654403 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:24.654403 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:24.654403 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:24.654403 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:24.655434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:24.655434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:24.655434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:24.655434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:24.655434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:24.655434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:24.655434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:24.655434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:24.655434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:24.655434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:24.655434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:24.655434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:24.655434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:24.655434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:24.655434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:24.655434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:24.655434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:24.656361 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:24.656361 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:24.656361 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:24.656361 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:24.656361 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 294/586] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:24.656361 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e94fe1-8e73-4871-a7ae-404635cdb8ca None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:24.755648 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a435f-7c17-41d4-af30-802ffcec57aa None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:24.761556 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e94fe1-8e73-4871-a7ae-404635cdb8ca None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:24.770641 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:24.793726 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138387a-5d37-494c-b656-b0b54b925389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:24.794420 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138387a-5d37-494c-b656-b0b54b925389 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:24.794703 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138387a-5d37-494c-b656-b0b54b925389 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:24.794980 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138387a-5d37-494c-b656-b0b54b925389 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:24.795725 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138387a-5d37-494c-b656-b0b54b925389 None admin] RBAC: Adding query filter params (name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:24.796030 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138387a-5d37-494c-b656-b0b54b925389 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:24.796127 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26e339-da29-49d6-944d-4fbd3dc1191c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:24.796737 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26e339-da29-49d6-944d-4fbd3dc1191c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:24.797024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26e339-da29-49d6-944d-4fbd3dc1191c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:24.797300 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26e339-da29-49d6-944d-4fbd3dc1191c None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:24.797393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138387a-5d37-494c-b656-b0b54b925389 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:24.798137 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26e339-da29-49d6-944d-4fbd3dc1191c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:24.798468 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26e339-da29-49d6-944d-4fbd3dc1191c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:24.799931 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26e339-da29-49d6-944d-4fbd3dc1191c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:24.811014 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 293/587] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Jul 4 03:58:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:24.811676 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138387a-5d37-494c-b656-b0b54b925389 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:24.821282 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 295/588] 10.222.0.49 () {56 vars in 1137 bytes} [Mon Jul 4 03:58:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:24.822465 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26e339-da29-49d6-944d-4fbd3dc1191c None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:24.839654 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:24.922417 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138387a-5d37-494c-b656-b0b54b925389 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:24.939261 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26e339-da29-49d6-944d-4fbd3dc1191c None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:24.957485 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e60cc-65bf-401d-9408-96d7d4e1b035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:24.958524 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e60cc-65bf-401d-9408-96d7d4e1b035 None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:24.958877 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e60cc-65bf-401d-9408-96d7d4e1b035 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:24.959228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e60cc-65bf-401d-9408-96d7d4e1b035 None admin] PATH_INFO: `/v3/projects/424a145a22434ef7a14b6108e6118ccb/users/8334e75253f843a980b01c6f0cda6015/roles/7fd75ec0129248b28b5254e00d4f6f0b` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:24.977786 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e60cc-65bf-401d-9408-96d7d4e1b035 None admin] RBAC: Authorizing `identity:create_grant(project_id=424a145a22434ef7a14b6108e6118ccb, user_id=8334e75253f843a980b01c6f0cda6015, role_id=7fd75ec0129248b28b5254e00d4f6f0b)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:24.979361 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e60cc-65bf-401d-9408-96d7d4e1b035 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:24.979756 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ce8d3-4965-4c7d-b1c1-04dbe8a9186e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:24.980496 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ce8d3-4965-4c7d-b1c1-04dbe8a9186e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:24.980844 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ce8d3-4965-4c7d-b1c1-04dbe8a9186e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:24.981185 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ce8d3-4965-4c7d-b1c1-04dbe8a9186e None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:24.981982 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ce8d3-4965-4c7d-b1c1-04dbe8a9186e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:24.982326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ce8d3-4965-4c7d-b1c1-04dbe8a9186e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:24.983814 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ce8d3-4965-4c7d-b1c1-04dbe8a9186e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:24.993863 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 294/589] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Jul 4 03:58:24 2022] PUT /identity/v3/projects/424a145a22434ef7a14b6108e6118ccb/users/8334e75253f843a980b01c6f0cda6015/roles/7fd75ec0129248b28b5254e00d4f6f0b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 03:58:24.994646 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e60cc-65bf-401d-9408-96d7d4e1b035 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:25.010180 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 296/590] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:25.010180 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ce8d3-4965-4c7d-b1c1-04dbe8a9186e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:25.032735 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:25.117738 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:25.118799 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e60cc-65bf-401d-9408-96d7d4e1b035 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:25.159221 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8034e44-64ed-46a8-ba36-c93d8baac84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:25.160321 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8034e44-64ed-46a8-ba36-c93d8baac84f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:25.160605 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8034e44-64ed-46a8-ba36-c93d8baac84f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:25.160928 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8034e44-64ed-46a8-ba36-c93d8baac84f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:25.161848 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ce8d3-4965-4c7d-b1c1-04dbe8a9186e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:25.177999 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8034e44-64ed-46a8-ba36-c93d8baac84f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:25.179872 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8034e44-64ed-46a8-ba36-c93d8baac84f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:25.198480 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-f8034e44-64ed-46a8-ba36-c93d8baac84f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:25.198480 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:25.198480 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:25.198480 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:25.198480 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:25.198480 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:25.198480 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:25.198480 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:25.198480 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:25.198480 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:25.198480 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:25.198480 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:25.198480 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:25.198480 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:25.198480 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:25.199420 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:25.199420 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:25.199420 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:25.199420 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:25.199420 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:25.199420 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:25.199420 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:25.199420 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:25.199420 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:25.199420 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:25.199420 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:25.199420 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:25.199420 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:25.199420 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:25.199420 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:25.199420 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:25.199420 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:25.203247 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:25.203247 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:25.203247 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:25.203247 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:25.203247 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 295/591] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:25.203247 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8034e44-64ed-46a8-ba36-c93d8baac84f None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:25.205108 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54faa789-97a7-48c0-915d-6e55f2e8a570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:25.206042 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54faa789-97a7-48c0-915d-6e55f2e8a570 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:25.206422 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54faa789-97a7-48c0-915d-6e55f2e8a570 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:25.206844 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54faa789-97a7-48c0-915d-6e55f2e8a570 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:25.219256 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54faa789-97a7-48c0-915d-6e55f2e8a570 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:25.220749 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54faa789-97a7-48c0-915d-6e55f2e8a570 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:25.244895 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-54faa789-97a7-48c0-915d-6e55f2e8a570 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:25.244895 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:25.244895 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:25.244895 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:25.244895 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:25.244895 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:25.244895 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:25.244895 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:25.244895 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:25.244895 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:25.244895 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:25.244895 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:25.244895 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:25.244895 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:25.244895 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:25.245883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:25.245883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:25.245883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:25.245883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:25.245883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:25.245883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:25.245883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:25.245883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:25.245883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:25.245883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:25.245883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:25.245883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:25.245883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:25.245883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:25.245883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:25.245883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:25.245883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:25.246817 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:25.246817 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:25.246817 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:25.246817 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:25.249517 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 297/592] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:25.250501 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54faa789-97a7-48c0-915d-6e55f2e8a570 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:25.310531 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:25.332977 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8034e44-64ed-46a8-ba36-c93d8baac84f None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:25.361373 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54faa789-97a7-48c0-915d-6e55f2e8a570 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:25.377557 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045a0b2-d7c2-4723-a6c7-2f5e420d3658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:25.378659 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045a0b2-d7c2-4723-a6c7-2f5e420d3658 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:25.378953 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045a0b2-d7c2-4723-a6c7-2f5e420d3658 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:25.379236 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045a0b2-d7c2-4723-a6c7-2f5e420d3658 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:25.388817 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:25.389072 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045a0b2-d7c2-4723-a6c7-2f5e420d3658 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:25.391417 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045a0b2-d7c2-4723-a6c7-2f5e420d3658 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:25.402592 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350a45f-1fca-49eb-9e22-169da96feff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:25.403567 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350a45f-1fca-49eb-9e22-169da96feff5 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:25.404109 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350a45f-1fca-49eb-9e22-169da96feff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:25.404603 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350a45f-1fca-49eb-9e22-169da96feff5 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:25.405532 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350a45f-1fca-49eb-9e22-169da96feff5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:25.406085 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350a45f-1fca-49eb-9e22-169da96feff5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:25.407701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350a45f-1fca-49eb-9e22-169da96feff5 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:25.408664 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-7045a0b2-d7c2-4723-a6c7-2f5e420d3658 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:25.408664 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:25.408664 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:25.408664 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:25.408664 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:25.408664 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:25.408664 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:25.408664 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:25.408664 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:25.408664 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:25.408664 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:25.408664 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:25.408664 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 03:58:25.408664 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 03:58:25.408664 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 03:58:25.409859 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 03:58:25.409859 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:25.409859 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:25.409859 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:25.409859 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:25.409859 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:25.409859 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:25.409859 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:25.409859 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:25.409859 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:25.409859 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:25.409859 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:25.409859 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:25.409859 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:25.409859 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:25.409859 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:25.409859 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:25.410809 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 03:58:25.410809 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 03:58:25.410809 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 03:58:25.410809 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 03:58:25.410809 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 03:58:25.410809 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 03:58:25.410809 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:25.410809 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:25.410809 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 296/593] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:58:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:25.411316 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045a0b2-d7c2-4723-a6c7-2f5e420d3658 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:25.432590 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 298/594] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:25.432590 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672b868-95c0-4c93-bcab-1175f6f71a30 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:25.432590 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672b868-95c0-4c93-bcab-1175f6f71a30 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:25.432590 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672b868-95c0-4c93-bcab-1175f6f71a30 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:25.432590 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 299/595] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:25.432590 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672b868-95c0-4c93-bcab-1175f6f71a30 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:25.522504 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045a0b2-d7c2-4723-a6c7-2f5e420d3658 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:25.547824 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672b868-95c0-4c93-bcab-1175f6f71a30 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:25.558062 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b3234-615d-4fe1-923b-62981992287c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:25.558763 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b3234-615d-4fe1-923b-62981992287c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:25.559045 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b3234-615d-4fe1-923b-62981992287c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:25.559327 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b3234-615d-4fe1-923b-62981992287c None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:25.560051 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b3234-615d-4fe1-923b-62981992287c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:25.560360 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b3234-615d-4fe1-923b-62981992287c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:25.561735 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b3234-615d-4fe1-923b-62981992287c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:25.568778 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:25.574328 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 297/596] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:25.575270 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b3234-615d-4fe1-923b-62981992287c None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:25.588442 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee03ae2-ec04-4564-b878-e37046322817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:25.589110 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee03ae2-ec04-4564-b878-e37046322817 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:25.589395 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee03ae2-ec04-4564-b878-e37046322817 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:25.589665 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee03ae2-ec04-4564-b878-e37046322817 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:25.590488 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee03ae2-ec04-4564-b878-e37046322817 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:25.590799 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee03ae2-ec04-4564-b878-e37046322817 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:25.592258 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee03ae2-ec04-4564-b878-e37046322817 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:25.604549 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 300/597] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Jul 4 03:58:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:25.605932 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16488391-965a-45ff-bf15-3c63ab28e7cd None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:25.606251 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16488391-965a-45ff-bf15-3c63ab28e7cd None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:25.606534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16488391-965a-45ff-bf15-3c63ab28e7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:25.623262 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-16488391-965a-45ff-bf15-3c63ab28e7cd None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:25.624483 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-16488391-965a-45ff-bf15-3c63ab28e7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:25.666311 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:25.684742 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b3234-615d-4fe1-923b-62981992287c None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:25.698222 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 301/598] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:58:25.698556 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16488391-965a-45ff-bf15-3c63ab28e7cd None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:25.725391 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b8cf4-478f-4c54-b1ed-1f9fafa35f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:25.726302 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b8cf4-478f-4c54-b1ed-1f9fafa35f2b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:25.726601 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b8cf4-478f-4c54-b1ed-1f9fafa35f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:25.726883 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b8cf4-478f-4c54-b1ed-1f9fafa35f2b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:25.734933 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b8cf4-478f-4c54-b1ed-1f9fafa35f2b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:25.736409 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b8cf4-478f-4c54-b1ed-1f9fafa35f2b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:25.750839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-5b6b8cf4-478f-4c54-b1ed-1f9fafa35f2b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 04 03:58:25.750839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:25.750839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:25.750839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:25.750839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:25.750839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:25.750839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:25.750839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:25.750839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:25.750839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:25.750839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:25.750839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:25.750839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 03:58:25.750839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 03:58:25.750839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 03:58:25.750839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 03:58:25.751781 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:25.751781 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:25.751781 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 03:58:25.751781 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:25.751781 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 03:58:25.751781 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:25.751781 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:25.751781 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:25.751781 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:25.751781 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:25.751781 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:25.751781 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:25.751781 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:25.751781 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:25.751781 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:25.751781 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:25.751781 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:25.751781 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:25.753376 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:25.753376 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:25.753376 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 03:58:25.753376 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 03:58:25.753376 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 03:58:25.753376 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 03:58:25.753376 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 03:58:25.753376 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 03:58:25.753376 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 04 03:58:25.753376 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:25.753376 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 298/599] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Jul 4 03:58:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:25.753376 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b8cf4-478f-4c54-b1ed-1f9fafa35f2b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:25.813566 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:25.818913 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16488391-965a-45ff-bf15-3c63ab28e7cd None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:25.855799 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b8cf4-478f-4c54-b1ed-1f9fafa35f2b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:25.858952 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d80dd-9465-4468-83e0-658321c195ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:25.859778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d80dd-9465-4468-83e0-658321c195ed None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:25.860077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d80dd-9465-4468-83e0-658321c195ed None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:25.860344 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d80dd-9465-4468-83e0-658321c195ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:25.868449 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31d80dd-9465-4468-83e0-658321c195ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:25.869950 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31d80dd-9465-4468-83e0-658321c195ed None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:25.883864 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-f31d80dd-9465-4468-83e0-658321c195ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:25.883864 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:25.883864 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:25.883864 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:25.883864 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:25.883864 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:25.883864 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:25.883864 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:25.883864 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:25.883864 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:25.883864 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:25.883864 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:25.883864 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 03:58:25.883864 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 03:58:25.883864 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 03:58:25.884772 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 03:58:25.884772 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:25.884772 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:25.884772 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:25.884772 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:25.884772 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:25.884772 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:25.884772 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:25.884772 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:25.884772 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:25.884772 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:25.884772 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:25.884772 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:25.884772 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:25.884772 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:25.884772 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:25.884772 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:25.885689 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 03:58:25.885689 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 03:58:25.885689 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 03:58:25.885689 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 03:58:25.885689 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 03:58:25.885689 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 03:58:25.885689 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:25.885689 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:25.885689 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 302/600] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:58:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:25.887169 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d80dd-9465-4468-83e0-658321c195ed None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:25.897310 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a6639-0367-4c02-8813-80dc1040d0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:25.898282 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a6639-0367-4c02-8813-80dc1040d0d3 None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:25.898575 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a6639-0367-4c02-8813-80dc1040d0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:25.898857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a6639-0367-4c02-8813-80dc1040d0d3 None admin] PATH_INFO: `/v3/projects/424a145a22434ef7a14b6108e6118ccb/users/60e29ce1e3d64431bc7aa80d55787ae5/roles/7fd75ec0129248b28b5254e00d4f6f0b` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:25.914561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8a6639-0367-4c02-8813-80dc1040d0d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=424a145a22434ef7a14b6108e6118ccb, user_id=60e29ce1e3d64431bc7aa80d55787ae5, role_id=7fd75ec0129248b28b5254e00d4f6f0b)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:25.916211 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8a6639-0367-4c02-8813-80dc1040d0d3 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:25.922626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:25.931476 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 299/601] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Jul 4 03:58:25 2022] PUT /identity/v3/projects/424a145a22434ef7a14b6108e6118ccb/users/60e29ce1e3d64431bc7aa80d55787ae5/roles/7fd75ec0129248b28b5254e00d4f6f0b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 03:58:25.932582 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a6639-0367-4c02-8813-80dc1040d0d3 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:26.031356 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d80dd-9465-4468-83e0-658321c195ed None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:26.055255 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a6639-0367-4c02-8813-80dc1040d0d3 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:26.072095 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:26.077491 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863089a-c208-4c87-8e4e-7a5ec385c2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:26.078446 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863089a-c208-4c87-8e4e-7a5ec385c2da None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:26.078725 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863089a-c208-4c87-8e4e-7a5ec385c2da None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:26.079346 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863089a-c208-4c87-8e4e-7a5ec385c2da None admin] PATH_INFO: `/v3/roles/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:26.096144 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7863089a-c208-4c87-8e4e-7a5ec385c2da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:58:26.104130 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-7863089a-c208-4c87-8e4e-7a5ec385c2da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 03:58:26.104130 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:26.104130 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:26.104130 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:26.104130 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:26.104130 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:26.104130 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:26.104130 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:26.104130 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:26.104130 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:26.104130 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:26.104130 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:26.104130 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:58:26.104130 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:58:26.104130 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:58:26.104130 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:58:26.105259 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:58:26.105259 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:58:26.105259 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:58:26.105259 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:58:26.105259 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:26.105259 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:26.105259 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:26.105259 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:26.105259 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:26.105259 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:26.105259 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:26.105259 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:26.105259 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:26.105259 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:26.105259 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:26.105259 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:26.106973 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:26.106973 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:26.106973 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:26.106973 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:26.106973 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:58:26.106973 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:58:26.106973 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:58:26.106973 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:58:26.106973 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:58:26.106973 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:58:26.106973 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 03:58:26.106973 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:26.106973 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 303/602] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Jul 4 03:58:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:26.106973 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863089a-c208-4c87-8e4e-7a5ec385c2da None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:26.118042 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1d2fe-36e9-4a54-8237-fbe7457e8e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:26.118822 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1d2fe-36e9-4a54-8237-fbe7457e8e38 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:26.119118 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1d2fe-36e9-4a54-8237-fbe7457e8e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:26.119397 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1d2fe-36e9-4a54-8237-fbe7457e8e38 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:26.120267 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1d2fe-36e9-4a54-8237-fbe7457e8e38 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:26.120581 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1d2fe-36e9-4a54-8237-fbe7457e8e38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:26.122048 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1d2fe-36e9-4a54-8237-fbe7457e8e38 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:26.147146 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 300/603] 10.222.0.49 () {56 vars in 1139 bytes} [Mon Jul 4 03:58:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:26.148595 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1d2fe-36e9-4a54-8237-fbe7457e8e38 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:26.228959 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:26.237501 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863089a-c208-4c87-8e4e-7a5ec385c2da None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:26.263108 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1d2fe-36e9-4a54-8237-fbe7457e8e38 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:26.283759 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c892629-8a28-413a-bf6a-f84d77cd7b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:26.285285 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c892629-8a28-413a-bf6a-f84d77cd7b80 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:26.285799 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c892629-8a28-413a-bf6a-f84d77cd7b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:26.286565 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c892629-8a28-413a-bf6a-f84d77cd7b80 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:26.287820 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c892629-8a28-413a-bf6a-f84d77cd7b80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:26.288771 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c892629-8a28-413a-bf6a-f84d77cd7b80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:26.290996 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c892629-8a28-413a-bf6a-f84d77cd7b80 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:26.299543 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054cabb9-62f2-461a-af87-e96101e9231c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:26.300313 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054cabb9-62f2-461a-af87-e96101e9231c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:26.300591 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054cabb9-62f2-461a-af87-e96101e9231c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:26.300878 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054cabb9-62f2-461a-af87-e96101e9231c None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:26.301677 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054cabb9-62f2-461a-af87-e96101e9231c None admin] RBAC: Adding query filter params (name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:26.301990 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054cabb9-62f2-461a-af87-e96101e9231c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:26.303398 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054cabb9-62f2-461a-af87-e96101e9231c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:26.308272 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 304/604] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Jul 4 03:58:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:26.309891 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c892629-8a28-413a-bf6a-f84d77cd7b80 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:26.312729 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 301/605] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Jul 4 03:58:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:26.317998 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054cabb9-62f2-461a-af87-e96101e9231c None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:26.348004 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:26.421292 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054cabb9-62f2-461a-af87-e96101e9231c None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:26.428981 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c892629-8a28-413a-bf6a-f84d77cd7b80 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:26.455798 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b0313-31c6-43f2-808c-7ab53530afbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:26.456697 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b0313-31c6-43f2-808c-7ab53530afbf None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:26.456979 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b0313-31c6-43f2-808c-7ab53530afbf None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:26.457256 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b0313-31c6-43f2-808c-7ab53530afbf None admin] PATH_INFO: `/v3/projects/424a145a22434ef7a14b6108e6118ccb/users/9d20ab1d200447c098d32ebfa130c5de/roles/7fd75ec0129248b28b5254e00d4f6f0b` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:26.467327 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796599a-535c-4d34-9735-fbeddfc88fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:26.468411 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796599a-535c-4d34-9735-fbeddfc88fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:26.468942 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796599a-535c-4d34-9735-fbeddfc88fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:26.469531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796599a-535c-4d34-9735-fbeddfc88fd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:26.473020 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b0313-31c6-43f2-808c-7ab53530afbf None admin] RBAC: Authorizing `identity:create_grant(project_id=424a145a22434ef7a14b6108e6118ccb, user_id=9d20ab1d200447c098d32ebfa130c5de, role_id=7fd75ec0129248b28b5254e00d4f6f0b)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:26.474511 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b0313-31c6-43f2-808c-7ab53530afbf None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:26.481338 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2796599a-535c-4d34-9735-fbeddfc88fd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:26.483092 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2796599a-535c-4d34-9735-fbeddfc88fd9 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:26.491836 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 302/606] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Jul 4 03:58:26 2022] PUT /identity/v3/projects/424a145a22434ef7a14b6108e6118ccb/users/9d20ab1d200447c098d32ebfa130c5de/roles/7fd75ec0129248b28b5254e00d4f6f0b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 03:58:26.492664 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b0313-31c6-43f2-808c-7ab53530afbf None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:26.505999 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-2796599a-535c-4d34-9735-fbeddfc88fd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:26.505999 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:26.505999 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:26.505999 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:26.505999 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:26.505999 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:26.505999 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:26.505999 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:26.505999 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:26.505999 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:26.505999 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:26.505999 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:26.505999 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:26.505999 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:26.505999 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:26.507001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:26.507001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:26.507001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:26.507001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:26.507001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:26.507001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:26.507001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:26.507001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:26.507001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:26.507001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:26.507001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:26.507001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:26.507001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:26.507001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:26.507001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:26.507001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:26.507001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:26.507985 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:26.507985 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:26.507985 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:26.507985 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:26.511476 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 305/607] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:26.518204 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796599a-535c-4d34-9735-fbeddfc88fd9 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:26.539287 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:26.593965 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:26.619186 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b0313-31c6-43f2-808c-7ab53530afbf None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:26.657788 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbfa1b9-bd86-4a3c-ad38-f7ec2085f3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:26.659015 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbfa1b9-bd86-4a3c-ad38-f7ec2085f3f2 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:26.659478 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbfa1b9-bd86-4a3c-ad38-f7ec2085f3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:26.659898 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbfa1b9-bd86-4a3c-ad38-f7ec2085f3f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:26.671777 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbfa1b9-bd86-4a3c-ad38-f7ec2085f3f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:26.673529 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbfa1b9-bd86-4a3c-ad38-f7ec2085f3f2 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:26.693756 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-0cbfa1b9-bd86-4a3c-ad38-f7ec2085f3f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:26.693756 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:26.693756 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:26.693756 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:26.693756 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:26.693756 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:26.693756 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:26.693756 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:26.693756 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:26.693756 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:26.693756 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:26.693756 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:26.693756 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:26.693756 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:26.693756 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:26.694973 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:26.694973 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:26.694973 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:26.694973 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:26.694973 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:26.694973 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:26.694973 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:26.694973 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:26.694973 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:26.694973 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:26.694973 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:26.694973 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:26.694973 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:26.694973 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:26.694973 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:26.694973 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:26.694973 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:26.696151 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:26.696151 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:26.696151 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:26.696151 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:26.702386 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 303/608] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:26.704267 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbfa1b9-bd86-4a3c-ad38-f7ec2085f3f2 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:26.771242 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796599a-535c-4d34-9735-fbeddfc88fd9 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:26.815517 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc0b92-fa06-43c4-b9f6-dda1f5573866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:26.816418 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc0b92-fa06-43c4-b9f6-dda1f5573866 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:26.816916 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc0b92-fa06-43c4-b9f6-dda1f5573866 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:26.817272 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc0b92-fa06-43c4-b9f6-dda1f5573866 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:26.818401 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc0b92-fa06-43c4-b9f6-dda1f5573866 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:26.818832 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc0b92-fa06-43c4-b9f6-dda1f5573866 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:26.821075 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc0b92-fa06-43c4-b9f6-dda1f5573866 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:26.825676 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbfa1b9-bd86-4a3c-ad38-f7ec2085f3f2 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:26.836231 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 306/609] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:26.842811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc0b92-fa06-43c4-b9f6-dda1f5573866 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:26.863915 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:26.870707 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38377a36-06cb-4976-8013-6953b95bb407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:26.871564 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38377a36-06cb-4976-8013-6953b95bb407 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:26.872002 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38377a36-06cb-4976-8013-6953b95bb407 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:26.872693 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38377a36-06cb-4976-8013-6953b95bb407 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:26.873578 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38377a36-06cb-4976-8013-6953b95bb407 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:26.874045 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38377a36-06cb-4976-8013-6953b95bb407 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:26.882798 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38377a36-06cb-4976-8013-6953b95bb407 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:26.902666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 304/610] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:26.908525 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38377a36-06cb-4976-8013-6953b95bb407 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:26.920986 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:27.008456 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc0b92-fa06-43c4-b9f6-dda1f5573866 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:27.067107 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38377a36-06cb-4976-8013-6953b95bb407 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:27.101937 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d37fde-04a7-482c-8d20-d95db0427fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:27.102809 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d37fde-04a7-482c-8d20-d95db0427fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:27.103097 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d37fde-04a7-482c-8d20-d95db0427fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:27.103376 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d37fde-04a7-482c-8d20-d95db0427fb5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:27.111083 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d37fde-04a7-482c-8d20-d95db0427fb5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:27.111900 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e20fae-e534-482d-b1d5-5e7bc34cdaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:27.112551 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d37fde-04a7-482c-8d20-d95db0427fb5 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:27.113069 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e20fae-e534-482d-b1d5-5e7bc34cdaf1 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:27.113497 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e20fae-e534-482d-b1d5-5e7bc34cdaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:27.113930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e20fae-e534-482d-b1d5-5e7bc34cdaf1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:27.129279 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e20fae-e534-482d-b1d5-5e7bc34cdaf1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:27.129509 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-09d37fde-04a7-482c-8d20-d95db0427fb5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 04 03:58:27.129509 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:27.129509 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:27.129509 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:27.129509 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:27.129509 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:27.129509 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:27.129509 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:27.129509 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:27.129509 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:27.129509 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:27.129509 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:27.129509 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 03:58:27.129509 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 03:58:27.129509 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 03:58:27.129509 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 03:58:27.130780 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:27.130780 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:27.130780 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 03:58:27.130780 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:27.130780 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 03:58:27.130780 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:27.130780 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:27.130780 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:27.130780 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:27.130780 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:27.130780 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:27.130780 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:27.130780 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:27.130780 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:27.130780 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:27.130780 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:27.130780 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:27.130780 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:27.131737 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:27.131737 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:27.131737 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 03:58:27.131737 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 03:58:27.131737 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 03:58:27.131737 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 03:58:27.131737 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 03:58:27.131737 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 03:58:27.131737 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 04 03:58:27.131737 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:27.131737 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 305/611] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Jul 4 03:58:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:58:27.132391 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e20fae-e534-482d-b1d5-5e7bc34cdaf1 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:27.138186 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d37fde-04a7-482c-8d20-d95db0427fb5 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:27.166049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-38e20fae-e534-482d-b1d5-5e7bc34cdaf1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:27.166049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:27.166049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:27.166049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:27.166049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:27.166049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:27.166049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:27.166049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:27.166049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:27.166049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:27.166049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:27.166049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:27.166049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 03:58:27.166049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 03:58:27.166049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 03:58:27.167049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 03:58:27.167049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:27.167049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:27.167049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:27.167049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:27.167049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:27.167049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:27.167049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:27.167049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:27.167049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:27.167049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:27.167049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:27.167049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:27.167049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:27.167049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:27.167049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:27.167049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:27.167954 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 03:58:27.167954 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 03:58:27.167954 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 03:58:27.167954 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 03:58:27.167954 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 03:58:27.167954 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 03:58:27.167954 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:27.167954 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:27.175329 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 307/612] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:58:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:27.176278 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e20fae-e534-482d-b1d5-5e7bc34cdaf1 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:27.218528 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:27.274946 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d37fde-04a7-482c-8d20-d95db0427fb5 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:27.285888 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e20fae-e534-482d-b1d5-5e7bc34cdaf1 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:27.309331 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c88c8-66ea-498e-9144-34755096ceca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:27.310410 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c88c8-66ea-498e-9144-34755096ceca None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:27.310903 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c88c8-66ea-498e-9144-34755096ceca None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:27.311386 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c88c8-66ea-498e-9144-34755096ceca None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:27.312510 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c88c8-66ea-498e-9144-34755096ceca None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:27.312931 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:27.313260 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c88c8-66ea-498e-9144-34755096ceca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:27.314975 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c88c8-66ea-498e-9144-34755096ceca None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:27.324400 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3a6a8-75b1-4742-85d6-acc5b77435ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:27.325890 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3a6a8-75b1-4742-85d6-acc5b77435ed None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:27.326213 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3a6a8-75b1-4742-85d6-acc5b77435ed None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:27.326499 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3a6a8-75b1-4742-85d6-acc5b77435ed None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:27.327309 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a3a6a8-75b1-4742-85d6-acc5b77435ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:27.327628 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a3a6a8-75b1-4742-85d6-acc5b77435ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:27.329094 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a3a6a8-75b1-4742-85d6-acc5b77435ed None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:27.335418 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 306/613] 10.222.0.49 () {56 vars in 1135 bytes} [Mon Jul 4 03:58:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:27.337528 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b4f1e-ff37-4f6b-bb5a-b4a34c1e327d None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:27.338029 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b4f1e-ff37-4f6b-bb5a-b4a34c1e327d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:27.338581 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b4f1e-ff37-4f6b-bb5a-b4a34c1e327d None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:27.345103 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 308/615] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Jul 4 03:58:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:27.345103 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3a6a8-75b1-4742-85d6-acc5b77435ed None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:27.345521 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 307/615] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:27.348760 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5feb80-47bb-495e-b9bc-9ec402291687 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:27.349275 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5feb80-47bb-495e-b9bc-9ec402291687 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:27.349760 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5feb80-47bb-495e-b9bc-9ec402291687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:27.369397 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-5a5feb80-47bb-495e-b9bc-9ec402291687 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:27.371040 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-5a5feb80-47bb-495e-b9bc-9ec402291687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:27.458389 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 308/616] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:58:27.458389 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5feb80-47bb-495e-b9bc-9ec402291687 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:27.486371 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3a6a8-75b1-4742-85d6-acc5b77435ed None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:27.530590 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:27.530788 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b89f148-5052-4728-9254-dd42ca7a8eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:27.531747 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89f148-5052-4728-9254-dd42ca7a8eba None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:27.532042 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89f148-5052-4728-9254-dd42ca7a8eba None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:27.532325 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89f148-5052-4728-9254-dd42ca7a8eba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:27.546665 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b89f148-5052-4728-9254-dd42ca7a8eba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:27.548897 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b89f148-5052-4728-9254-dd42ca7a8eba None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:27.570106 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-9b89f148-5052-4728-9254-dd42ca7a8eba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:27.570106 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:27.570106 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:27.570106 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:27.570106 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:27.570106 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:27.570106 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:27.570106 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:27.570106 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:27.570106 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:27.570106 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:27.570106 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:27.570106 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:27.570106 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:27.570106 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:27.571071 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:27.571071 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:27.571071 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:27.571071 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:27.571071 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:27.571071 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:27.571071 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:27.571071 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:27.571071 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:27.571071 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:27.571071 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:27.571071 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:27.571071 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:27.571071 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:27.571071 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:27.571071 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:27.571071 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:27.571970 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:27.571970 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:27.571970 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:27.571970 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:27.571970 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 309/617] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:27.572246 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b89f148-5052-4728-9254-dd42ca7a8eba None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:27.589951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5feb80-47bb-495e-b9bc-9ec402291687 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:27.626352 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:27.635093 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09b29e-dff4-40d9-8e44-67d81f60a64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:27.636339 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09b29e-dff4-40d9-8e44-67d81f60a64e None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:27.636839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09b29e-dff4-40d9-8e44-67d81f60a64e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:27.636974 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09b29e-dff4-40d9-8e44-67d81f60a64e None admin] PATH_INFO: `/v3/projects/424a145a22434ef7a14b6108e6118ccb/users/b36a8402144c458fa98f80d7e3516127/roles/7fd75ec0129248b28b5254e00d4f6f0b` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:27.652102 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d09b29e-dff4-40d9-8e44-67d81f60a64e None admin] RBAC: Authorizing `identity:create_grant(project_id=424a145a22434ef7a14b6108e6118ccb, user_id=b36a8402144c458fa98f80d7e3516127, role_id=7fd75ec0129248b28b5254e00d4f6f0b)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:27.653578 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d09b29e-dff4-40d9-8e44-67d81f60a64e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:27.669978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 309/618] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Jul 4 03:58:27 2022] PUT /identity/v3/projects/424a145a22434ef7a14b6108e6118ccb/users/b36a8402144c458fa98f80d7e3516127/roles/7fd75ec0129248b28b5254e00d4f6f0b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 03:58:27.671072 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09b29e-dff4-40d9-8e44-67d81f60a64e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:27.698525 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b89f148-5052-4728-9254-dd42ca7a8eba None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:27.738894 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88741c4e-b19b-4006-b74a-85d23caa1588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:27.740209 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88741c4e-b19b-4006-b74a-85d23caa1588 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:27.740709 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88741c4e-b19b-4006-b74a-85d23caa1588 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:27.741230 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88741c4e-b19b-4006-b74a-85d23caa1588 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:27.754201 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88741c4e-b19b-4006-b74a-85d23caa1588 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:58:27.763538 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-88741c4e-b19b-4006-b74a-85d23caa1588 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 03:58:27.763538 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:27.763538 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:27.763538 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:27.763538 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:27.763538 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:27.763538 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:27.763538 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:27.763538 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:27.763538 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:27.763538 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:27.763538 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:27.763538 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:58:27.763538 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:58:27.763538 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:58:27.763538 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:58:27.764547 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:58:27.764547 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:58:27.764547 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:58:27.764547 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:58:27.764547 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:27.764547 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:27.764547 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:27.764547 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:27.764547 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:27.764547 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:27.764547 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:27.764547 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:27.764547 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:27.764547 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:27.764547 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:27.764547 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:27.765383 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:27.765383 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:27.765383 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:27.765383 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:27.765383 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:58:27.765383 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:58:27.765383 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:58:27.765383 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:58:27.765383 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:58:27.765383 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:58:27.765383 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 03:58:27.765383 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:27.773593 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:27.773960 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 310/619] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Jul 4 03:58:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:27.776407 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88741c4e-b19b-4006-b74a-85d23caa1588 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:27.786616 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09b29e-dff4-40d9-8e44-67d81f60a64e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:27.826353 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d785a-2cb6-4f33-bad3-226dd6cd36c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:27.827035 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d785a-2cb6-4f33-bad3-226dd6cd36c1 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:27.827324 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d785a-2cb6-4f33-bad3-226dd6cd36c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:27.827605 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d785a-2cb6-4f33-bad3-226dd6cd36c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:27.828572 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d785a-2cb6-4f33-bad3-226dd6cd36c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:27.828683 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d785a-2cb6-4f33-bad3-226dd6cd36c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:27.830037 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d785a-2cb6-4f33-bad3-226dd6cd36c1 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:27.843045 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 310/620] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:27.852771 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d785a-2cb6-4f33-bad3-226dd6cd36c1 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:27.894099 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:27.900545 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88741c4e-b19b-4006-b74a-85d23caa1588 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:27.939862 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb30e88-1119-4f29-b2fe-5718c01fee45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:27.940899 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb30e88-1119-4f29-b2fe-5718c01fee45 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:27.941420 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb30e88-1119-4f29-b2fe-5718c01fee45 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:27.941928 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb30e88-1119-4f29-b2fe-5718c01fee45 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:27.943374 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb30e88-1119-4f29-b2fe-5718c01fee45 None admin] RBAC: Adding query filter params (name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:27.943901 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb30e88-1119-4f29-b2fe-5718c01fee45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:27.946018 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb30e88-1119-4f29-b2fe-5718c01fee45 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:27.961089 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 311/621] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Jul 4 03:58:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:27.975267 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb30e88-1119-4f29-b2fe-5718c01fee45 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:28.005082 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d785a-2cb6-4f33-bad3-226dd6cd36c1 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:28.046468 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69019ee0-7f9e-42e6-bb14-dbd6ca26c5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:28.047680 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69019ee0-7f9e-42e6-bb14-dbd6ca26c5cd None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:28.048061 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69019ee0-7f9e-42e6-bb14-dbd6ca26c5cd None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:28.048438 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69019ee0-7f9e-42e6-bb14-dbd6ca26c5cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:28.057051 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69019ee0-7f9e-42e6-bb14-dbd6ca26c5cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:28.058711 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69019ee0-7f9e-42e6-bb14-dbd6ca26c5cd None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:28.078178 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-69019ee0-7f9e-42e6-bb14-dbd6ca26c5cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:28.078178 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:28.078178 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:28.078178 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:28.078178 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:28.078178 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:28.078178 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:28.078178 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:28.078178 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:28.078178 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:28.078178 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:28.078178 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:28.078178 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 03:58:28.078178 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 03:58:28.078178 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 03:58:28.079253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 03:58:28.079253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:28.079253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:28.079253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:28.079253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:28.079253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:28.079253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:28.079253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:28.079253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:28.079253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:28.079253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:28.079253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:28.079253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:28.079253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:28.079253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:28.079253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:28.079253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:28.080690 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 03:58:28.080690 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 03:58:28.080690 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 03:58:28.080690 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 03:58:28.080690 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 03:58:28.080690 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 03:58:28.080690 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:28.080690 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:28.080690 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 311/622] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:58:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:28.081715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d682d-2ce3-48ef-b6da-e0fe9c0c6aaf None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:28.082003 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d682d-2ce3-48ef-b6da-e0fe9c0c6aaf None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:28.082316 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d682d-2ce3-48ef-b6da-e0fe9c0c6aaf None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:28.084438 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 312/623] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:28.086911 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d682d-2ce3-48ef-b6da-e0fe9c0c6aaf None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:28.098422 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:28.171088 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb30e88-1119-4f29-b2fe-5718c01fee45 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:28.199835 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d682d-2ce3-48ef-b6da-e0fe9c0c6aaf None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:28.215719 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd900140-4487-48e6-8f2a-8a2a3f03978c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:28.216778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd900140-4487-48e6-8f2a-8a2a3f03978c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:28.217066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd900140-4487-48e6-8f2a-8a2a3f03978c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:28.217368 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd900140-4487-48e6-8f2a-8a2a3f03978c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:28.232517 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd900140-4487-48e6-8f2a-8a2a3f03978c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:28.233998 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd900140-4487-48e6-8f2a-8a2a3f03978c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:28.236100 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6821a6-b826-43ba-ab21-0ca621763330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:28.236856 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6821a6-b826-43ba-ab21-0ca621763330 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:28.237207 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6821a6-b826-43ba-ab21-0ca621763330 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:28.237551 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6821a6-b826-43ba-ab21-0ca621763330 None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:28.238451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6821a6-b826-43ba-ab21-0ca621763330 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:28.238835 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6821a6-b826-43ba-ab21-0ca621763330 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:28.240822 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6821a6-b826-43ba-ab21-0ca621763330 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:28.253425 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-bd900140-4487-48e6-8f2a-8a2a3f03978c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:28.253425 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:28.253425 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:28.253425 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:28.253425 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:28.253425 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:28.253425 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:28.253425 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:28.253425 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:28.253425 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:28.253425 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:28.253425 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:28.253425 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:28.253425 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:28.253425 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:28.255420 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:28.255420 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:28.255420 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:28.255420 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:28.255420 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:28.255420 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:28.255420 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:28.255420 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:28.255420 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:28.255420 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:28.255420 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:28.255420 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:28.255420 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:28.255420 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:28.255420 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:28.255420 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:28.255420 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:28.257708 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:28.257708 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:28.257708 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:28.257708 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:28.258240 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 313/624] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Jul 4 03:58:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:58:28.258240 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f47052-11c9-4918-9577-b5489ff9e142 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:28.258240 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f47052-11c9-4918-9577-b5489ff9e142 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:28.258240 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f47052-11c9-4918-9577-b5489ff9e142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:28.260174 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 312/625] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:28.263862 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd900140-4487-48e6-8f2a-8a2a3f03978c None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:28.274533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-10f47052-11c9-4918-9577-b5489ff9e142 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:28.275740 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-10f47052-11c9-4918-9577-b5489ff9e142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:28.278512 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:28.345271 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:28.353556 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 314/626] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:58:28.354941 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f47052-11c9-4918-9577-b5489ff9e142 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:28.393341 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd900140-4487-48e6-8f2a-8a2a3f03978c None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:28.437062 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83dd8c-7b1b-472e-a6bf-764a0fcea090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:28.438417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83dd8c-7b1b-472e-a6bf-764a0fcea090 None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:28.438709 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83dd8c-7b1b-472e-a6bf-764a0fcea090 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:28.438992 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83dd8c-7b1b-472e-a6bf-764a0fcea090 None admin] PATH_INFO: `/v3/projects/424a145a22434ef7a14b6108e6118ccb/users/24f93fdc98ff425791da3e2194b3a671/roles/7fd75ec0129248b28b5254e00d4f6f0b` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:28.458104 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f83dd8c-7b1b-472e-a6bf-764a0fcea090 None admin] RBAC: Authorizing `identity:create_grant(project_id=424a145a22434ef7a14b6108e6118ccb, user_id=24f93fdc98ff425791da3e2194b3a671, role_id=7fd75ec0129248b28b5254e00d4f6f0b)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:28.460260 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f83dd8c-7b1b-472e-a6bf-764a0fcea090 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:28.478235 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 313/627] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Jul 4 03:58:28 2022] PUT /identity/v3/projects/424a145a22434ef7a14b6108e6118ccb/users/24f93fdc98ff425791da3e2194b3a671/roles/7fd75ec0129248b28b5254e00d4f6f0b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 03:58:28.479555 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83dd8c-7b1b-472e-a6bf-764a0fcea090 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:28.500838 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f47052-11c9-4918-9577-b5489ff9e142 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:28.573047 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21843b8-cafd-4729-af13-37c0fe29276c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:28.574091 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21843b8-cafd-4729-af13-37c0fe29276c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:28.574866 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21843b8-cafd-4729-af13-37c0fe29276c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:28.575364 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21843b8-cafd-4729-af13-37c0fe29276c None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:28.577244 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21843b8-cafd-4729-af13-37c0fe29276c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:28.577965 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21843b8-cafd-4729-af13-37c0fe29276c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:28.580136 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21843b8-cafd-4729-af13-37c0fe29276c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:28.609062 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 315/628] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:28.611699 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21843b8-cafd-4729-af13-37c0fe29276c None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:28.613729 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:28.685338 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83dd8c-7b1b-472e-a6bf-764a0fcea090 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:28.708596 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:28.732606 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a20c5-9d60-4734-a5f3-343e2f12d353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:28.734381 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a20c5-9d60-4734-a5f3-343e2f12d353 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:28.734850 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a20c5-9d60-4734-a5f3-343e2f12d353 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:28.735308 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a20c5-9d60-4734-a5f3-343e2f12d353 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:28.749866 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a20c5-9d60-4734-a5f3-343e2f12d353 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:58:28.758225 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-d74a20c5-9d60-4734-a5f3-343e2f12d353 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 03:58:28.758225 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:28.758225 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:28.758225 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:28.758225 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:28.758225 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:28.758225 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:28.758225 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:28.758225 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:28.758225 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:28.758225 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:28.758225 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:28.758225 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:58:28.758225 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:58:28.758225 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:58:28.758225 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:58:28.759229 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:58:28.759229 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:58:28.759229 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:58:28.759229 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:58:28.759229 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:28.759229 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:28.759229 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:28.759229 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:28.759229 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:28.759229 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:28.759229 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:28.759229 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:28.759229 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:28.759229 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:28.759229 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:28.759229 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:28.760073 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:28.760073 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:28.760073 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:28.760073 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:28.760073 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:58:28.760073 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:58:28.760073 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:58:28.760073 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:58:28.760073 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:58:28.760073 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:58:28.760073 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 03:58:28.760073 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:28.763774 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21843b8-cafd-4729-af13-37c0fe29276c None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:28.765295 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 314/629] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Jul 4 03:58:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:28.767380 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a20c5-9d60-4734-a5f3-343e2f12d353 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:28.810141 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025e84f-fbe4-434b-b9d6-f13a22877bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:28.814423 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025e84f-fbe4-434b-b9d6-f13a22877bcc None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:28.814741 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025e84f-fbe4-434b-b9d6-f13a22877bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:28.815030 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025e84f-fbe4-434b-b9d6-f13a22877bcc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:28.828382 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3025e84f-fbe4-434b-b9d6-f13a22877bcc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:28.829867 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3025e84f-fbe4-434b-b9d6-f13a22877bcc None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:28.853233 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-3025e84f-fbe4-434b-b9d6-f13a22877bcc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 03:58:28.853233 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:28.853233 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:28.853233 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:28.853233 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:28.853233 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:28.853233 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:28.853233 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:28.853233 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:28.853233 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:28.853233 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:28.853233 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:28.853233 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 03:58:28.853233 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 03:58:28.853233 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 03:58:28.853233 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 03:58:28.854346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:28.854346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:28.854346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 03:58:28.854346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:28.854346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 03:58:28.854346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:28.854346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:28.854346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:28.854346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:28.854346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:28.854346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:28.854346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:28.854346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:28.854346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:28.854346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:28.854346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:28.854346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:28.854346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:28.855294 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:28.855294 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:28.855294 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 03:58:28.855294 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 03:58:28.855294 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 03:58:28.855294 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 03:58:28.855294 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 03:58:28.855294 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 03:58:28.855294 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 03:58:28.855294 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:28.860820 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 316/630] 10.222.0.49 () {56 vars in 1093 bytes} [Mon Jul 4 03:58:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:58:28.869756 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025e84f-fbe4-434b-b9d6-f13a22877bcc None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:28.939312 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a20c5-9d60-4734-a5f3-343e2f12d353 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:28.976982 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:28.990474 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0f1d2-48f1-46ec-8782-9ab22da5f94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:28.991470 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0f1d2-48f1-46ec-8782-9ab22da5f94c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:28.992098 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0f1d2-48f1-46ec-8782-9ab22da5f94c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:28.992536 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0f1d2-48f1-46ec-8782-9ab22da5f94c None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:28.993444 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c0f1d2-48f1-46ec-8782-9ab22da5f94c None admin] RBAC: Adding query filter params (name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:28.993896 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c0f1d2-48f1-46ec-8782-9ab22da5f94c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:28.995606 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c0f1d2-48f1-46ec-8782-9ab22da5f94c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:29.005037 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 315/631] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Jul 4 03:58:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:58:29.010907 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0f1d2-48f1-46ec-8782-9ab22da5f94c None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:29.050027 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025e84f-fbe4-434b-b9d6-f13a22877bcc None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:29.069012 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:29.091853 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41d0e6-2127-46e5-b183-10eb9a8ce6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:29.093483 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41d0e6-2127-46e5-b183-10eb9a8ce6c7 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:29.094129 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41d0e6-2127-46e5-b183-10eb9a8ce6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:29.094739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41d0e6-2127-46e5-b183-10eb9a8ce6c7 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:29.096097 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe41d0e6-2127-46e5-b183-10eb9a8ce6c7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:29.097565 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe41d0e6-2127-46e5-b183-10eb9a8ce6c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:29.099097 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe41d0e6-2127-46e5-b183-10eb9a8ce6c7 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:29.125446 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 317/632] 10.222.0.49 () {56 vars in 1133 bytes} [Mon Jul 4 03:58:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:58:29.127129 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b349dd0-52ba-43e6-96e7-7ccd103363b9 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:29.127422 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b349dd0-52ba-43e6-96e7-7ccd103363b9 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:29.127702 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b349dd0-52ba-43e6-96e7-7ccd103363b9 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:29.130543 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 318/633] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:29.131434 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b349dd0-52ba-43e6-96e7-7ccd103363b9 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:29.139715 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0f1d2-48f1-46ec-8782-9ab22da5f94c None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:29.182042 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b824226-ea47-4dc9-b13e-2e0b80a27533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:29.183151 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b824226-ea47-4dc9-b13e-2e0b80a27533 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:29.183606 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b824226-ea47-4dc9-b13e-2e0b80a27533 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:29.184039 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b824226-ea47-4dc9-b13e-2e0b80a27533 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:29.198289 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b824226-ea47-4dc9-b13e-2e0b80a27533 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:29.199987 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b824226-ea47-4dc9-b13e-2e0b80a27533 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:29.222328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-5b824226-ea47-4dc9-b13e-2e0b80a27533 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:29.222328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:29.222328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:29.222328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:29.222328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:29.222328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:29.222328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:29.222328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:29.222328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:29.222328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:29.222328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:29.222328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:29.222328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:29.222328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:29.222328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:29.223318 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:29.223318 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:29.223318 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:29.223318 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:29.223318 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:29.223318 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:29.223318 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:29.223318 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:29.223318 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:29.223318 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:29.223318 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:29.223318 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:29.223318 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:29.223318 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:29.223318 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:29.223318 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:29.223318 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:29.224217 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:29.224217 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:29.224217 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:29.224217 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:29.231468 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 316/634] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:58:29.231611 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dba541-4553-48c0-9e46-d710d3334b7d None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:29.231802 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dba541-4553-48c0-9e46-d710d3334b7d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:29.232086 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dba541-4553-48c0-9e46-d710d3334b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:29.250500 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e9dba541-4553-48c0-9e46-d710d3334b7d None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:29.251702 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e9dba541-4553-48c0-9e46-d710d3334b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:29.259831 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b349dd0-52ba-43e6-96e7-7ccd103363b9 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:29.287222 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:29.295380 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2340904-a58c-4caf-aca9-a287be57411c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:29.296227 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2340904-a58c-4caf-aca9-a287be57411c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:29.296542 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2340904-a58c-4caf-aca9-a287be57411c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:29.296920 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2340904-a58c-4caf-aca9-a287be57411c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:29.338489 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 317/635] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:58:29.339790 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dba541-4553-48c0-9e46-d710d3334b7d None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:29.342610 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:29.370190 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2340904-a58c-4caf-aca9-a287be57411c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:29.370190 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2340904-a58c-4caf-aca9-a287be57411c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:29.466869 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 319/636] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:58:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 03:58:29.467910 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2340904-a58c-4caf-aca9-a287be57411c None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:29.468892 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dba541-4553-48c0-9e46-d710d3334b7d None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:29.506872 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7a746-2319-4fe0-bdde-78df30e14570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:29.508050 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7a746-2319-4fe0-bdde-78df30e14570 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:29.508752 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7a746-2319-4fe0-bdde-78df30e14570 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:29.509298 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7a746-2319-4fe0-bdde-78df30e14570 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:29.510269 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d7a746-2319-4fe0-bdde-78df30e14570 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:29.511359 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d7a746-2319-4fe0-bdde-78df30e14570 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:29.512976 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d7a746-2319-4fe0-bdde-78df30e14570 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:29.527287 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 318/637] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:29.528532 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7a746-2319-4fe0-bdde-78df30e14570 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:29.549414 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:29.559619 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:29.572149 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2340904-a58c-4caf-aca9-a287be57411c None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:29.606801 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5db8b-4f12-49c0-8193-47cbc4af0fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:29.607636 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5db8b-4f12-49c0-8193-47cbc4af0fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:29.607922 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5db8b-4f12-49c0-8193-47cbc4af0fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:29.608205 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5db8b-4f12-49c0-8193-47cbc4af0fa5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:29.618878 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e5db8b-4f12-49c0-8193-47cbc4af0fa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:58:29.626528 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-62e5db8b-4f12-49c0-8193-47cbc4af0fa5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 03:58:29.626528 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:29.626528 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:29.626528 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:29.626528 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:29.626528 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:29.626528 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:29.626528 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:29.626528 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:29.626528 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:29.626528 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:29.626528 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:29.626528 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:58:29.626528 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:58:29.626528 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:58:29.626528 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:58:29.627482 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:58:29.627482 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:58:29.627482 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:58:29.627482 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:58:29.627482 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:29.627482 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:29.627482 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:29.627482 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:29.627482 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:29.627482 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:29.627482 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:29.627482 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:29.627482 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:29.627482 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:29.627482 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:29.627482 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:29.628329 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:29.628329 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:29.628329 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:29.628329 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:29.628329 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:58:29.628329 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:58:29.628329 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:58:29.628329 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:58:29.628329 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:58:29.628329 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:58:29.628329 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 03:58:29.628329 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:29.632666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 320/638] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Jul 4 03:58:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:29.633537 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5db8b-4f12-49c0-8193-47cbc4af0fa5 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:29.647268 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7a746-2319-4fe0-bdde-78df30e14570 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:29.685353 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593dd037-30f2-4f8e-8251-e802030b55b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:29.686645 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593dd037-30f2-4f8e-8251-e802030b55b7 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:29.687157 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593dd037-30f2-4f8e-8251-e802030b55b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:29.687649 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593dd037-30f2-4f8e-8251-e802030b55b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:29.699935 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593dd037-30f2-4f8e-8251-e802030b55b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:29.701876 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593dd037-30f2-4f8e-8251-e802030b55b7 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:29.720664 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-593dd037-30f2-4f8e-8251-e802030b55b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:29.720664 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:29.720664 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:29.720664 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:29.720664 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:29.720664 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:29.720664 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:29.720664 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:29.720664 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:29.720664 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:29.720664 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:29.720664 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:29.720664 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:29.720664 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:29.720664 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:29.721582 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:29.721582 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:29.721582 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:29.721582 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:29.721582 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:29.721582 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:29.721582 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:29.721582 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:29.721582 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:29.721582 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:29.721582 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:29.721582 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:29.721582 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:29.721582 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:29.721582 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:29.721582 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:29.721582 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:29.722519 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:29.722519 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:29.722519 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:29.722519 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:29.724882 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 319/639] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:29.725973 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593dd037-30f2-4f8e-8251-e802030b55b7 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:29.736230 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5db8b-4f12-49c0-8193-47cbc4af0fa5 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:29.772946 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5f553-66fd-480d-8033-144a19ba3ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:29.773809 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5f553-66fd-480d-8033-144a19ba3ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:29.774095 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5f553-66fd-480d-8033-144a19ba3ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:29.774397 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5f553-66fd-480d-8033-144a19ba3ac4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:29.777474 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:29.783188 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd5f553-66fd-480d-8033-144a19ba3ac4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:29.784665 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd5f553-66fd-480d-8033-144a19ba3ac4 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:29.799671 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-acd5f553-66fd-480d-8033-144a19ba3ac4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 04 03:58:29.799671 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:29.799671 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:29.799671 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:29.799671 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:29.799671 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:29.799671 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:29.799671 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:29.799671 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:29.799671 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:29.799671 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:29.799671 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:29.799671 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 03:58:29.799671 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 03:58:29.799671 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 03:58:29.799671 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 03:58:29.800739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:29.800739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:29.800739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 03:58:29.800739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:29.800739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 03:58:29.800739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:29.800739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:29.800739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:29.800739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:29.800739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:29.800739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:29.800739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:29.800739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:29.800739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:29.800739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:29.800739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:29.800739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:29.800739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:29.801700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:29.801700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:29.801700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 03:58:29.801700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 03:58:29.801700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 03:58:29.801700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 03:58:29.801700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 03:58:29.801700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 03:58:29.801700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 04 03:58:29.801700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:29.805619 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 321/640] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:58:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:29.806631 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5f553-66fd-480d-8033-144a19ba3ac4 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:29.823575 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:29.849126 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593dd037-30f2-4f8e-8251-e802030b55b7 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:29.886574 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b5e27-8da6-4c86-a99c-ac5e6f9df0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:29.887635 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b5e27-8da6-4c86-a99c-ac5e6f9df0fc None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:29.888124 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b5e27-8da6-4c86-a99c-ac5e6f9df0fc None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:29.888705 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b5e27-8da6-4c86-a99c-ac5e6f9df0fc None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:29.889788 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b5e27-8da6-4c86-a99c-ac5e6f9df0fc None admin] RBAC: Adding query filter params (name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:29.890325 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b5e27-8da6-4c86-a99c-ac5e6f9df0fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:29.892042 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b5e27-8da6-4c86-a99c-ac5e6f9df0fc None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:29.903307 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 320/641] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Jul 4 03:58:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:29.904484 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b5e27-8da6-4c86-a99c-ac5e6f9df0fc None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:29.912148 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5f553-66fd-480d-8033-144a19ba3ac4 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:29.946745 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96e495-757f-4e52-bbbf-8aae3a3a78a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:29.947422 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96e495-757f-4e52-bbbf-8aae3a3a78a5 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:29.947749 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96e495-757f-4e52-bbbf-8aae3a3a78a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:29.948083 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96e495-757f-4e52-bbbf-8aae3a3a78a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:29.948823 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f96e495-757f-4e52-bbbf-8aae3a3a78a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:29.949131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f96e495-757f-4e52-bbbf-8aae3a3a78a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:29.950558 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f96e495-757f-4e52-bbbf-8aae3a3a78a5 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:29.963833 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 322/642] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:29.964370 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96e495-757f-4e52-bbbf-8aae3a3a78a5 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:30.024917 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:30.027320 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b5e27-8da6-4c86-a99c-ac5e6f9df0fc None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:30.064287 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818473bb-141f-4c3c-be39-cab4e947d30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:30.064966 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818473bb-141f-4c3c-be39-cab4e947d30f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:30.065256 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818473bb-141f-4c3c-be39-cab4e947d30f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:30.065536 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818473bb-141f-4c3c-be39-cab4e947d30f None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:30.066445 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818473bb-141f-4c3c-be39-cab4e947d30f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:30.066765 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818473bb-141f-4c3c-be39-cab4e947d30f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:30.068253 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818473bb-141f-4c3c-be39-cab4e947d30f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:30.074101 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96e495-757f-4e52-bbbf-8aae3a3a78a5 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:30.078900 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:30.092217 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 321/643] 10.222.0.49 () {56 vars in 1137 bytes} [Mon Jul 4 03:58:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:30.092217 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818473bb-141f-4c3c-be39-cab4e947d30f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:30.113461 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e05a4-51dd-4092-860d-bdde5817dbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:30.114398 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e05a4-51dd-4092-860d-bdde5817dbd3 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:30.114685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e05a4-51dd-4092-860d-bdde5817dbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:30.114973 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e05a4-51dd-4092-860d-bdde5817dbd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:30.125569 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e05a4-51dd-4092-860d-bdde5817dbd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:30.127075 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e05a4-51dd-4092-860d-bdde5817dbd3 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:30.144978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-611e05a4-51dd-4092-860d-bdde5817dbd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:30.144978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:30.144978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:30.144978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:30.144978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:30.144978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:30.144978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:30.144978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:30.144978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:30.144978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:30.144978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:30.144978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:30.144978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:30.144978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:30.144978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:30.145887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:30.145887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:30.145887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:30.145887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:30.145887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:30.145887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:30.145887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:30.145887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:30.145887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:30.145887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:30.145887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:30.145887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:30.145887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:30.145887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:30.145887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:30.145887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:30.145887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:30.146995 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:30.146995 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:30.146995 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:30.146995 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:30.146995 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 323/644] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:30.147826 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f462d-d010-4aa3-abd0-978dca2be2df None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:30.147826 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f462d-d010-4aa3-abd0-978dca2be2df None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:30.148077 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f462d-d010-4aa3-abd0-978dca2be2df None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:30.153501 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 324/645] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:30.153501 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f462d-d010-4aa3-abd0-978dca2be2df None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:30.213504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818473bb-141f-4c3c-be39-cab4e947d30f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:30.252583 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f9309-9d10-4249-bb63-4fc40c91a33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:30.253508 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f462d-d010-4aa3-abd0-978dca2be2df None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:30.253868 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f9309-9d10-4249-bb63-4fc40c91a33c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:30.254339 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f9309-9d10-4249-bb63-4fc40c91a33c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:30.254786 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f9309-9d10-4249-bb63-4fc40c91a33c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:30.262704 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f9309-9d10-4249-bb63-4fc40c91a33c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:30.263348 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:30.265298 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f9309-9d10-4249-bb63-4fc40c91a33c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:30.279584 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-856f9309-9d10-4249-bb63-4fc40c91a33c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:30.279584 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:30.279584 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:30.279584 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:30.279584 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:30.279584 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:30.279584 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:30.279584 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:30.279584 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:30.279584 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:30.279584 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:30.279584 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:30.279584 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 03:58:30.279584 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 03:58:30.279584 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 03:58:30.280667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 03:58:30.280667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:30.280667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:30.280667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:30.280667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:30.280667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:30.280667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:30.280667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:30.280667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:30.280667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:30.280667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:30.280667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:30.280667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:30.280667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:30.280667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:30.280667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:30.280667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:30.281802 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 03:58:30.281802 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 03:58:30.281802 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 03:58:30.281802 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 03:58:30.281802 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 03:58:30.281802 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 03:58:30.281802 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:30.281802 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:30.288354 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 322/646] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:58:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:30.289432 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f9309-9d10-4249-bb63-4fc40c91a33c None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:30.291717 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690fb1f4-1cdb-4c5d-b376-5a5a23c3c5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:30.292592 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fb1f4-1cdb-4c5d-b376-5a5a23c3c5ad None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:30.292911 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fb1f4-1cdb-4c5d-b376-5a5a23c3c5ad None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:30.293199 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fb1f4-1cdb-4c5d-b376-5a5a23c3c5ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:30.355968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:30.367210 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690fb1f4-1cdb-4c5d-b376-5a5a23c3c5ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:30.369008 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690fb1f4-1cdb-4c5d-b376-5a5a23c3c5ad None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:30.401699 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f9309-9d10-4249-bb63-4fc40c91a33c None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:30.436326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc563b-7427-4cfb-b890-77b69b495740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:30.437000 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc563b-7427-4cfb-b890-77b69b495740 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:30.437593 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc563b-7427-4cfb-b890-77b69b495740 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:30.437593 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc563b-7427-4cfb-b890-77b69b495740 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:30.438299 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc563b-7427-4cfb-b890-77b69b495740 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:30.438601 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc563b-7427-4cfb-b890-77b69b495740 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:30.440124 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc563b-7427-4cfb-b890-77b69b495740 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:30.452180 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 323/647] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:30.453218 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e130c11-5036-432c-b6ee-458ef50472b7 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:30.453510 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e130c11-5036-432c-b6ee-458ef50472b7 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:30.453789 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e130c11-5036-432c-b6ee-458ef50472b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:30.470388 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-6e130c11-5036-432c-b6ee-458ef50472b7 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:30.471612 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6e130c11-5036-432c-b6ee-458ef50472b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:30.478519 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 325/648] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:58:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 03:58:30.479642 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690fb1f4-1cdb-4c5d-b376-5a5a23c3c5ad None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:30.492350 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:30.558260 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 324/649] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:58:30.558260 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e130c11-5036-432c-b6ee-458ef50472b7 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:30.601220 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690fb1f4-1cdb-4c5d-b376-5a5a23c3c5ad None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:30.609997 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:30.639420 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f48938-5951-4d28-804b-d9b91124b394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:30.640093 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f48938-5951-4d28-804b-d9b91124b394 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:30.640379 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f48938-5951-4d28-804b-d9b91124b394 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:30.640664 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f48938-5951-4d28-804b-d9b91124b394 None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:30.641462 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f48938-5951-4d28-804b-d9b91124b394 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:30.641780 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f48938-5951-4d28-804b-d9b91124b394 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:30.643279 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f48938-5951-4d28-804b-d9b91124b394 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:30.659890 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 326/650] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Jul 4 03:58:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:30.659890 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f48938-5951-4d28-804b-d9b91124b394 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:30.669334 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e130c11-5036-432c-b6ee-458ef50472b7 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:30.704726 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f326e-92b5-42ad-adde-2e0e6afc164d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:30.705534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f326e-92b5-42ad-adde-2e0e6afc164d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:30.705809 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f326e-92b5-42ad-adde-2e0e6afc164d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:30.706084 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f326e-92b5-42ad-adde-2e0e6afc164d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:30.713230 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f326e-92b5-42ad-adde-2e0e6afc164d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:30.714749 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f326e-92b5-42ad-adde-2e0e6afc164d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:30.722732 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:30.729097 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-335f326e-92b5-42ad-adde-2e0e6afc164d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 04 03:58:30.729097 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:30.729097 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:30.729097 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:30.729097 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:30.729097 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:30.729097 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:30.729097 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:30.729097 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:30.729097 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:30.729097 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:30.729097 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:30.729097 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 03:58:30.729097 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 03:58:30.729097 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 03:58:30.729097 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 03:58:30.730054 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:30.730054 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:30.730054 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 03:58:30.730054 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:30.730054 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 03:58:30.730054 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:30.730054 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:30.730054 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:30.730054 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:30.730054 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:30.730054 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:30.730054 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:30.730054 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:30.730054 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:30.730054 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:30.730054 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:30.730054 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:30.730054 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:30.731044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:30.731044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:30.731044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 03:58:30.731044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 03:58:30.731044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 03:58:30.731044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 03:58:30.731044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 03:58:30.731044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 03:58:30.731044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 04 03:58:30.731044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:30.731044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 325/651] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:58:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:30.731044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f326e-92b5-42ad-adde-2e0e6afc164d None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:30.757070 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f48938-5951-4d28-804b-d9b91124b394 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:30.794674 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1d752-3236-43b5-963f-20240bffa6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:30.795472 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1d752-3236-43b5-963f-20240bffa6d0 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:30.795766 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1d752-3236-43b5-963f-20240bffa6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:30.796061 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1d752-3236-43b5-963f-20240bffa6d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:30.807222 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1d752-3236-43b5-963f-20240bffa6d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:30.808763 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1d752-3236-43b5-963f-20240bffa6d0 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:30.825805 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-d1f1d752-3236-43b5-963f-20240bffa6d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:30.825805 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:30.825805 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:30.825805 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:30.825805 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:30.825805 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:30.825805 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:30.825805 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:30.825805 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:30.825805 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:30.825805 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:30.825805 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:30.825805 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:30.825805 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:30.825805 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:30.826782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:30.826782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:30.826782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:30.826782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:30.826782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:30.826782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:30.826782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:30.826782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:30.826782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:30.826782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:30.826782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:30.826782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:30.826782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:30.826782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:30.826782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:30.826782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:30.826782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:30.827674 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:30.827674 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:30.827674 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:30.827674 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:30.827674 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 327/652] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:30.827985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1d752-3236-43b5-963f-20240bffa6d0 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:30.842530 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f326e-92b5-42ad-adde-2e0e6afc164d None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:30.852518 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:30.878021 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba0fbe-b09a-428d-a32b-b7ede308b36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:30.878855 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba0fbe-b09a-428d-a32b-b7ede308b36b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:30.879144 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba0fbe-b09a-428d-a32b-b7ede308b36b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:30.879425 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba0fbe-b09a-428d-a32b-b7ede308b36b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:30.889737 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba0fbe-b09a-428d-a32b-b7ede308b36b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:58:30.897442 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-96ba0fbe-b09a-428d-a32b-b7ede308b36b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 03:58:30.897442 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:30.897442 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:30.897442 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:30.897442 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:30.897442 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:30.897442 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:30.897442 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:30.897442 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:30.897442 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:30.897442 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:30.897442 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:30.897442 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:58:30.897442 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:58:30.897442 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:58:30.897442 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:58:30.898580 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:58:30.898580 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:58:30.898580 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:58:30.898580 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:58:30.898580 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:30.898580 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:30.898580 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:30.898580 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:30.898580 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:30.898580 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:30.898580 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:30.898580 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:30.898580 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:30.898580 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:30.898580 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:30.898580 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:30.899453 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:30.899453 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:30.899453 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:30.899453 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:30.899453 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:58:30.899453 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:58:30.899453 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:58:30.899453 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:58:30.899453 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:58:30.899453 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:58:30.899453 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 03:58:30.899453 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:30.899453 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 326/653] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Jul 4 03:58:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:30.900143 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42805ed7-e216-469b-ae13-58ff7e4d40bf None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:30.900211 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42805ed7-e216-469b-ae13-58ff7e4d40bf None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:30.900754 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42805ed7-e216-469b-ae13-58ff7e4d40bf None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:30.905947 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 327/654] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:30.905947 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42805ed7-e216-469b-ae13-58ff7e4d40bf None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:30.928067 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1d752-3236-43b5-963f-20240bffa6d0 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:30.947313 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:30.961143 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1124046-566c-4489-b592-7272cfd5ef41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:30.961809 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1124046-566c-4489-b592-7272cfd5ef41 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:30.962098 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1124046-566c-4489-b592-7272cfd5ef41 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:30.962412 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1124046-566c-4489-b592-7272cfd5ef41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:30.963257 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1124046-566c-4489-b592-7272cfd5ef41 None admin] RBAC: Adding query filter params (role.id=7fd75ec0129248b28b5254e00d4f6f0b, scope.project.id=424a145a22434ef7a14b6108e6118ccb, user.id=8334e75253f843a980b01c6f0cda6015) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:30.963575 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1124046-566c-4489-b592-7272cfd5ef41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:30.965045 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1124046-566c-4489-b592-7272cfd5ef41 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:30.973444 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 328/655] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:58:30 2022] GET /identity/v3/role_assignments?user.id=8334e75253f843a980b01c6f0cda6015&scope.project.id=424a145a22434ef7a14b6108e6118ccb&role.id=7fd75ec0129248b28b5254e00d4f6f0b => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:30.974359 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1124046-566c-4489-b592-7272cfd5ef41 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:31.017432 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42805ed7-e216-469b-ae13-58ff7e4d40bf None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:31.057695 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9783f45-59c7-4a08-8f82-2f0d5beab314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:31.058430 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9783f45-59c7-4a08-8f82-2f0d5beab314 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:31.058721 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9783f45-59c7-4a08-8f82-2f0d5beab314 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:31.059063 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9783f45-59c7-4a08-8f82-2f0d5beab314 None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:31.059879 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9783f45-59c7-4a08-8f82-2f0d5beab314 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:31.060201 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9783f45-59c7-4a08-8f82-2f0d5beab314 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:31.061704 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9783f45-59c7-4a08-8f82-2f0d5beab314 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:31.084625 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 328/656] 10.222.0.49 () {56 vars in 1137 bytes} [Mon Jul 4 03:58:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:31.085437 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9783f45-59c7-4a08-8f82-2f0d5beab314 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:31.114650 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1124046-566c-4489-b592-7272cfd5ef41 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:31.125359 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:31.155036 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960fa5fa-8ebf-456c-ba5a-2dbf1d24bc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:31.156308 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fa5fa-8ebf-456c-ba5a-2dbf1d24bc0a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:31.156308 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fa5fa-8ebf-456c-ba5a-2dbf1d24bc0a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:31.156681 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fa5fa-8ebf-456c-ba5a-2dbf1d24bc0a None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:31.157558 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960fa5fa-8ebf-456c-ba5a-2dbf1d24bc0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:31.157997 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960fa5fa-8ebf-456c-ba5a-2dbf1d24bc0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:31.159889 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960fa5fa-8ebf-456c-ba5a-2dbf1d24bc0a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:31.173985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 329/657] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:31.175330 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f296d0-455c-4505-81d8-46223c5b8914 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:31.175623 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f296d0-455c-4505-81d8-46223c5b8914 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:31.175900 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f296d0-455c-4505-81d8-46223c5b8914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:31.198230 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-58f296d0-455c-4505-81d8-46223c5b8914 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:31.198720 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-58f296d0-455c-4505-81d8-46223c5b8914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:31.217255 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9783f45-59c7-4a08-8f82-2f0d5beab314 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:31.241700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:31.255689 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b152136-46cf-424a-95a6-c0d33fd2768d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:31.256637 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b152136-46cf-424a-95a6-c0d33fd2768d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:31.256933 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b152136-46cf-424a-95a6-c0d33fd2768d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:31.257275 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b152136-46cf-424a-95a6-c0d33fd2768d None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:31.258718 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b152136-46cf-424a-95a6-c0d33fd2768d None admin] RBAC: Adding query filter params (name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:31.259040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b152136-46cf-424a-95a6-c0d33fd2768d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:31.261302 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b152136-46cf-424a-95a6-c0d33fd2768d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:31.269383 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 330/658] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:58:31.270985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f296d0-455c-4505-81d8-46223c5b8914 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:31.275201 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 329/659] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Jul 4 03:58:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:31.276084 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b152136-46cf-424a-95a6-c0d33fd2768d None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:31.370436 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:31.383995 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f296d0-455c-4505-81d8-46223c5b8914 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:31.386894 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b152136-46cf-424a-95a6-c0d33fd2768d None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:31.425541 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ae5e3-6370-485d-b9a6-9e8e5f69576a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:31.426630 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2392f8-ad11-4cc5-8f11-271a57d9b3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:31.427449 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2392f8-ad11-4cc5-8f11-271a57d9b3b0 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:31.427740 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2392f8-ad11-4cc5-8f11-271a57d9b3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:31.428022 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2392f8-ad11-4cc5-8f11-271a57d9b3b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:31.430063 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ae5e3-6370-485d-b9a6-9e8e5f69576a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:31.430389 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ae5e3-6370-485d-b9a6-9e8e5f69576a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:31.430666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ae5e3-6370-485d-b9a6-9e8e5f69576a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:31.436047 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2392f8-ad11-4cc5-8f11-271a57d9b3b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:31.437534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2392f8-ad11-4cc5-8f11-271a57d9b3b0 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:31.453324 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-dd2392f8-ad11-4cc5-8f11-271a57d9b3b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:31.453324 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:31.453324 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:31.453324 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:31.453324 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:31.453324 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:31.453324 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:31.453324 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:31.453324 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:31.453324 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:31.453324 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:31.453324 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:31.453324 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 03:58:31.453324 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 03:58:31.453324 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 03:58:31.454534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 03:58:31.454534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:31.454534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:31.454534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:31.454534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:31.454534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:31.454534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:31.454534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:31.454534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:31.454534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:31.454534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:31.454534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:31.454534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:31.454534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:31.454534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:31.454534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:31.454534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:31.455448 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 03:58:31.455448 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 03:58:31.455448 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 03:58:31.455448 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 03:58:31.455448 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 03:58:31.455448 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 03:58:31.455448 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:31.455448 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:31.455448 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 330/660] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:58:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:31.455962 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2392f8-ad11-4cc5-8f11-271a57d9b3b0 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:31.482778 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:31.515870 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ae5e3-6370-485d-b9a6-9e8e5f69576a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:31.517488 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ae5e3-6370-485d-b9a6-9e8e5f69576a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:31.559447 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2392f8-ad11-4cc5-8f11-271a57d9b3b0 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:31.596220 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694821b-5bf0-43c4-981a-5fa80abdab8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:31.597023 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694821b-5bf0-43c4-981a-5fa80abdab8a None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:31.597312 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694821b-5bf0-43c4-981a-5fa80abdab8a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:31.597594 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694821b-5bf0-43c4-981a-5fa80abdab8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:31.607884 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5694821b-5bf0-43c4-981a-5fa80abdab8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:31.609361 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5694821b-5bf0-43c4-981a-5fa80abdab8a None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:31.618626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:31.629450 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 331/661] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:58:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 03:58:31.629450 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ae5e3-6370-485d-b9a6-9e8e5f69576a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:31.630651 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-5694821b-5bf0-43c4-981a-5fa80abdab8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:31.630651 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:31.630651 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:31.630651 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:31.630651 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:31.630651 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:31.630651 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:31.630651 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:31.630651 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:31.630651 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:31.630651 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:31.630651 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:31.630651 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:31.630651 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:31.630651 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:31.631491 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:31.631491 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:31.631491 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:31.631491 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:31.631491 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:31.631491 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:31.631491 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:31.631491 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:31.631491 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:31.631491 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:31.631491 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:31.631491 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:31.631491 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:31.631491 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:31.631491 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:31.631491 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:31.631491 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:31.632374 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:31.632374 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:31.632374 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:31.632374 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:31.632374 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 331/662] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:31.632374 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694821b-5bf0-43c4-981a-5fa80abdab8a None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:31.708030 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:31.734868 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ae5e3-6370-485d-b9a6-9e8e5f69576a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:31.740186 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694821b-5bf0-43c4-981a-5fa80abdab8a None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:31.770448 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5544a-3b46-4e35-bb3e-8701192f8021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:31.771308 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5544a-3b46-4e35-bb3e-8701192f8021 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:31.771598 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5544a-3b46-4e35-bb3e-8701192f8021 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:31.771879 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5544a-3b46-4e35-bb3e-8701192f8021 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:31.777363 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c220ab8-df10-484c-85ee-a99e975c198c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:31.778032 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c220ab8-df10-484c-85ee-a99e975c198c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:31.778348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c220ab8-df10-484c-85ee-a99e975c198c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:31.778627 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c220ab8-df10-484c-85ee-a99e975c198c None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:31.779420 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c220ab8-df10-484c-85ee-a99e975c198c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:31.779742 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c220ab8-df10-484c-85ee-a99e975c198c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:31.781205 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c220ab8-df10-484c-85ee-a99e975c198c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:31.782522 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5544a-3b46-4e35-bb3e-8701192f8021 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:58:31.790356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-5df5544a-3b46-4e35-bb3e-8701192f8021 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 03:58:31.790356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:31.790356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:31.790356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:31.790356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:31.790356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:31.790356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:31.790356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:31.790356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:31.790356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:31.790356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:31.790356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:31.790356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:58:31.790356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:58:31.790356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:58:31.790356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:58:31.791561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:58:31.791561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:58:31.791561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:58:31.791561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:58:31.791561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:31.791561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:31.791561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:31.791561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:31.791561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:31.791561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:31.791561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:31.791561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:31.791561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:31.791561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:31.791561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:31.791561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:31.797362 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:31.797362 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:31.797362 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:31.797362 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:31.797362 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:58:31.797362 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:58:31.797362 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:58:31.797362 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:58:31.797362 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:58:31.797362 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:58:31.797362 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 03:58:31.797362 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:31.797362 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 332/663] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Jul 4 03:58:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:31.797362 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5544a-3b46-4e35-bb3e-8701192f8021 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:31.798437 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 332/664] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Jul 4 03:58:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:31.798437 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c220ab8-df10-484c-85ee-a99e975c198c None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:31.860268 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:31.902129 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c220ab8-df10-484c-85ee-a99e975c198c None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:31.907564 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5544a-3b46-4e35-bb3e-8701192f8021 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:31.937455 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9841f8-4174-43ec-8791-3c3773296095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:31.938122 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9841f8-4174-43ec-8791-3c3773296095 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:31.938440 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9841f8-4174-43ec-8791-3c3773296095 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:31.938818 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9841f8-4174-43ec-8791-3c3773296095 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:31.939552 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9841f8-4174-43ec-8791-3c3773296095 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:31.939868 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9841f8-4174-43ec-8791-3c3773296095 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:31.941490 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9841f8-4174-43ec-8791-3c3773296095 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:31.942315 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865d899-48f3-4dd3-8149-6bd80747d73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:31.943173 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865d899-48f3-4dd3-8149-6bd80747d73e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:31.943526 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865d899-48f3-4dd3-8149-6bd80747d73e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:31.943876 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865d899-48f3-4dd3-8149-6bd80747d73e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:31.945989 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:31.955226 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4865d899-48f3-4dd3-8149-6bd80747d73e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:31.960630 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 333/665] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:31.960759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4865d899-48f3-4dd3-8149-6bd80747d73e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:31.960875 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9841f8-4174-43ec-8791-3c3773296095 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:31.979850 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-4865d899-48f3-4dd3-8149-6bd80747d73e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:31.979850 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:31.979850 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:31.979850 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:31.979850 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:31.979850 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:31.979850 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:31.979850 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:31.979850 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:31.979850 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:31.979850 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:31.979850 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:31.979850 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:31.979850 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:31.979850 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:31.980951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:31.980951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:31.980951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:31.980951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:31.980951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:31.980951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:31.980951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:31.980951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:31.980951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:31.980951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:31.980951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:31.980951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:31.980951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:31.980951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:31.980951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:31.980951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:31.980951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:31.982066 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:31.982066 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:31.982066 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:31.982066 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:31.987890 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 333/666] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:31.987890 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865d899-48f3-4dd3-8149-6bd80747d73e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:32.081192 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9841f8-4174-43ec-8791-3c3773296095 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:32.087929 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865d899-48f3-4dd3-8149-6bd80747d73e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:32.102110 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:32.116382 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc26da8-4394-4a46-94ac-7ad80b2c1dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:32.117148 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc26da8-4394-4a46-94ac-7ad80b2c1dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:32.117501 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc26da8-4394-4a46-94ac-7ad80b2c1dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:32.117850 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc26da8-4394-4a46-94ac-7ad80b2c1dc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:32.118708 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc26da8-4394-4a46-94ac-7ad80b2c1dc6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:32.119022 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc26da8-4394-4a46-94ac-7ad80b2c1dc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:32.120429 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc26da8-4394-4a46-94ac-7ad80b2c1dc6 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:32.123202 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984adc35-d5bf-4864-9b81-416b784c062d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:32.124072 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984adc35-d5bf-4864-9b81-416b784c062d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:32.124503 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984adc35-d5bf-4864-9b81-416b784c062d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:32.124953 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984adc35-d5bf-4864-9b81-416b784c062d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:32.126089 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984adc35-d5bf-4864-9b81-416b784c062d None admin] RBAC: Adding query filter params (role.id=7fd75ec0129248b28b5254e00d4f6f0b, scope.project.id=424a145a22434ef7a14b6108e6118ccb, user.id=60e29ce1e3d64431bc7aa80d55787ae5) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:32.126444 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984adc35-d5bf-4864-9b81-416b784c062d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:32.127942 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984adc35-d5bf-4864-9b81-416b784c062d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:32.134214 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 334/667] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Jul 4 03:58:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:32.134214 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc26da8-4394-4a46-94ac-7ad80b2c1dc6 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:32.150184 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 334/668] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:58:31 2022] GET /identity/v3/role_assignments?user.id=60e29ce1e3d64431bc7aa80d55787ae5&scope.project.id=424a145a22434ef7a14b6108e6118ccb&role.id=7fd75ec0129248b28b5254e00d4f6f0b => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:32.150184 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984adc35-d5bf-4864-9b81-416b784c062d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:32.238572 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:32.251614 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc26da8-4394-4a46-94ac-7ad80b2c1dc6 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:32.272056 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984adc35-d5bf-4864-9b81-416b784c062d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:32.288521 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0fb4d-2f6c-4d95-916b-f9b9af05fac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:32.289342 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0fb4d-2f6c-4d95-916b-f9b9af05fac5 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:32.289632 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0fb4d-2f6c-4d95-916b-f9b9af05fac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:32.289908 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0fb4d-2f6c-4d95-916b-f9b9af05fac5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:32.298686 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd0fb4d-2f6c-4d95-916b-f9b9af05fac5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:32.300194 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd0fb4d-2f6c-4d95-916b-f9b9af05fac5 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:32.312359 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb490f-d976-4d42-83f4-c64c1febfdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:32.313352 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb490f-d976-4d42-83f4-c64c1febfdac None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:32.313856 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb490f-d976-4d42-83f4-c64c1febfdac None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:32.314378 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb490f-d976-4d42-83f4-c64c1febfdac None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:32.315307 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb490f-d976-4d42-83f4-c64c1febfdac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:32.315813 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb490f-d976-4d42-83f4-c64c1febfdac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:32.316459 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-dbd0fb4d-2f6c-4d95-916b-f9b9af05fac5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 04 03:58:32.316459 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:32.316459 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:32.316459 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:32.316459 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:32.316459 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:32.316459 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:32.316459 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:32.316459 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:32.316459 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:32.316459 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:32.316459 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:32.316459 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 03:58:32.316459 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 03:58:32.316459 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 03:58:32.316459 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 03:58:32.317373 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:32.317373 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:32.317373 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 03:58:32.317373 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:32.317373 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 03:58:32.317373 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:32.317373 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:32.317373 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:32.317373 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:32.317373 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:32.317373 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:32.317373 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:32.317373 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:32.317373 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:32.317373 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:32.317373 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:32.317373 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:32.317373 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:32.318721 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:32.318721 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:32.318721 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 03:58:32.318721 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 03:58:32.318721 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 03:58:32.318721 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 03:58:32.318721 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 03:58:32.318721 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 03:58:32.318721 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 04 03:58:32.318721 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:32.318721 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 335/669] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Jul 4 03:58:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:32.318721 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0fb4d-2f6c-4d95-916b-f9b9af05fac5 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:32.320745 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb490f-d976-4d42-83f4-c64c1febfdac None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:32.334227 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 335/670] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:32.335348 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb490f-d976-4d42-83f4-c64c1febfdac None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:32.374437 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:32.451069 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb490f-d976-4d42-83f4-c64c1febfdac None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:32.454823 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0fb4d-2f6c-4d95-916b-f9b9af05fac5 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:32.467501 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:32.493300 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c1fe92-c86c-4dd3-be3c-fbfa5f084870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:32.493894 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1fe92-c86c-4dd3-be3c-fbfa5f084870 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:32.494203 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1fe92-c86c-4dd3-be3c-fbfa5f084870 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:32.494488 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c1fe92-c86c-4dd3-be3c-fbfa5f084870 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:32.494961 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42203f-2a21-469a-893f-445e366eaceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:32.495338 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c1fe92-c86c-4dd3-be3c-fbfa5f084870 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:32.495649 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c1fe92-c86c-4dd3-be3c-fbfa5f084870 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:32.496250 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42203f-2a21-469a-893f-445e366eaceb None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:32.496689 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42203f-2a21-469a-893f-445e366eaceb None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:32.497086 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c1fe92-c86c-4dd3-be3c-fbfa5f084870 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:32.497261 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42203f-2a21-469a-893f-445e366eaceb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:32.508796 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42203f-2a21-469a-893f-445e366eaceb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:32.510542 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42203f-2a21-469a-893f-445e366eaceb None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:32.516965 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 336/671] 10.222.0.49 () {56 vars in 1139 bytes} [Mon Jul 4 03:58:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:32.518005 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c1fe92-c86c-4dd3-be3c-fbfa5f084870 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:32.529226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-bf42203f-2a21-469a-893f-445e366eaceb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:32.529226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:32.529226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:32.529226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:32.529226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:32.529226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:32.529226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:32.529226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:32.529226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:32.529226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:32.529226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:32.529226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:32.529226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:32.529226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:32.529226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:32.530469 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:32.530469 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:32.530469 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:32.530469 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:32.530469 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:32.530469 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:32.530469 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:32.530469 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:32.530469 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:32.530469 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:32.530469 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:32.530469 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:32.530469 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:32.530469 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:32.530469 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:32.530469 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:32.530469 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:32.531701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:32.531701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:32.531701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:32.531701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:32.533560 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 336/672] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:32.534689 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42203f-2a21-469a-893f-445e366eaceb None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:32.625351 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c1fe92-c86c-4dd3-be3c-fbfa5f084870 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:32.629450 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:32.637753 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42203f-2a21-469a-893f-445e366eaceb None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:32.664668 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8fea9-7efb-4177-9d17-c263f2d39af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:32.665475 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8fea9-7efb-4177-9d17-c263f2d39af5 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:32.666027 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8fea9-7efb-4177-9d17-c263f2d39af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:32.666143 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8fea9-7efb-4177-9d17-c263f2d39af5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:32.673369 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8fea9-7efb-4177-9d17-c263f2d39af5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:32.674283 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7e341-f738-44f4-9bda-6bfdc56eb22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:32.674865 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8fea9-7efb-4177-9d17-c263f2d39af5 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:32.675529 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7e341-f738-44f4-9bda-6bfdc56eb22e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:32.676000 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7e341-f738-44f4-9bda-6bfdc56eb22e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:32.676454 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7e341-f738-44f4-9bda-6bfdc56eb22e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:32.689634 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-a4e8fea9-7efb-4177-9d17-c263f2d39af5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:32.689634 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:32.689634 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:32.689634 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:32.689634 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:32.689634 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:32.689634 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:32.689634 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:32.689634 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:32.689634 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:32.689634 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:32.689634 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:32.689634 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 03:58:32.689634 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 03:58:32.689634 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 03:58:32.690653 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 03:58:32.690653 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:32.690653 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:32.690653 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:32.690653 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:32.690653 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:32.690653 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:32.690653 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:32.690653 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:32.690653 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:32.690653 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:32.690653 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:32.690653 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:32.690653 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:32.690653 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:32.690653 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:32.690653 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:32.691569 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 03:58:32.691569 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 03:58:32.691569 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 03:58:32.691569 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 03:58:32.691569 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 03:58:32.691569 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 03:58:32.691569 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:32.691569 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:32.695648 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 337/673] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:58:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:32.696614 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8fea9-7efb-4177-9d17-c263f2d39af5 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:32.728142 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:32.750874 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7e341-f738-44f4-9bda-6bfdc56eb22e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:32.752920 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7e341-f738-44f4-9bda-6bfdc56eb22e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:32.820405 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8fea9-7efb-4177-9d17-c263f2d39af5 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:32.849228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:32.858907 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 337/674] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:58:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 03:58:32.860046 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7e341-f738-44f4-9bda-6bfdc56eb22e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:32.871697 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50b675-7a6f-426c-9203-eb7c85699491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:32.872375 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50b675-7a6f-426c-9203-eb7c85699491 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:32.872664 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50b675-7a6f-426c-9203-eb7c85699491 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:32.872947 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50b675-7a6f-426c-9203-eb7c85699491 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:32.873685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50b675-7a6f-426c-9203-eb7c85699491 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:32.873999 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50b675-7a6f-426c-9203-eb7c85699491 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:32.875441 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50b675-7a6f-426c-9203-eb7c85699491 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:32.894313 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 338/675] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:32.895484 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50b675-7a6f-426c-9203-eb7c85699491 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:32.981156 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7e341-f738-44f4-9bda-6bfdc56eb22e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:33.011561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:33.020095 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e200e-4882-4c05-b1f4-f31ea709ea4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:33.021137 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e200e-4882-4c05-b1f4-f31ea709ea4b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:33.021635 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e200e-4882-4c05-b1f4-f31ea709ea4b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:33.022120 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e200e-4882-4c05-b1f4-f31ea709ea4b None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:33.023213 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e200e-4882-4c05-b1f4-f31ea709ea4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:33.023786 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e200e-4882-4c05-b1f4-f31ea709ea4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:33.025443 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e200e-4882-4c05-b1f4-f31ea709ea4b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:33.025871 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50b675-7a6f-426c-9203-eb7c85699491 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:33.038625 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 338/676] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Jul 4 03:58:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:33.039880 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e200e-4882-4c05-b1f4-f31ea709ea4b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:33.063400 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4134f3-9036-4b6e-b3e8-b3f2ea2f65ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:33.064151 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4134f3-9036-4b6e-b3e8-b3f2ea2f65ce None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:33.064441 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4134f3-9036-4b6e-b3e8-b3f2ea2f65ce None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:33.064725 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4134f3-9036-4b6e-b3e8-b3f2ea2f65ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:33.076867 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4134f3-9036-4b6e-b3e8-b3f2ea2f65ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:33.078376 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4134f3-9036-4b6e-b3e8-b3f2ea2f65ce None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:33.096117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-cb4134f3-9036-4b6e-b3e8-b3f2ea2f65ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:33.096117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:33.096117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:33.096117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:33.096117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:33.096117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:33.096117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:33.096117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:33.096117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:33.096117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:33.096117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:33.096117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:33.096117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:33.096117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:33.096117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:33.097263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:33.097263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:33.097263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:33.097263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:33.097263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:33.097263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:33.097263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:33.097263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:33.097263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:33.097263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:33.097263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:33.097263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:33.097263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:33.097263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:33.097263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:33.097263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:33.097263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:33.098411 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:33.098411 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:33.098411 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:33.098411 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:33.099461 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 339/677] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:33.100187 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4134f3-9036-4b6e-b3e8-b3f2ea2f65ce None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:33.106689 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:33.160346 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e200e-4882-4c05-b1f4-f31ea709ea4b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:33.195118 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534757db-7524-4871-893d-045d54574f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:33.196464 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534757db-7524-4871-893d-045d54574f39 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:33.196958 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534757db-7524-4871-893d-045d54574f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:33.197328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534757db-7524-4871-893d-045d54574f39 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:33.205035 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534757db-7524-4871-893d-045d54574f39 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:33.206677 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534757db-7524-4871-893d-045d54574f39 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:33.207468 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4134f3-9036-4b6e-b3e8-b3f2ea2f65ce None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:33.221179 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-534757db-7524-4871-893d-045d54574f39 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 04 03:58:33.221179 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:33.221179 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:33.221179 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:33.221179 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:33.221179 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:33.221179 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:33.221179 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:33.221179 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:33.221179 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:33.221179 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:33.221179 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:33.221179 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 03:58:33.221179 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 03:58:33.221179 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 03:58:33.221179 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 03:58:33.222377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:33.222377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:33.222377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 03:58:33.222377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:33.222377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 03:58:33.222377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:33.222377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:33.222377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:33.222377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:33.222377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:33.222377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:33.222377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:33.222377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:33.222377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:33.222377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:33.222377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:33.222377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:33.222377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:33.223588 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:33.223588 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:33.223588 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 03:58:33.223588 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 03:58:33.223588 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 03:58:33.223588 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 03:58:33.223588 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 03:58:33.223588 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 03:58:33.223588 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 04 03:58:33.223588 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:33.224210 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 339/678] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Jul 4 03:58:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:33.225215 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8384ec-09be-472f-96e0-296d4dbabe9d None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:33.225501 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8384ec-09be-472f-96e0-296d4dbabe9d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:33.225808 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8384ec-09be-472f-96e0-296d4dbabe9d None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:33.231065 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 340/679] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:33.231806 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8384ec-09be-472f-96e0-296d4dbabe9d None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:33.250633 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e456377-cbc8-451a-88a0-838e1bbc201e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:33.251295 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e456377-cbc8-451a-88a0-838e1bbc201e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:33.251803 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e456377-cbc8-451a-88a0-838e1bbc201e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:33.251937 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e456377-cbc8-451a-88a0-838e1bbc201e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:33.252697 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e456377-cbc8-451a-88a0-838e1bbc201e None admin] RBAC: Adding query filter params (role.id=7fd75ec0129248b28b5254e00d4f6f0b, scope.project.id=424a145a22434ef7a14b6108e6118ccb, user.id=9d20ab1d200447c098d32ebfa130c5de) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:33.253016 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e456377-cbc8-451a-88a0-838e1bbc201e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:33.254564 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e456377-cbc8-451a-88a0-838e1bbc201e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:33.270266 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 340/680] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:58:33 2022] GET /identity/v3/role_assignments?user.id=9d20ab1d200447c098d32ebfa130c5de&scope.project.id=424a145a22434ef7a14b6108e6118ccb&role.id=7fd75ec0129248b28b5254e00d4f6f0b => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:33.270266 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e456377-cbc8-451a-88a0-838e1bbc201e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:33.273350 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:33.364618 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8384ec-09be-472f-96e0-296d4dbabe9d None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:33.380987 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:33.398077 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e456377-cbc8-451a-88a0-838e1bbc201e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:33.406776 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef710a-9079-4531-abf6-b9777f026bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:33.407575 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef710a-9079-4531-abf6-b9777f026bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:33.407930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef710a-9079-4531-abf6-b9777f026bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:33.408215 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef710a-9079-4531-abf6-b9777f026bc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:33.409015 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef710a-9079-4531-abf6-b9777f026bc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:33.409336 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef710a-9079-4531-abf6-b9777f026bc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:33.410829 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef710a-9079-4531-abf6-b9777f026bc6 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:33.429956 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 341/681] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:33.431638 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed579395-c3b5-4c79-8a32-befb61473bdb None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:33.431931 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed579395-c3b5-4c79-8a32-befb61473bdb None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:33.432214 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed579395-c3b5-4c79-8a32-befb61473bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:33.442712 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb9053-4e35-4b24-bb3d-2219dab4629e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:33.443871 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb9053-4e35-4b24-bb3d-2219dab4629e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:33.444284 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb9053-4e35-4b24-bb3d-2219dab4629e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:33.444695 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb9053-4e35-4b24-bb3d-2219dab4629e None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:33.446939 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb9053-4e35-4b24-bb3d-2219dab4629e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:33.447256 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb9053-4e35-4b24-bb3d-2219dab4629e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:33.449029 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb9053-4e35-4b24-bb3d-2219dab4629e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:33.451849 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-ed579395-c3b5-4c79-8a32-befb61473bdb None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:33.453076 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ed579395-c3b5-4c79-8a32-befb61473bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:33.474783 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 341/682] 10.222.0.49 () {56 vars in 1135 bytes} [Mon Jul 4 03:58:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:33.476574 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb9053-4e35-4b24-bb3d-2219dab4629e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:33.537265 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 342/683] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:58:33.538602 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed579395-c3b5-4c79-8a32-befb61473bdb None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:33.571803 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:33.615590 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb9053-4e35-4b24-bb3d-2219dab4629e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:33.657319 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b28063-dfd4-4ff9-839e-acd0521dfdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:33.658120 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b28063-dfd4-4ff9-839e-acd0521dfdf3 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:33.658399 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed579395-c3b5-4c79-8a32-befb61473bdb None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:33.658506 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b28063-dfd4-4ff9-839e-acd0521dfdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:33.658716 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b28063-dfd4-4ff9-839e-acd0521dfdf3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:33.662075 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:33.668993 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b28063-dfd4-4ff9-839e-acd0521dfdf3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:33.671324 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b28063-dfd4-4ff9-839e-acd0521dfdf3 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:33.690474 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-96b28063-dfd4-4ff9-839e-acd0521dfdf3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:33.690474 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:33.690474 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:33.690474 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:33.690474 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:33.690474 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:33.690474 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:33.690474 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:33.690474 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:33.690474 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:33.690474 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:33.690474 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:33.690474 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 03:58:33.690474 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 03:58:33.690474 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 03:58:33.691413 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 03:58:33.691413 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:33.691413 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:33.691413 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:33.691413 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:33.691413 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:33.691413 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:33.691413 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:33.691413 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:33.691413 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:33.691413 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:33.691413 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:33.691413 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:33.691413 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:33.691413 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:33.691413 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:33.691413 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:33.692291 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 03:58:33.692291 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 03:58:33.692291 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 03:58:33.692291 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 03:58:33.692291 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 03:58:33.692291 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 03:58:33.692291 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:33.692291 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:33.692291 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 342/684] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:58:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:33.692783 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b28063-dfd4-4ff9-839e-acd0521dfdf3 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:33.700689 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577275d8-5373-4c62-acd0-8d5c916abcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:33.701665 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577275d8-5373-4c62-acd0-8d5c916abcb1 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:33.702194 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577275d8-5373-4c62-acd0-8d5c916abcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:33.702682 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577275d8-5373-4c62-acd0-8d5c916abcb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:33.797209 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577275d8-5373-4c62-acd0-8d5c916abcb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:33.799218 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577275d8-5373-4c62-acd0-8d5c916abcb1 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:33.804593 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b28063-dfd4-4ff9-839e-acd0521dfdf3 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:33.829825 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:33.844486 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b1e1d-f3f2-4a17-b6b3-1817e91c5e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:33.845646 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b1e1d-f3f2-4a17-b6b3-1817e91c5e50 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:33.846147 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b1e1d-f3f2-4a17-b6b3-1817e91c5e50 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:33.846656 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b1e1d-f3f2-4a17-b6b3-1817e91c5e50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:33.857745 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b1e1d-f3f2-4a17-b6b3-1817e91c5e50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:58:33.865797 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-f89b1e1d-f3f2-4a17-b6b3-1817e91c5e50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:58:33.865797 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:33.865797 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:33.865797 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:33.865797 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:33.865797 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:33.865797 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:33.865797 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:33.865797 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:33.865797 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:33.865797 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:33.865797 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:33.865797 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:58:33.865797 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:58:33.865797 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:58:33.865797 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:58:33.866887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:58:33.866887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:58:33.866887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:58:33.866887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:58:33.866887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:33.866887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:33.866887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:33.866887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:33.866887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:33.866887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:33.866887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:33.866887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:33.866887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:33.866887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:33.866887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:33.866887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:33.867739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:33.867739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:33.867739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:33.867739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:33.867739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:58:33.867739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:58:33.867739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:58:33.867739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:58:33.867739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:58:33.867739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:58:33.867739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:58:33.867739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:33.875057 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 343/685] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Jul 4 03:58:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:33.876336 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b1e1d-f3f2-4a17-b6b3-1817e91c5e50 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:33.910985 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 343/686] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:58:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 03:58:33.911858 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577275d8-5373-4c62-acd0-8d5c916abcb1 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:33.915958 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:34.006512 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b1e1d-f3f2-4a17-b6b3-1817e91c5e50 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:34.020382 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577275d8-5373-4c62-acd0-8d5c916abcb1 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:34.047149 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa331e06-1e8f-4c56-80bb-4fe4a6ec9bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:34.048335 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa331e06-1e8f-4c56-80bb-4fe4a6ec9bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:34.048818 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa331e06-1e8f-4c56-80bb-4fe4a6ec9bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:34.049309 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa331e06-1e8f-4c56-80bb-4fe4a6ec9bf5 None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:34.050425 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa331e06-1e8f-4c56-80bb-4fe4a6ec9bf5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:34.050987 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa331e06-1e8f-4c56-80bb-4fe4a6ec9bf5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:34.052709 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa331e06-1e8f-4c56-80bb-4fe4a6ec9bf5 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:34.055991 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a3378-9e4d-4ee6-9c09-8786d64d98cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:34.056667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a3378-9e4d-4ee6-9c09-8786d64d98cc None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:34.056947 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a3378-9e4d-4ee6-9c09-8786d64d98cc None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:34.057221 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a3378-9e4d-4ee6-9c09-8786d64d98cc None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:34.057971 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a3378-9e4d-4ee6-9c09-8786d64d98cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:34.058301 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a3378-9e4d-4ee6-9c09-8786d64d98cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:34.059683 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a3378-9e4d-4ee6-9c09-8786d64d98cc None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:34.068086 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 344/687] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Jul 4 03:58:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:34.069347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa331e06-1e8f-4c56-80bb-4fe4a6ec9bf5 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:34.070232 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 344/688] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:58:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:34.073659 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a3378-9e4d-4ee6-9c09-8786d64d98cc None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:34.127976 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:34.161947 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:34.202374 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa331e06-1e8f-4c56-80bb-4fe4a6ec9bf5 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:34.207859 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a3378-9e4d-4ee6-9c09-8786d64d98cc None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:34.239190 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75cbe5-4190-44d9-9b6b-2cd4cbaf731a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:34.240367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75cbe5-4190-44d9-9b6b-2cd4cbaf731a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:34.240856 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75cbe5-4190-44d9-9b6b-2cd4cbaf731a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:34.241350 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75cbe5-4190-44d9-9b6b-2cd4cbaf731a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:34.250502 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b463b-9166-47eb-b1f0-605dfcba1c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:34.251171 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b463b-9166-47eb-b1f0-605dfcba1c69 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:34.251456 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b463b-9166-47eb-b1f0-605dfcba1c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:34.251739 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b463b-9166-47eb-b1f0-605dfcba1c69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:34.252899 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b463b-9166-47eb-b1f0-605dfcba1c69 None admin] RBAC: Adding query filter params (role.id=7fd75ec0129248b28b5254e00d4f6f0b, scope.project.id=424a145a22434ef7a14b6108e6118ccb, user.id=b36a8402144c458fa98f80d7e3516127) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:34.253181 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e75cbe5-4190-44d9-9b6b-2cd4cbaf731a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:34.253297 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b463b-9166-47eb-b1f0-605dfcba1c69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:34.254688 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b463b-9166-47eb-b1f0-605dfcba1c69 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:34.255181 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e75cbe5-4190-44d9-9b6b-2cd4cbaf731a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:34.262237 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 345/689] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:58:34 2022] GET /identity/v3/role_assignments?user.id=b36a8402144c458fa98f80d7e3516127&scope.project.id=424a145a22434ef7a14b6108e6118ccb&role.id=7fd75ec0129248b28b5254e00d4f6f0b => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:58:34.263497 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b463b-9166-47eb-b1f0-605dfcba1c69 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:34.274613 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-8e75cbe5-4190-44d9-9b6b-2cd4cbaf731a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:34.274613 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:34.274613 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:34.274613 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:34.274613 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:34.274613 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:34.274613 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:34.274613 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:34.274613 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:34.274613 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:34.274613 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:34.274613 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:34.274613 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:34.274613 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:34.274613 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:34.275593 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:34.275593 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:34.275593 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:34.275593 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:34.275593 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:34.275593 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:34.275593 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:34.275593 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:34.275593 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:34.275593 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:34.275593 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:34.275593 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:34.275593 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:34.275593 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:34.275593 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:34.275593 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:34.275593 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:34.276535 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:34.276535 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:34.276535 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:34.276535 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:34.278913 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 345/690] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:34.288014 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75cbe5-4190-44d9-9b6b-2cd4cbaf731a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:34.385836 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b463b-9166-47eb-b1f0-605dfcba1c69 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:34.424781 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:34.433714 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee536a-00a2-433c-ba84-13eb2cfb633e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:34.434724 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee536a-00a2-433c-ba84-13eb2cfb633e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:34.435015 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee536a-00a2-433c-ba84-13eb2cfb633e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:34.435292 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee536a-00a2-433c-ba84-13eb2cfb633e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:34.449673 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:34.452200 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee536a-00a2-433c-ba84-13eb2cfb633e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:34.453932 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee536a-00a2-433c-ba84-13eb2cfb633e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:34.458243 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75cbe5-4190-44d9-9b6b-2cd4cbaf731a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:34.475580 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-3fee536a-00a2-433c-ba84-13eb2cfb633e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:34.475580 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:34.475580 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:34.475580 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:34.475580 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:34.475580 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:34.475580 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:34.475580 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:34.475580 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:34.475580 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:34.475580 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:34.475580 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:34.475580 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:34.475580 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:34.475580 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:34.476626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:34.476626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:34.476626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:34.476626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:34.476626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:34.476626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:34.476626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:34.476626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:34.476626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:34.476626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:34.476626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:34.476626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:34.476626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:34.476626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:34.476626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:34.476626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:34.476626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:34.477593 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:34.477593 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:34.477593 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:34.477593 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:34.477593 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 346/691] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:34.482444 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85c49d-b5b4-4fe0-8a2f-4bb74d7b7c93 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:34.482781 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85c49d-b5b4-4fe0-8a2f-4bb74d7b7c93 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:34.483068 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85c49d-b5b4-4fe0-8a2f-4bb74d7b7c93 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:34.484722 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 347/692] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:34.486910 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85c49d-b5b4-4fe0-8a2f-4bb74d7b7c93 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:34.504298 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bfbbec-1905-4e1b-b140-98147a30f850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:34.504995 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfbbec-1905-4e1b-b140-98147a30f850 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:34.505522 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfbbec-1905-4e1b-b140-98147a30f850 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:34.505827 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfbbec-1905-4e1b-b140-98147a30f850 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:34.506908 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bfbbec-1905-4e1b-b140-98147a30f850 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:34.507804 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bfbbec-1905-4e1b-b140-98147a30f850 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:34.508817 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bfbbec-1905-4e1b-b140-98147a30f850 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:34.523402 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 346/693] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:34.524345 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be5fe6-9e35-40a8-b62c-caedcba3d7fd None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:34.524651 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be5fe6-9e35-40a8-b62c-caedcba3d7fd None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:34.524937 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be5fe6-9e35-40a8-b62c-caedcba3d7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:34.544512 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-84be5fe6-9e35-40a8-b62c-caedcba3d7fd None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:34.545961 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-84be5fe6-9e35-40a8-b62c-caedcba3d7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:34.609787 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85c49d-b5b4-4fe0-8a2f-4bb74d7b7c93 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:34.613951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 347/694] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:58:34.614938 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be5fe6-9e35-40a8-b62c-caedcba3d7fd None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:34.660146 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2af375-ab73-4be1-8904-13ca4d2b1762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:34.661055 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2af375-ab73-4be1-8904-13ca4d2b1762 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:34.661442 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2af375-ab73-4be1-8904-13ca4d2b1762 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:34.661834 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2af375-ab73-4be1-8904-13ca4d2b1762 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:34.662693 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2af375-ab73-4be1-8904-13ca4d2b1762 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:34.663112 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2af375-ab73-4be1-8904-13ca4d2b1762 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:34.664664 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2af375-ab73-4be1-8904-13ca4d2b1762 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:34.677884 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 348/695] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:34.678907 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2af375-ab73-4be1-8904-13ca4d2b1762 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:34.701313 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:34.719587 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be5fe6-9e35-40a8-b62c-caedcba3d7fd None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:34.724630 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:34.755579 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19cbafa-522e-48c7-b533-7e54d2870683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:34.756688 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cbafa-522e-48c7-b533-7e54d2870683 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:34.757164 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cbafa-522e-48c7-b533-7e54d2870683 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:34.757605 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cbafa-522e-48c7-b533-7e54d2870683 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:34.765227 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19cbafa-522e-48c7-b533-7e54d2870683 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:34.766966 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19cbafa-522e-48c7-b533-7e54d2870683 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:34.781228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-f19cbafa-522e-48c7-b533-7e54d2870683 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:34.781228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:34.781228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:34.781228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:34.781228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:34.781228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:34.781228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:34.781228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:34.781228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:34.781228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:34.781228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:34.781228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:34.781228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 03:58:34.781228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 03:58:34.781228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 03:58:34.782343 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 03:58:34.782343 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:34.782343 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:34.782343 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:34.782343 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:34.782343 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:34.782343 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:34.782343 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:34.782343 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:34.782343 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:34.782343 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:34.782343 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:34.782343 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:34.782343 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:34.782343 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:34.782343 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:34.782343 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:34.783435 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 03:58:34.783435 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 03:58:34.783435 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 03:58:34.783435 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 03:58:34.783435 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 03:58:34.783435 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 03:58:34.783435 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:34.783435 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:34.789867 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2af375-ab73-4be1-8904-13ca4d2b1762 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:34.790049 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 348/696] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:58:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:34.791116 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19cbafa-522e-48c7-b533-7e54d2870683 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:34.822238 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195100b-2dc2-4736-9ea0-5acfb50b6895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:34.823157 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195100b-2dc2-4736-9ea0-5acfb50b6895 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:34.823527 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195100b-2dc2-4736-9ea0-5acfb50b6895 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:34.823727 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195100b-2dc2-4736-9ea0-5acfb50b6895 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:34.834674 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b195100b-2dc2-4736-9ea0-5acfb50b6895 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:34.836247 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b195100b-2dc2-4736-9ea0-5acfb50b6895 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:34.854610 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-b195100b-2dc2-4736-9ea0-5acfb50b6895 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:34.854610 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:34.854610 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:34.854610 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:34.854610 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:34.854610 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:34.854610 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:34.854610 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:34.854610 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:34.854610 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:34.854610 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:34.854610 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:34.854610 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:34.854610 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:34.854610 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:34.855633 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:34.855633 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:34.855633 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:34.855633 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:34.855633 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:34.855633 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:34.855633 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:34.855633 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:34.855633 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:34.855633 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:34.855633 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:34.855633 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:34.855633 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:34.855633 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:34.855633 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:34.855633 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:34.855633 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:34.856610 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:34.856610 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:34.856610 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:34.856610 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:34.856610 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 349/697] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:34.857074 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195100b-2dc2-4736-9ea0-5acfb50b6895 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:34.899814 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19cbafa-522e-48c7-b533-7e54d2870683 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:34.935088 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f8af0-55ff-46f9-8767-cf1464613975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:34.936121 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f8af0-55ff-46f9-8767-cf1464613975 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:34.936561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f8af0-55ff-46f9-8767-cf1464613975 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:34.936996 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f8af0-55ff-46f9-8767-cf1464613975 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:34.945654 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f8af0-55ff-46f9-8767-cf1464613975 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:34.947432 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f8af0-55ff-46f9-8767-cf1464613975 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:34.955034 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:34.962528 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195100b-2dc2-4736-9ea0-5acfb50b6895 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:34.965724 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-815f8af0-55ff-46f9-8767-cf1464613975 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 03:58:34.965724 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:34.965724 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:34.965724 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:34.965724 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:34.965724 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:34.965724 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:34.965724 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:34.965724 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:34.965724 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:34.965724 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:34.965724 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:34.965724 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 03:58:34.965724 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 03:58:34.965724 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 03:58:34.965724 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 03:58:34.966950 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:34.966950 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:34.966950 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 03:58:34.966950 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:34.966950 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 03:58:34.966950 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:34.966950 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:34.966950 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:34.966950 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:34.966950 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:34.966950 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:34.966950 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:34.966950 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:34.966950 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:34.966950 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:34.966950 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:34.966950 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:34.966950 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:34.968070 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:34.968070 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:34.968070 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 03:58:34.968070 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 03:58:34.968070 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 03:58:34.968070 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 03:58:34.968070 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 03:58:34.968070 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 03:58:34.968070 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 03:58:34.968070 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:34.970476 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 349/698] 10.222.0.49 () {56 vars in 1093 bytes} [Mon Jul 4 03:58:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:34.971624 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f8af0-55ff-46f9-8767-cf1464613975 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:34.976544 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:35.001104 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7484710-8d74-4810-9a94-0519c9a4fdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:35.001776 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7484710-8d74-4810-9a94-0519c9a4fdec None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:35.002073 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7484710-8d74-4810-9a94-0519c9a4fdec None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:35.002435 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7484710-8d74-4810-9a94-0519c9a4fdec None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:35.003239 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7484710-8d74-4810-9a94-0519c9a4fdec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:35.003556 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7484710-8d74-4810-9a94-0519c9a4fdec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:35.005202 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7484710-8d74-4810-9a94-0519c9a4fdec None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:35.023156 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 350/699] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Jul 4 03:58:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:35.023156 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7484710-8d74-4810-9a94-0519c9a4fdec None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:35.089354 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f8af0-55ff-46f9-8767-cf1464613975 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:35.122104 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7484710-8d74-4810-9a94-0519c9a4fdec None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:35.125824 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe79ae-1dfc-42c5-9963-094598537715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:35.126757 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe79ae-1dfc-42c5-9963-094598537715 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:35.127249 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe79ae-1dfc-42c5-9963-094598537715 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:35.127743 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe79ae-1dfc-42c5-9963-094598537715 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:35.128676 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe79ae-1dfc-42c5-9963-094598537715 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:35.129210 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe79ae-1dfc-42c5-9963-094598537715 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:35.130888 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe79ae-1dfc-42c5-9963-094598537715 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:35.144828 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 350/700] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:35.146061 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe79ae-1dfc-42c5-9963-094598537715 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:35.157990 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe57310-44de-4b87-9c5b-0e5bf338fe56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:35.158767 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe57310-44de-4b87-9c5b-0e5bf338fe56 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:35.159056 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe57310-44de-4b87-9c5b-0e5bf338fe56 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:35.159387 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe57310-44de-4b87-9c5b-0e5bf338fe56 None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:35.160241 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe57310-44de-4b87-9c5b-0e5bf338fe56 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:35.160612 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe57310-44de-4b87-9c5b-0e5bf338fe56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:35.162133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe57310-44de-4b87-9c5b-0e5bf338fe56 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:35.181195 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 351/701] 10.222.0.49 () {56 vars in 1133 bytes} [Mon Jul 4 03:58:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:35.182081 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe57310-44de-4b87-9c5b-0e5bf338fe56 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:35.197130 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:35.225953 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:35.266203 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe79ae-1dfc-42c5-9963-094598537715 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:35.301315 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42f210-654f-4b4c-8cc6-211317e3ee8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:35.301948 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42f210-654f-4b4c-8cc6-211317e3ee8a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:35.302262 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42f210-654f-4b4c-8cc6-211317e3ee8a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:35.302546 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42f210-654f-4b4c-8cc6-211317e3ee8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:35.303444 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e42f210-654f-4b4c-8cc6-211317e3ee8a None admin] RBAC: Adding query filter params (role.id=7fd75ec0129248b28b5254e00d4f6f0b, scope.project.id=424a145a22434ef7a14b6108e6118ccb, user.id=24f93fdc98ff425791da3e2194b3a671) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:35.303854 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e42f210-654f-4b4c-8cc6-211317e3ee8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:35.305327 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e42f210-654f-4b4c-8cc6-211317e3ee8a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:35.314964 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 351/702] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:58:35 2022] GET /identity/v3/role_assignments?user.id=24f93fdc98ff425791da3e2194b3a671&scope.project.id=424a145a22434ef7a14b6108e6118ccb&role.id=7fd75ec0129248b28b5254e00d4f6f0b => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:35.315564 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe57310-44de-4b87-9c5b-0e5bf338fe56 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:35.316162 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42f210-654f-4b4c-8cc6-211317e3ee8a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:35.363794 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0540730-5d7c-4402-82bf-1dd6396bd2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:35.365176 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0540730-5d7c-4402-82bf-1dd6396bd2bc None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:35.365689 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0540730-5d7c-4402-82bf-1dd6396bd2bc None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:35.366560 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0540730-5d7c-4402-82bf-1dd6396bd2bc None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:35.368054 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0540730-5d7c-4402-82bf-1dd6396bd2bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:35.370356 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0540730-5d7c-4402-82bf-1dd6396bd2bc None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:35.397655 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 352/703] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Jul 4 03:58:35 2022] POST /identity/v3/users => generated 254 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 03:58:35.462803 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42f210-654f-4b4c-8cc6-211317e3ee8a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:35.510010 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:35.520823 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ff276-4cf6-4d84-92a8-720b2a7b61b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:35.521503 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ff276-4cf6-4d84-92a8-720b2a7b61b1 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:35.521789 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ff276-4cf6-4d84-92a8-720b2a7b61b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:35.522076 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ff276-4cf6-4d84-92a8-720b2a7b61b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:35.547397 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab909e9-9a9c-4ea1-a465-a5ac9cf5d358 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:35.547724 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab909e9-9a9c-4ea1-a465-a5ac9cf5d358 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:35.547976 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab909e9-9a9c-4ea1-a465-a5ac9cf5d358 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:35.549700 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 353/704] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 03:58:35.555650 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3134c1-2625-4252-81c8-1276f71f2008 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:35.555970 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3134c1-2625-4252-81c8-1276f71f2008 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:35.556242 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3134c1-2625-4252-81c8-1276f71f2008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:35.574867 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-df3134c1-2625-4252-81c8-1276f71f2008 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:35.576262 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-df3134c1-2625-4252-81c8-1276f71f2008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:35.602427 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ff276-4cf6-4d84-92a8-720b2a7b61b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:35.604444 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ff276-4cf6-4d84-92a8-720b2a7b61b1 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:35.683835 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:35.697243 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 354/705] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 03:58:35.720795 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3134c1-2625-4252-81c8-1276f71f2008 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:35.728208 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 352/706] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:58:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 03:58:35.733488 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ff276-4cf6-4d84-92a8-720b2a7b61b1 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:35.763814 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:35.841288 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3134c1-2625-4252-81c8-1276f71f2008 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:35.861284 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ff276-4cf6-4d84-92a8-720b2a7b61b1 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:35.880917 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76dfea4-0cbd-406a-a50a-91faa0816aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:35.881957 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76dfea4-0cbd-406a-a50a-91faa0816aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:35.882374 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76dfea4-0cbd-406a-a50a-91faa0816aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:35.882754 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76dfea4-0cbd-406a-a50a-91faa0816aa6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:35.883523 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76dfea4-0cbd-406a-a50a-91faa0816aa6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:35.885046 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76dfea4-0cbd-406a-a50a-91faa0816aa6 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:35.900010 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-e76dfea4-0cbd-406a-a50a-91faa0816aa6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 03:58:35.900010 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:35.900010 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 03:58:35.900010 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 03:58:35.900010 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 03:58:35.900010 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 03:58:35.900010 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 03:58:35.900010 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:58:35.900010 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 03:58:35.900010 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:35.900010 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 03:58:35.900010 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:35.900010 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:35.900010 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:35.900010 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:35.900010 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:35.901256 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:35.901256 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:35.901256 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:35.901256 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:35.901256 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:35.901256 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:35.901256 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:35.901256 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 03:58:35.901256 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 03:58:35.901256 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 03:58:35.901256 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 03:58:35.901256 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:35.901256 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:35.901256 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:35.901256 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:35.901256 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:35.902377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:35.902377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:35.902377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:35.902377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:35.902377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:35.902377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:35.902377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:35.902377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:35.902377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:35.902377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:35.902377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:35.902377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 03:58:35.902377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:58:35.902377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 03:58:35.902377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:35.904453 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 355/707] 10.222.0.49 () {56 vars in 1129 bytes} [Mon Jul 4 03:58:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:58:35.905788 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cde6dd-2f1e-49a6-94fd-e2828eb7d59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:35.906847 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cde6dd-2f1e-49a6-94fd-e2828eb7d59e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:35.907318 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cde6dd-2f1e-49a6-94fd-e2828eb7d59e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:35.907737 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cde6dd-2f1e-49a6-94fd-e2828eb7d59e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:35.910183 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76dfea4-0cbd-406a-a50a-91faa0816aa6 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:35.920597 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cde6dd-2f1e-49a6-94fd-e2828eb7d59e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:35.922794 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cde6dd-2f1e-49a6-94fd-e2828eb7d59e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:35.942764 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-00cde6dd-2f1e-49a6-94fd-e2828eb7d59e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:35.942764 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:35.942764 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:35.942764 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:35.942764 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:35.942764 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:35.942764 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:35.942764 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:35.942764 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:35.942764 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:35.942764 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:35.942764 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:35.942764 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:35.942764 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:35.942764 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:35.943909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:35.943909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:35.943909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:35.943909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:35.943909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:35.943909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:35.943909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:35.943909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:35.943909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:35.943909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:35.943909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:35.943909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:35.943909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:35.943909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:35.943909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:35.943909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:35.943909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:35.945118 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:35.945118 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:35.945118 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:35.945118 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:35.951259 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 353/708] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:58:35.953167 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cde6dd-2f1e-49a6-94fd-e2828eb7d59e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:35.980699 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:36.023485 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76dfea4-0cbd-406a-a50a-91faa0816aa6 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:36.048680 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:36.059942 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a0a38-4bb7-4bd7-aee3-5be61f95c712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:36.060800 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a0a38-4bb7-4bd7-aee3-5be61f95c712 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:36.060921 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a0a38-4bb7-4bd7-aee3-5be61f95c712 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:36.061183 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a0a38-4bb7-4bd7-aee3-5be61f95c712 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:36.061905 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a0a38-4bb7-4bd7-aee3-5be61f95c712 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:36.062273 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a0a38-4bb7-4bd7-aee3-5be61f95c712 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:36.063679 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a0a38-4bb7-4bd7-aee3-5be61f95c712 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:36.068946 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 356/709] 10.222.0.49 () {56 vars in 1124 bytes} [Mon Jul 4 03:58:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:36.070799 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cde6dd-2f1e-49a6-94fd-e2828eb7d59e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:36.074508 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a0a38-4bb7-4bd7-aee3-5be61f95c712 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:36.110635 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3467f-2948-45d4-8343-936d09c05bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:36.111562 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3467f-2948-45d4-8343-936d09c05bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:36.111993 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3467f-2948-45d4-8343-936d09c05bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:36.112545 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3467f-2948-45d4-8343-936d09c05bc9 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:36.114244 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3467f-2948-45d4-8343-936d09c05bc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:36.114735 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3467f-2948-45d4-8343-936d09c05bc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:36.116513 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3467f-2948-45d4-8343-936d09c05bc9 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:36.137208 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 354/710] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:36.139352 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3467f-2948-45d4-8343-936d09c05bc9 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:36.196910 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a0a38-4bb7-4bd7-aee3-5be61f95c712 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:36.227955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:36.246597 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbb29e-e7e1-489b-8a9f-1d2b3a110fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:36.247526 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbb29e-e7e1-489b-8a9f-1d2b3a110fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:36.248887 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbb29e-e7e1-489b-8a9f-1d2b3a110fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:36.249690 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbb29e-e7e1-489b-8a9f-1d2b3a110fb4 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:36.250871 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cbb29e-e7e1-489b-8a9f-1d2b3a110fb4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:36.252701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cbb29e-e7e1-489b-8a9f-1d2b3a110fb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:36.256388 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cbb29e-e7e1-489b-8a9f-1d2b3a110fb4 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:36.273730 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 357/711] 10.222.0.49 () {56 vars in 1124 bytes} [Mon Jul 4 03:58:36 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:58:36.303704 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3467f-2948-45d4-8343-936d09c05bc9 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:36.349995 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77d283-1fcd-453e-bf7b-e5d08e6ec19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:36.351204 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77d283-1fcd-453e-bf7b-e5d08e6ec19a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:36.351640 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77d283-1fcd-453e-bf7b-e5d08e6ec19a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:36.352071 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77d283-1fcd-453e-bf7b-e5d08e6ec19a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:36.360061 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77d283-1fcd-453e-bf7b-e5d08e6ec19a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:36.361709 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77d283-1fcd-453e-bf7b-e5d08e6ec19a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:36.368126 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:36.385392 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-3b77d283-1fcd-453e-bf7b-e5d08e6ec19a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:36.385392 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:36.385392 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:36.385392 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:36.385392 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:36.385392 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:36.385392 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:36.385392 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:36.385392 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:36.385392 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:36.385392 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:36.385392 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:36.385392 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 03:58:36.385392 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 03:58:36.385392 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 03:58:36.386859 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 03:58:36.386859 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:36.386859 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:36.386859 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:36.386859 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:36.386859 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:36.386859 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:36.386859 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:36.386859 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:36.386859 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:36.386859 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:36.386859 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:36.386859 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:36.386859 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:36.386859 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:36.386859 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:36.386859 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:36.387929 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 03:58:36.387929 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 03:58:36.387929 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 03:58:36.387929 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 03:58:36.387929 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 03:58:36.387929 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 03:58:36.387929 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:36.387929 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:36.390115 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 355/712] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:58:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:36.395747 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbb29e-e7e1-489b-8a9f-1d2b3a110fb4 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:36.510665 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbb29e-e7e1-489b-8a9f-1d2b3a110fb4 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:36.549955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479f652-5673-4b21-9dac-55e54cf00bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:36.550674 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479f652-5673-4b21-9dac-55e54cf00bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:36.550962 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479f652-5673-4b21-9dac-55e54cf00bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:36.551246 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479f652-5673-4b21-9dac-55e54cf00bc8 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:36.552063 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6479f652-5673-4b21-9dac-55e54cf00bc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:36.552380 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6479f652-5673-4b21-9dac-55e54cf00bc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:36.553945 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6479f652-5673-4b21-9dac-55e54cf00bc8 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:36.575944 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 358/713] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Jul 4 03:58:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:36.582281 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77d283-1fcd-453e-bf7b-e5d08e6ec19a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:36.618654 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8337d67-01d2-4cd7-95ee-4e65f1341fcf None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:36.618983 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8337d67-01d2-4cd7-95ee-4e65f1341fcf None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:36.619230 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8337d67-01d2-4cd7-95ee-4e65f1341fcf None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:36.620874 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 359/714] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:36.625854 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b23bb-e5aa-4aef-a815-4ce9d6097e66 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:36.626144 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b23bb-e5aa-4aef-a815-4ce9d6097e66 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:36.626456 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b23bb-e5aa-4aef-a815-4ce9d6097e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:36.648886 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-977b23bb-e5aa-4aef-a815-4ce9d6097e66 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:36.650240 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-977b23bb-e5aa-4aef-a815-4ce9d6097e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:36.730505 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:36.735497 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77d283-1fcd-453e-bf7b-e5d08e6ec19a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:36.767429 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 360/715] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 04 03:58:36.794774 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66dc28-1bc9-4d51-abb1-7a38e7f2d7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:36.795490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66dc28-1bc9-4d51-abb1-7a38e7f2d7b5 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:36.795781 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66dc28-1bc9-4d51-abb1-7a38e7f2d7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:36.796064 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66dc28-1bc9-4d51-abb1-7a38e7f2d7b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:36.796912 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66dc28-1bc9-4d51-abb1-7a38e7f2d7b5 None admin] RBAC: Adding query filter params (role.id=2eee98054d42475bb7e22a8487ab235e, scope.project.id=424a145a22434ef7a14b6108e6118ccb, user.id=8334e75253f843a980b01c6f0cda6015) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:36.797271 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66dc28-1bc9-4d51-abb1-7a38e7f2d7b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:36.798772 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66dc28-1bc9-4d51-abb1-7a38e7f2d7b5 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:36.807577 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 356/716] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:58:36 2022] GET /identity/v3/role_assignments?user.id=8334e75253f843a980b01c6f0cda6015&scope.project.id=424a145a22434ef7a14b6108e6118ccb&role.id=2eee98054d42475bb7e22a8487ab235e => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:36.818025 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b23bb-e5aa-4aef-a815-4ce9d6097e66 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:36.992376 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b23bb-e5aa-4aef-a815-4ce9d6097e66 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:37.038924 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be09beb-03ff-4735-956d-29f96f346ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:37.039667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be09beb-03ff-4735-956d-29f96f346ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:37.039952 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be09beb-03ff-4735-956d-29f96f346ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:37.040312 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be09beb-03ff-4735-956d-29f96f346ca6 None admin] PATH_INFO: `/v3/services/network` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:37.040978 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be09beb-03ff-4735-956d-29f96f346ca6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:37.042433 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be09beb-03ff-4735-956d-29f96f346ca6 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:37.059062 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-9be09beb-03ff-4735-956d-29f96f346ca6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 03:58:37.059062 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:37.059062 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 03:58:37.059062 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 03:58:37.059062 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 03:58:37.059062 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 03:58:37.059062 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 03:58:37.059062 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:58:37.059062 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 03:58:37.059062 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:37.059062 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 03:58:37.059062 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:37.059062 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:37.059062 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:37.059062 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:37.059062 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:37.059062 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:37.060139 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:37.060139 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:37.060139 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:37.060139 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:37.060139 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:37.060139 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:37.060139 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 03:58:37.060139 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 03:58:37.060139 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 03:58:37.060139 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 03:58:37.060139 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:37.060139 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:37.060139 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:37.060139 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:37.060139 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:37.060139 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:37.060982 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:37.060982 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:37.060982 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:37.060982 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:37.060982 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:37.060982 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:37.060982 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:37.060982 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:37.060982 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:37.060982 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:37.060982 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 03:58:37.060982 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:58:37.060982 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 03:58:37.060982 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:37.060982 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 361/717] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:58:36 2022] GET /identity/v3/services/network => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:37.066412 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66dc28-1bc9-4d51-abb1-7a38e7f2d7b5 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:37.150217 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:37.211028 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66dc28-1bc9-4d51-abb1-7a38e7f2d7b5 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:37.255769 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd9104e-15f8-4c81-b39e-37bb23e5742c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:37.256453 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9104e-15f8-4c81-b39e-37bb23e5742c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:37.256735 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9104e-15f8-4c81-b39e-37bb23e5742c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:37.257076 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9104e-15f8-4c81-b39e-37bb23e5742c None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:37.257793 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd9104e-15f8-4c81-b39e-37bb23e5742c None admin] RBAC: Adding query filter params (name=network) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:37.258106 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd9104e-15f8-4c81-b39e-37bb23e5742c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:37.259572 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd9104e-15f8-4c81-b39e-37bb23e5742c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:37.270024 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 357/718] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Jul 4 03:58:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:37.275415 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be09beb-03ff-4735-956d-29f96f346ca6 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:37.336432 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:37.400358 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be09beb-03ff-4735-956d-29f96f346ca6 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:37.447093 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bffe9d-43c4-4b10-bfd3-ba29964f8747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:37.447772 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bffe9d-43c4-4b10-bfd3-ba29964f8747 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:37.448057 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bffe9d-43c4-4b10-bfd3-ba29964f8747 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:37.448335 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bffe9d-43c4-4b10-bfd3-ba29964f8747 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:37.449050 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bffe9d-43c4-4b10-bfd3-ba29964f8747 None admin] RBAC: Adding query filter params (type=network) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:37.449361 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bffe9d-43c4-4b10-bfd3-ba29964f8747 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:37.450806 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bffe9d-43c4-4b10-bfd3-ba29964f8747 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:37.457661 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 362/719] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Jul 4 03:58:37 2022] GET /identity/v3/services?type=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:38.226482 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a32a1-4700-4684-baa5-8d7101ce585f None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:38.226990 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a32a1-4700-4684-baa5-8d7101ce585f None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:38.226990 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a32a1-4700-4684-baa5-8d7101ce585f None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:38.228787 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 358/720] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:38.234247 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d8e3c-f4f1-46e0-96e0-0d36efdf59b4 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:38.234698 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d8e3c-f4f1-46e0-96e0-0d36efdf59b4 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:38.234919 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d8e3c-f4f1-46e0-96e0-0d36efdf59b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:38.251966 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-cc4d8e3c-f4f1-46e0-96e0-0d36efdf59b4 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:38.253165 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-cc4d8e3c-f4f1-46e0-96e0-0d36efdf59b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:38.274112 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de756c9-faf7-48d2-b4ed-2627a54e54b5 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:38.274460 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de756c9-faf7-48d2-b4ed-2627a54e54b5 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:38.274709 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de756c9-faf7-48d2-b4ed-2627a54e54b5 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:38.276131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 359/721] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:38.282287 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f61d16-4151-4389-98a7-7e63719abfb9 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:38.282585 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f61d16-4151-4389-98a7-7e63719abfb9 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:38.282873 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f61d16-4151-4389-98a7-7e63719abfb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:38.309460 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-60f61d16-4151-4389-98a7-7e63719abfb9 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:38.310682 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-60f61d16-4151-4389-98a7-7e63719abfb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:38.352807 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 363/722] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:58:38.388587 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 360/723] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:58:38.397889 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d8e3c-f4f1-46e0-96e0-0d36efdf59b4 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:38.411728 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f61d16-4151-4389-98a7-7e63719abfb9 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:38.480978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:38.487912 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:38.552236 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f61d16-4151-4389-98a7-7e63719abfb9 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:38.589870 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d8e3c-f4f1-46e0-96e0-0d36efdf59b4 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:38.626132 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9432ff-f06c-40d4-ba9a-4a4fa99f5e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:38.626984 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9432ff-f06c-40d4-ba9a-4a4fa99f5e93 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:38.627272 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9432ff-f06c-40d4-ba9a-4a4fa99f5e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:38.627553 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9432ff-f06c-40d4-ba9a-4a4fa99f5e93 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:38.634802 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e2da00-dde4-4890-bdc3-3a271789b7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:38.635618 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e2da00-dde4-4890-bdc3-3a271789b7e1 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:38.636230 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e2da00-dde4-4890-bdc3-3a271789b7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:38.636517 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e2da00-dde4-4890-bdc3-3a271789b7e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:38.639517 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9432ff-f06c-40d4-ba9a-4a4fa99f5e93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:58:38.647533 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-cd9432ff-f06c-40d4-ba9a-4a4fa99f5e93 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 03:58:38.647533 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:38.647533 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:38.647533 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:38.647533 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:38.647533 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:38.647533 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:38.647533 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:38.647533 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:38.647533 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:38.647533 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:38.647533 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:38.647533 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:58:38.647533 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:58:38.647533 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:58:38.647533 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:58:38.648542 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:58:38.648542 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:58:38.648542 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:58:38.648542 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:58:38.648542 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:38.648542 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:38.648542 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:38.648542 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:38.648542 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:38.648542 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:38.648542 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:38.648542 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:38.648542 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:38.648542 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:38.648542 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:38.648542 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:38.649441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:38.649441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:38.649441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:38.649441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:38.649441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:58:38.649441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:58:38.649441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:58:38.649441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:58:38.649441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:58:38.649441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:58:38.649441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 03:58:38.649441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:38.649441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 364/724] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Jul 4 03:58:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:38.656581 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9432ff-f06c-40d4-ba9a-4a4fa99f5e93 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:38.663202 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e2da00-dde4-4890-bdc3-3a271789b7e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:58:38.676670 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-70e2da00-dde4-4890-bdc3-3a271789b7e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:58:38.676670 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:38.676670 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:38.676670 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:38.676670 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:38.676670 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:38.676670 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:38.676670 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:38.676670 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:38.676670 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:38.676670 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:38.676670 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:38.676670 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:58:38.676670 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:58:38.676670 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:58:38.676670 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:58:38.678985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:58:38.678985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:58:38.678985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:58:38.678985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:58:38.678985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:38.678985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:38.678985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:38.678985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:38.678985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:38.678985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:38.678985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:38.678985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:38.678985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:38.678985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:38.678985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:38.678985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:38.681019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:38.681019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:38.681019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:38.681019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:38.681019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:58:38.681019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:58:38.681019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:58:38.681019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:58:38.681019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:58:38.681019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:58:38.681019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:58:38.681019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:38.686231 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 361/725] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Jul 4 03:58:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:58:38.687595 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e2da00-dde4-4890-bdc3-3a271789b7e1 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:38.820996 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e2da00-dde4-4890-bdc3-3a271789b7e1 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:38.838323 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:38.844033 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:38.849308 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9432ff-f06c-40d4-ba9a-4a4fa99f5e93 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:38.856250 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5370a64-8b1b-4a4a-9bb5-4895d3ef7910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:38.856933 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5370a64-8b1b-4a4a-9bb5-4895d3ef7910 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:38.857222 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5370a64-8b1b-4a4a-9bb5-4895d3ef7910 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:38.857505 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5370a64-8b1b-4a4a-9bb5-4895d3ef7910 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:38.858302 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5370a64-8b1b-4a4a-9bb5-4895d3ef7910 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:38.858619 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5370a64-8b1b-4a4a-9bb5-4895d3ef7910 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:38.860014 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5370a64-8b1b-4a4a-9bb5-4895d3ef7910 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:38.869145 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 362/726] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:58:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:38.874617 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2783e-ad6a-4399-8b17-6e63daa0ccfd None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:38.874948 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2783e-ad6a-4399-8b17-6e63daa0ccfd None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:38.875248 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2783e-ad6a-4399-8b17-6e63daa0ccfd None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:38.880784 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 363/727] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:38.880784 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2783e-ad6a-4399-8b17-6e63daa0ccfd None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:38.894549 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54033426-3589-4794-9706-ba6c798ad31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:38.895524 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54033426-3589-4794-9706-ba6c798ad31d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:38.896013 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54033426-3589-4794-9706-ba6c798ad31d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:38.896569 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54033426-3589-4794-9706-ba6c798ad31d None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:38.897677 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54033426-3589-4794-9706-ba6c798ad31d None admin] RBAC: Adding query filter params (name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:38.898234 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54033426-3589-4794-9706-ba6c798ad31d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:38.899946 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54033426-3589-4794-9706-ba6c798ad31d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:38.913959 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 365/728] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Jul 4 03:58:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:38.915966 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050c5dd-ebb1-40b1-b2e7-1300ca1b6a0a None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:38.916528 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050c5dd-ebb1-40b1-b2e7-1300ca1b6a0a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:38.917024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050c5dd-ebb1-40b1-b2e7-1300ca1b6a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:38.934755 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-d050c5dd-ebb1-40b1-b2e7-1300ca1b6a0a None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:38.936278 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d050c5dd-ebb1-40b1-b2e7-1300ca1b6a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:38.988737 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2783e-ad6a-4399-8b17-6e63daa0ccfd None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:39.029426 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f2ba0-d4b1-479b-a381-2103ea924733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:39.032561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f2ba0-d4b1-479b-a381-2103ea924733 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:39.032561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f2ba0-d4b1-479b-a381-2103ea924733 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:39.032561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f2ba0-d4b1-479b-a381-2103ea924733 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:39.043690 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f2ba0-d4b1-479b-a381-2103ea924733 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:39.045298 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f2ba0-d4b1-479b-a381-2103ea924733 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:39.051734 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 366/729] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:58:39.051734 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050c5dd-ebb1-40b1-b2e7-1300ca1b6a0a None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:39.079431 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-260f2ba0-d4b1-479b-a381-2103ea924733 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:39.079431 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:39.079431 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:39.079431 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:39.079431 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:39.079431 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:39.079431 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:39.079431 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:39.079431 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:39.079431 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:39.079431 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:39.079431 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:39.079431 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:39.079431 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:39.079431 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:39.080351 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:39.080351 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:39.080351 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:39.080351 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:39.080351 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:39.080351 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:39.080351 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:39.080351 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:39.080351 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:39.080351 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:39.080351 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:39.080351 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:39.080351 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:39.080351 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:39.080351 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:39.080351 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:39.080351 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:39.081273 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:39.081273 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:39.081273 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:39.081273 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:39.083833 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 364/730] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:58:39.084756 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f2ba0-d4b1-479b-a381-2103ea924733 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:39.125106 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:39.172598 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:39.185127 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050c5dd-ebb1-40b1-b2e7-1300ca1b6a0a None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:39.205261 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f2ba0-d4b1-479b-a381-2103ea924733 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:39.228220 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23fdfb-9e2c-43cc-8b85-bcca27b2d3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:39.229431 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23fdfb-9e2c-43cc-8b85-bcca27b2d3a3 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:39.230225 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23fdfb-9e2c-43cc-8b85-bcca27b2d3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:39.230658 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23fdfb-9e2c-43cc-8b85-bcca27b2d3a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:39.241254 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fb12a-a3e1-494c-bd18-fe53b5fa47bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:39.242356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fb12a-a3e1-494c-bd18-fe53b5fa47bc None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:39.242557 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fb12a-a3e1-494c-bd18-fe53b5fa47bc None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:39.242963 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fb12a-a3e1-494c-bd18-fe53b5fa47bc None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:39.243801 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3fb12a-a3e1-494c-bd18-fe53b5fa47bc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:39.244835 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23fdfb-9e2c-43cc-8b85-bcca27b2d3a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:39.245403 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3fb12a-a3e1-494c-bd18-fe53b5fa47bc None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:39.246937 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23fdfb-9e2c-43cc-8b85-bcca27b2d3a3 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:39.265692 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 365/731] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Jul 4 03:58:39 2022] POST /identity/v3/services => generated 251 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 03:58:39.266647 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fb12a-a3e1-494c-bd18-fe53b5fa47bc None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:39.272955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-7e23fdfb-9e2c-43cc-8b85-bcca27b2d3a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:39.272955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:39.272955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:39.272955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:39.272955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:39.272955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:39.272955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:39.272955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:39.272955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:39.272955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:39.272955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:39.272955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:39.272955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:39.272955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:39.272955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:39.273980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:39.273980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:39.273980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:39.273980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:39.273980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:39.273980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:39.273980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:39.273980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:39.273980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:39.273980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:39.273980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:39.273980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:39.273980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:39.273980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:39.273980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:39.273980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:39.273980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:39.274946 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:39.274946 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:39.274946 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:39.274946 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:39.278348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 367/732] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:39.280391 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a90c5-6a59-4a1a-88e8-35f0a228dfcb None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:39.280885 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a90c5-6a59-4a1a-88e8-35f0a228dfcb None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:39.281435 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a90c5-6a59-4a1a-88e8-35f0a228dfcb None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:39.287704 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 368/733] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:39.289079 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a90c5-6a59-4a1a-88e8-35f0a228dfcb None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:39.372945 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:39.398828 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fb12a-a3e1-494c-bd18-fe53b5fa47bc None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:39.417484 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a90c5-6a59-4a1a-88e8-35f0a228dfcb None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:39.444145 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b082b-020d-4eac-bf94-d4c3431a21a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:39.445064 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b082b-020d-4eac-bf94-d4c3431a21a3 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:39.445416 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b082b-020d-4eac-bf94-d4c3431a21a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:39.446857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b082b-020d-4eac-bf94-d4c3431a21a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:39.447676 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b082b-020d-4eac-bf94-d4c3431a21a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:39.448071 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b082b-020d-4eac-bf94-d4c3431a21a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:39.449587 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b082b-020d-4eac-bf94-d4c3431a21a3 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:39.460023 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a8e6a-c5b1-4c3c-ab07-c245790f63d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:39.460758 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a8e6a-c5b1-4c3c-ab07-c245790f63d3 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:39.461099 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a8e6a-c5b1-4c3c-ab07-c245790f63d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:39.461386 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a8e6a-c5b1-4c3c-ab07-c245790f63d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:39.462148 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a8e6a-c5b1-4c3c-ab07-c245790f63d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:39.462495 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a8e6a-c5b1-4c3c-ab07-c245790f63d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:39.463155 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 366/734] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:39.463904 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a8e6a-c5b1-4c3c-ab07-c245790f63d3 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:39.464612 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a3c7d-28e0-452d-a74a-089dbed21615 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:39.464914 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a3c7d-28e0-452d-a74a-089dbed21615 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:39.465196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a3c7d-28e0-452d-a74a-089dbed21615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:39.482049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 369/735] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:39.482369 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-2e9a3c7d-28e0-452d-a74a-089dbed21615 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:39.482985 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a8e6a-c5b1-4c3c-ab07-c245790f63d3 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:39.483520 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-2e9a3c7d-28e0-452d-a74a-089dbed21615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:39.487107 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:39.559881 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 367/736] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:39 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:58:39.560773 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a3c7d-28e0-452d-a74a-089dbed21615 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:39.614685 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a8e6a-c5b1-4c3c-ab07-c245790f63d3 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:39.649968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459efd8a-4f30-467b-a24d-b3083179dce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:39.650731 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459efd8a-4f30-467b-a24d-b3083179dce6 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:39.651020 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459efd8a-4f30-467b-a24d-b3083179dce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:39.651302 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459efd8a-4f30-467b-a24d-b3083179dce6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:39.653584 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:39.659203 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459efd8a-4f30-467b-a24d-b3083179dce6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:39.660687 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459efd8a-4f30-467b-a24d-b3083179dce6 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:39.676173 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-459efd8a-4f30-467b-a24d-b3083179dce6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 04 03:58:39.676173 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:39.676173 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:39.676173 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:39.676173 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:39.676173 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:39.676173 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:39.676173 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:39.676173 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:39.676173 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:39.676173 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:39.676173 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:39.676173 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 03:58:39.676173 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 03:58:39.676173 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 03:58:39.676173 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 03:58:39.677199 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:39.677199 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:39.677199 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 03:58:39.677199 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:39.677199 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 03:58:39.677199 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:39.677199 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:39.677199 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:39.677199 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:39.677199 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:39.677199 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:39.677199 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:39.677199 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:39.677199 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:39.677199 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:39.677199 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:39.677199 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:39.677199 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:39.678256 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:39.678256 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:39.678256 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 03:58:39.678256 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 03:58:39.678256 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 03:58:39.678256 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 03:58:39.678256 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 03:58:39.678256 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 03:58:39.678256 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 04 03:58:39.678256 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:39.678845 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a3c7d-28e0-452d-a74a-089dbed21615 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:39.678923 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 370/737] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Jul 4 03:58:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:39.678923 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459efd8a-4f30-467b-a24d-b3083179dce6 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:39.719701 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba365f19-be36-4eae-8f10-516ced826ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:39.720936 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba365f19-be36-4eae-8f10-516ced826ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:39.721233 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba365f19-be36-4eae-8f10-516ced826ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:39.721521 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba365f19-be36-4eae-8f10-516ced826ce2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:39.731118 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba365f19-be36-4eae-8f10-516ced826ce2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:39.732905 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba365f19-be36-4eae-8f10-516ced826ce2 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:39.743741 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:39.751481 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-ba365f19-be36-4eae-8f10-516ced826ce2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 03:58:39.751481 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:39.751481 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:39.751481 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:39.751481 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:39.751481 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:39.751481 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:39.751481 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:39.751481 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:39.751481 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:39.751481 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:39.751481 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:39.751481 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 03:58:39.751481 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 03:58:39.751481 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 03:58:39.751481 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 03:58:39.752640 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:39.752640 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:39.752640 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 03:58:39.752640 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:39.752640 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 03:58:39.752640 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:39.752640 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:39.752640 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:39.752640 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:39.752640 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:39.752640 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:39.752640 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:39.752640 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:39.752640 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:39.752640 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:39.752640 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:39.752640 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:39.752640 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:39.753602 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:39.753602 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:39.753602 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 03:58:39.753602 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 03:58:39.753602 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 03:58:39.753602 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 03:58:39.753602 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 03:58:39.753602 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 03:58:39.753602 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 03:58:39.753602 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:39.753602 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 368/738] 10.222.0.49 () {56 vars in 1117 bytes} [Mon Jul 4 03:58:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:39.754237 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba365f19-be36-4eae-8f10-516ced826ce2 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:39.791535 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459efd8a-4f30-467b-a24d-b3083179dce6 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:39.828638 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0890a92-f7da-405a-a505-d9bb511a48a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:39.829723 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0890a92-f7da-405a-a505-d9bb511a48a0 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:39.830341 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0890a92-f7da-405a-a505-d9bb511a48a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:39.830859 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0890a92-f7da-405a-a505-d9bb511a48a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:39.842681 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0890a92-f7da-405a-a505-d9bb511a48a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:58:39.850966 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-e0890a92-f7da-405a-a505-d9bb511a48a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:58:39.850966 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:39.850966 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:39.850966 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:39.850966 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:39.850966 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:39.850966 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:39.850966 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:39.850966 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:39.850966 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:39.850966 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:39.850966 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:39.850966 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:58:39.850966 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:58:39.850966 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:58:39.850966 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:58:39.852122 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:58:39.852122 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:58:39.852122 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:58:39.852122 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:58:39.852122 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:39.852122 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:39.852122 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:39.852122 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:39.852122 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:39.852122 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:39.852122 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:39.852122 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:39.852122 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:39.852122 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:39.852122 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:39.852122 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:39.853050 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:39.853050 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:39.853050 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:39.853050 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:39.853050 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:58:39.853050 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:58:39.853050 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:58:39.853050 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:58:39.853050 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:58:39.853050 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:58:39.853050 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:58:39.853050 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:39.860140 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 371/739] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Jul 4 03:58:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:39.861318 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0890a92-f7da-405a-a505-d9bb511a48a0 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:39.872966 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba365f19-be36-4eae-8f10-516ced826ce2 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:39.910707 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865592f0-6adb-46ba-911e-d992949164b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:39.911619 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865592f0-6adb-46ba-911e-d992949164b1 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:39.912074 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865592f0-6adb-46ba-911e-d992949164b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:39.912495 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865592f0-6adb-46ba-911e-d992949164b1 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:39.913620 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865592f0-6adb-46ba-911e-d992949164b1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:39.914082 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865592f0-6adb-46ba-911e-d992949164b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:39.915778 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865592f0-6adb-46ba-911e-d992949164b1 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:39.926025 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:39.937831 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 369/740] 10.222.0.49 () {56 vars in 1135 bytes} [Mon Jul 4 03:58:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:39.939085 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865592f0-6adb-46ba-911e-d992949164b1 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:39.986565 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0890a92-f7da-405a-a505-d9bb511a48a0 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:40.009879 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:40.023338 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0abf63-a373-4d90-bf8e-8464605b2d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:40.024022 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0abf63-a373-4d90-bf8e-8464605b2d51 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:40.024307 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0abf63-a373-4d90-bf8e-8464605b2d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:40.024665 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0abf63-a373-4d90-bf8e-8464605b2d51 None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:40.025524 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0abf63-a373-4d90-bf8e-8464605b2d51 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:40.025842 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0abf63-a373-4d90-bf8e-8464605b2d51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:40.027332 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0abf63-a373-4d90-bf8e-8464605b2d51 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:40.049178 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 372/741] 10.222.0.49 () {56 vars in 1149 bytes} [Mon Jul 4 03:58:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:40.054340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865592f0-6adb-46ba-911e-d992949164b1 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:40.054597 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0abf63-a373-4d90-bf8e-8464605b2d51 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:40.088889 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ebc56-e027-4458-86a2-140f5232dd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:40.089561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ebc56-e027-4458-86a2-140f5232dd55 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:40.089849 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ebc56-e027-4458-86a2-140f5232dd55 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:40.090134 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ebc56-e027-4458-86a2-140f5232dd55 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:40.090912 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ebc56-e027-4458-86a2-140f5232dd55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:40.091227 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ebc56-e027-4458-86a2-140f5232dd55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:40.092627 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ebc56-e027-4458-86a2-140f5232dd55 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:40.105520 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 370/742] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:58:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:40.105520 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1667ad-47fc-4671-8154-b5ab3a5e1cf7 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:40.105520 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1667ad-47fc-4671-8154-b5ab3a5e1cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:40.105520 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1667ad-47fc-4671-8154-b5ab3a5e1cf7 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:40.105520 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 371/743] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:40.105520 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1667ad-47fc-4671-8154-b5ab3a5e1cf7 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:40.167176 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:40.173630 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0abf63-a373-4d90-bf8e-8464605b2d51 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:40.208262 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57830a-195a-4174-b43c-eefdeab9c47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:40.208916 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57830a-195a-4174-b43c-eefdeab9c47d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:40.209204 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57830a-195a-4174-b43c-eefdeab9c47d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:40.209479 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57830a-195a-4174-b43c-eefdeab9c47d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:40.218398 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1667ad-47fc-4671-8154-b5ab3a5e1cf7 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:40.258665 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7d06f-8fe4-4ad6-addc-7620e57473d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:40.259308 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:40.260723 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7d06f-8fe4-4ad6-addc-7620e57473d7 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:40.261422 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7d06f-8fe4-4ad6-addc-7620e57473d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:40.261710 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7d06f-8fe4-4ad6-addc-7620e57473d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:40.281225 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57830a-195a-4174-b43c-eefdeab9c47d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:40.282956 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57830a-195a-4174-b43c-eefdeab9c47d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:40.330364 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f7d06f-8fe4-4ad6-addc-7620e57473d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:40.331864 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f7d06f-8fe4-4ad6-addc-7620e57473d7 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:40.390534 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:40.393810 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 373/744] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:58:40 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 03:58:40.394579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57830a-195a-4174-b43c-eefdeab9c47d None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:40.434305 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 372/745] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:58:40 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 04 03:58:40.435724 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e0a52-de63-4cbb-b28d-407068d31bff None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:40.436124 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e0a52-de63-4cbb-b28d-407068d31bff None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:40.436514 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e0a52-de63-4cbb-b28d-407068d31bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:40.453609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-dd0e0a52-de63-4cbb-b28d-407068d31bff None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:40.454881 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-dd0e0a52-de63-4cbb-b28d-407068d31bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:40.491347 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:40.512834 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57830a-195a-4174-b43c-eefdeab9c47d None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:40.528680 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 373/746] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:40 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 04 03:58:40.529366 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e0a52-de63-4cbb-b28d-407068d31bff None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:40.557616 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de507df7-6049-42a2-8eb7-5e028f0f6b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:40.558638 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de507df7-6049-42a2-8eb7-5e028f0f6b1e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:40.558928 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de507df7-6049-42a2-8eb7-5e028f0f6b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:40.559586 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de507df7-6049-42a2-8eb7-5e028f0f6b1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:40.572045 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de507df7-6049-42a2-8eb7-5e028f0f6b1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:40.573538 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de507df7-6049-42a2-8eb7-5e028f0f6b1e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:40.591511 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-de507df7-6049-42a2-8eb7-5e028f0f6b1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:40.591511 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:40.591511 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:40.591511 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:40.591511 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:40.591511 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:40.591511 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:40.591511 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:40.591511 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:40.591511 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:40.591511 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:40.591511 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:40.591511 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:40.591511 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:40.591511 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:40.592439 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:40.592439 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:40.592439 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:40.592439 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:40.592439 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:40.592439 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:40.592439 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:40.592439 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:40.592439 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:40.592439 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:40.592439 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:40.592439 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:40.592439 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:40.592439 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:40.592439 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:40.592439 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:40.592439 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:40.593379 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:40.593379 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:40.593379 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:40.593379 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:40.593379 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 374/747] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:40.593669 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de507df7-6049-42a2-8eb7-5e028f0f6b1e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:40.639858 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:40.653997 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e0a52-de63-4cbb-b28d-407068d31bff None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:40.691741 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929d788-6664-40bf-843f-12ecae395b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:40.692545 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929d788-6664-40bf-843f-12ecae395b5e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:40.692833 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929d788-6664-40bf-843f-12ecae395b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:40.693114 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929d788-6664-40bf-843f-12ecae395b5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:40.696318 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de507df7-6049-42a2-8eb7-5e028f0f6b1e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:40.703997 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929d788-6664-40bf-843f-12ecae395b5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:40.705477 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929d788-6664-40bf-843f-12ecae395b5e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:40.722770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-a929d788-6664-40bf-843f-12ecae395b5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:40.722770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:40.722770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:40.722770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:40.722770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:40.722770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:40.722770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:40.722770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:40.722770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:40.722770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:40.722770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:40.722770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:40.722770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:40.722770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:40.722770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:40.723693 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:40.723693 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:40.723693 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:40.723693 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:40.723693 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:40.723693 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:40.723693 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:40.723693 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:40.723693 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:40.723693 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:40.723693 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:40.723693 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:40.723693 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:40.723693 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:40.723693 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:40.723693 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:40.723693 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:40.724608 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:40.724608 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:40.724608 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:40.724608 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:40.724608 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 374/748] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:40.725641 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929d788-6664-40bf-843f-12ecae395b5e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:40.731919 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:40.737966 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca346c37-3f6a-4285-b651-f5e615d8a47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:40.738961 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca346c37-3f6a-4285-b651-f5e615d8a47a None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:40.739368 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca346c37-3f6a-4285-b651-f5e615d8a47a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:40.739854 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca346c37-3f6a-4285-b651-f5e615d8a47a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:40.751440 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca346c37-3f6a-4285-b651-f5e615d8a47a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:40.753046 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca346c37-3f6a-4285-b651-f5e615d8a47a None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:40.774847 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-ca346c37-3f6a-4285-b651-f5e615d8a47a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:40.774847 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:40.774847 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:40.774847 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:40.774847 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:40.774847 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:40.774847 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:40.774847 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:40.774847 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:40.774847 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:40.774847 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:40.774847 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:40.774847 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:40.774847 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:40.774847 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:40.775959 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:40.775959 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:40.775959 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:40.775959 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:40.775959 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:40.775959 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:40.775959 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:40.775959 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:40.775959 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:40.775959 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:40.775959 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:40.775959 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:40.775959 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:40.775959 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:40.775959 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:40.775959 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:40.775959 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:40.777095 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:40.777095 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:40.777095 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:40.777095 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:40.781916 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 375/749] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:40.781916 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca346c37-3f6a-4285-b651-f5e615d8a47a None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:40.833529 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929d788-6664-40bf-843f-12ecae395b5e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:40.868683 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916e168-b238-4a70-9b23-b4cd5ddb74bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:40.869380 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916e168-b238-4a70-9b23-b4cd5ddb74bf None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:40.869684 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916e168-b238-4a70-9b23-b4cd5ddb74bf None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:40.869952 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916e168-b238-4a70-9b23-b4cd5ddb74bf None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:40.870709 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916e168-b238-4a70-9b23-b4cd5ddb74bf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:40.872097 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916e168-b238-4a70-9b23-b4cd5ddb74bf None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:40.880889 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:40.892782 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca346c37-3f6a-4285-b651-f5e615d8a47a None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:40.894832 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 375/750] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Jul 4 03:58:40 2022] POST /identity/v3/services => generated 240 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 03:58:40.897201 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916e168-b238-4a70-9b23-b4cd5ddb74bf None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:40.940667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e526eddf-3e1a-4222-9ebf-b07f7343132b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:40.941423 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526eddf-3e1a-4222-9ebf-b07f7343132b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:40.941810 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526eddf-3e1a-4222-9ebf-b07f7343132b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:40.942044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526eddf-3e1a-4222-9ebf-b07f7343132b None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:40.943265 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e526eddf-3e1a-4222-9ebf-b07f7343132b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:40.943265 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e526eddf-3e1a-4222-9ebf-b07f7343132b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:40.944873 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e526eddf-3e1a-4222-9ebf-b07f7343132b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:40.963092 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 376/751] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:40.963092 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e526eddf-3e1a-4222-9ebf-b07f7343132b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:41.012235 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:41.036971 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916e168-b238-4a70-9b23-b4cd5ddb74bf None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:41.080880 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de175991-f356-4319-a7f1-87013fa418d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:41.081554 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de175991-f356-4319-a7f1-87013fa418d5 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:41.081842 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de175991-f356-4319-a7f1-87013fa418d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:41.082119 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de175991-f356-4319-a7f1-87013fa418d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:41.082900 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de175991-f356-4319-a7f1-87013fa418d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:41.083287 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de175991-f356-4319-a7f1-87013fa418d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:41.084673 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de175991-f356-4319-a7f1-87013fa418d5 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:41.084997 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e526eddf-3e1a-4222-9ebf-b07f7343132b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:41.098057 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 376/752] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:41.098941 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de175991-f356-4319-a7f1-87013fa418d5 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:41.129515 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104b4ea-1c28-4eae-b4d4-ddb674831d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:41.131214 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104b4ea-1c28-4eae-b4d4-ddb674831d7e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:41.132050 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104b4ea-1c28-4eae-b4d4-ddb674831d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:41.132540 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104b4ea-1c28-4eae-b4d4-ddb674831d7e None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:41.133749 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104b4ea-1c28-4eae-b4d4-ddb674831d7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:41.134622 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104b4ea-1c28-4eae-b4d4-ddb674831d7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:41.136790 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104b4ea-1c28-4eae-b4d4-ddb674831d7e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:41.153538 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 377/753] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:41.154775 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104b4ea-1c28-4eae-b4d4-ddb674831d7e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:41.173221 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:41.217876 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de175991-f356-4319-a7f1-87013fa418d5 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:41.255453 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2e833-af18-40d5-9ea8-bd325ce61522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:41.256611 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2e833-af18-40d5-9ea8-bd325ce61522 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:41.257164 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2e833-af18-40d5-9ea8-bd325ce61522 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:41.257673 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2e833-af18-40d5-9ea8-bd325ce61522 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:41.266389 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2e833-af18-40d5-9ea8-bd325ce61522 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:41.268659 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2e833-af18-40d5-9ea8-bd325ce61522 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:41.273188 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:41.276112 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104b4ea-1c28-4eae-b4d4-ddb674831d7e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:41.286620 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-1ff2e833-af18-40d5-9ea8-bd325ce61522 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 03:58:41.286620 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:41.286620 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:41.286620 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:41.286620 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:41.286620 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:41.286620 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:41.286620 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:41.286620 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:41.286620 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:41.286620 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:41.286620 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:41.286620 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 03:58:41.286620 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 03:58:41.286620 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 03:58:41.286620 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 03:58:41.287586 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:41.287586 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:41.287586 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 03:58:41.287586 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:41.287586 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 03:58:41.287586 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:41.287586 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:41.287586 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:41.287586 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:41.287586 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:41.287586 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:41.287586 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:41.287586 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:41.287586 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:41.287586 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:41.287586 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:41.287586 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:41.287586 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:41.288591 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:41.288591 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:41.288591 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 03:58:41.288591 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 03:58:41.288591 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 03:58:41.288591 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 03:58:41.288591 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 03:58:41.288591 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 03:58:41.288591 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 03:58:41.288591 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:41.291473 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 377/754] 10.222.0.49 () {56 vars in 1093 bytes} [Mon Jul 4 03:58:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:41.292406 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2e833-af18-40d5-9ea8-bd325ce61522 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:41.323844 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce88341-bc40-4a0f-9b38-38429ade4845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:41.324658 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce88341-bc40-4a0f-9b38-38429ade4845 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:41.324946 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce88341-bc40-4a0f-9b38-38429ade4845 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:41.325227 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce88341-bc40-4a0f-9b38-38429ade4845 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:41.335555 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce88341-bc40-4a0f-9b38-38429ade4845 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:41.338304 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce88341-bc40-4a0f-9b38-38429ade4845 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:41.358417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-0ce88341-bc40-4a0f-9b38-38429ade4845 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:41.358417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:41.358417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:41.358417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:41.358417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:41.358417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:41.358417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:41.358417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:41.358417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:41.358417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:41.358417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:41.358417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:41.358417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 03:58:41.358417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 03:58:41.358417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 03:58:41.359362 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 03:58:41.359362 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:41.359362 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:41.359362 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:41.359362 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:41.359362 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:41.359362 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:41.359362 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:41.359362 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:41.359362 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:41.359362 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:41.359362 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:41.359362 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:41.359362 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:41.359362 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:41.359362 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:41.359362 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:41.360274 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 03:58:41.360274 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 03:58:41.360274 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 03:58:41.360274 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 03:58:41.360274 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 03:58:41.360274 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 03:58:41.360274 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:41.360274 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:41.367928 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 378/755] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:58:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:41.367928 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce88341-bc40-4a0f-9b38-38429ade4845 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:41.412091 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2e833-af18-40d5-9ea8-bd325ce61522 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:41.434652 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:41.449059 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931237d-9194-4a64-910b-690d6249ca13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:41.449864 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931237d-9194-4a64-910b-690d6249ca13 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:41.450143 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931237d-9194-4a64-910b-690d6249ca13 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:41.450454 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931237d-9194-4a64-910b-690d6249ca13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:41.457501 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8931237d-9194-4a64-910b-690d6249ca13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:41.459000 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8931237d-9194-4a64-910b-690d6249ca13 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:41.474186 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-8931237d-9194-4a64-910b-690d6249ca13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:41.474186 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:41.474186 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:41.474186 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:41.474186 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:41.474186 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:41.474186 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:41.474186 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:41.474186 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:41.474186 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:41.474186 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:41.474186 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:41.474186 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 03:58:41.474186 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 03:58:41.474186 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 03:58:41.475077 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 03:58:41.475077 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:41.475077 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:41.475077 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:41.475077 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:41.475077 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:41.475077 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:41.475077 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:41.475077 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:41.475077 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:41.475077 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:41.475077 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:41.475077 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:41.475077 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:41.475077 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:41.475077 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:41.475077 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:41.476029 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 03:58:41.476029 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 03:58:41.476029 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 03:58:41.476029 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 03:58:41.476029 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 03:58:41.476029 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 03:58:41.476029 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:41.476029 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:41.476029 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 378/756] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:58:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:41.476522 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931237d-9194-4a64-910b-690d6249ca13 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:41.492721 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce88341-bc40-4a0f-9b38-38429ade4845 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:41.529890 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8dd88-d07b-41fc-942c-21dd38aca4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:41.530957 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8dd88-d07b-41fc-942c-21dd38aca4aa None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:41.531465 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8dd88-d07b-41fc-942c-21dd38aca4aa None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:41.531927 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8dd88-d07b-41fc-942c-21dd38aca4aa None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:41.532975 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8dd88-d07b-41fc-942c-21dd38aca4aa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:41.533478 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8dd88-d07b-41fc-942c-21dd38aca4aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:41.535200 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8dd88-d07b-41fc-942c-21dd38aca4aa None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:41.558489 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 379/757] 10.222.0.49 () {56 vars in 1133 bytes} [Mon Jul 4 03:58:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:41.560245 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c389dd7-65d5-4e74-a3ae-91c5c3da39d0 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:41.560721 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c389dd7-65d5-4e74-a3ae-91c5c3da39d0 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:41.561168 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c389dd7-65d5-4e74-a3ae-91c5c3da39d0 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:41.563073 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 380/758] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:41.564068 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c389dd7-65d5-4e74-a3ae-91c5c3da39d0 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:41.588756 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:41.680724 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c389dd7-65d5-4e74-a3ae-91c5c3da39d0 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:41.701152 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931237d-9194-4a64-910b-690d6249ca13 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:41.715962 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66feafbe-42ba-4502-877a-371fcb644d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:41.716745 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66feafbe-42ba-4502-877a-371fcb644d62 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:41.717155 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66feafbe-42ba-4502-877a-371fcb644d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:41.717539 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66feafbe-42ba-4502-877a-371fcb644d62 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:41.718374 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66feafbe-42ba-4502-877a-371fcb644d62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:41.718695 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66feafbe-42ba-4502-877a-371fcb644d62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:41.720157 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66feafbe-42ba-4502-877a-371fcb644d62 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:41.732041 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 381/759] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Jul 4 03:58:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:41.732774 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66feafbe-42ba-4502-877a-371fcb644d62 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:41.745301 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81828aa-1ce1-46a6-b95f-ea89b0f123c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:41.745901 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81828aa-1ce1-46a6-b95f-ea89b0f123c5 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:41.746211 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81828aa-1ce1-46a6-b95f-ea89b0f123c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:41.746561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81828aa-1ce1-46a6-b95f-ea89b0f123c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:41.747288 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81828aa-1ce1-46a6-b95f-ea89b0f123c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:41.747605 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81828aa-1ce1-46a6-b95f-ea89b0f123c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:41.749734 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81828aa-1ce1-46a6-b95f-ea89b0f123c5 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:41.762417 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 379/760] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Jul 4 03:58:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:41.763921 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db903b3-f8ef-41ed-8677-09f8f12ada21 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:41.764216 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db903b3-f8ef-41ed-8677-09f8f12ada21 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:41.764486 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db903b3-f8ef-41ed-8677-09f8f12ada21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:41.781223 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-8db903b3-f8ef-41ed-8677-09f8f12ada21 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:41.782461 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-8db903b3-f8ef-41ed-8677-09f8f12ada21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:41.817624 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:41.825100 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:41.849866 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66feafbe-42ba-4502-877a-371fcb644d62 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:41.858237 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 380/761] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 03:58:41.858237 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db903b3-f8ef-41ed-8677-09f8f12ada21 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:41.895652 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3146b-72a2-43f6-bd40-feb54a9a5d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:41.896678 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3146b-72a2-43f6-bd40-feb54a9a5d58 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:41.896862 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3146b-72a2-43f6-bd40-feb54a9a5d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:41.897144 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3146b-72a2-43f6-bd40-feb54a9a5d58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:41.908924 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3146b-72a2-43f6-bd40-feb54a9a5d58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:41.910432 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3146b-72a2-43f6-bd40-feb54a9a5d58 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:41.928829 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-f1c3146b-72a2-43f6-bd40-feb54a9a5d58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:41.928829 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:41.928829 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:41.928829 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:41.928829 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:41.928829 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:41.928829 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:41.928829 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:41.928829 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:41.928829 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:41.928829 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:41.928829 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:41.928829 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:41.928829 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:41.928829 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:41.929906 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:41.929906 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:41.929906 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:41.929906 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:41.929906 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:41.929906 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:41.929906 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:41.929906 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:41.929906 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:41.929906 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:41.929906 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:41.929906 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:41.929906 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:41.929906 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:41.929906 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:41.929906 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:41.929906 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:41.935560 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:41.935560 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:41.935560 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:41.935560 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:41.935560 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 382/762] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:41.935560 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3146b-72a2-43f6-bd40-feb54a9a5d58 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:41.960495 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db903b3-f8ef-41ed-8677-09f8f12ada21 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:42.006794 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a95e50-9ac9-402f-94aa-ee54c2da0b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:42.007395 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a95e50-9ac9-402f-94aa-ee54c2da0b95 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:42.007726 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a95e50-9ac9-402f-94aa-ee54c2da0b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:42.008023 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a95e50-9ac9-402f-94aa-ee54c2da0b95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:42.008886 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a95e50-9ac9-402f-94aa-ee54c2da0b95 None admin] RBAC: Adding query filter params (role.id=7fd75ec0129248b28b5254e00d4f6f0b, scope.project.id=424a145a22434ef7a14b6108e6118ccb, user.id=03e7f908f0a7499792e59e31d497edb7) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:42.009213 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a95e50-9ac9-402f-94aa-ee54c2da0b95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:42.010724 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a95e50-9ac9-402f-94aa-ee54c2da0b95 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:42.017950 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 381/763] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:58:41 2022] GET /identity/v3/role_assignments?user.id=03e7f908f0a7499792e59e31d497edb7&scope.project.id=424a145a22434ef7a14b6108e6118ccb&role.id=7fd75ec0129248b28b5254e00d4f6f0b => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:42.018808 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a95e50-9ac9-402f-94aa-ee54c2da0b95 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:42.056526 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3146b-72a2-43f6-bd40-feb54a9a5d58 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:42.082689 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:42.100204 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:42.109504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d6b4f-d676-4188-b9fa-1792eaa5c815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:42.110963 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d6b4f-d676-4188-b9fa-1792eaa5c815 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:42.111405 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d6b4f-d676-4188-b9fa-1792eaa5c815 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:42.111875 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d6b4f-d676-4188-b9fa-1792eaa5c815 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:42.113911 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d6b4f-d676-4188-b9fa-1792eaa5c815 None admin] RBAC: Adding query filter params (role.id=2eee98054d42475bb7e22a8487ab235e, scope.project.id=424a145a22434ef7a14b6108e6118ccb, user.id=24f93fdc98ff425791da3e2194b3a671) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:42.114442 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d6b4f-d676-4188-b9fa-1792eaa5c815 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:42.116258 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d6b4f-d676-4188-b9fa-1792eaa5c815 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:42.124741 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 383/764] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:58:41 2022] GET /identity/v3/role_assignments?user.id=24f93fdc98ff425791da3e2194b3a671&scope.project.id=424a145a22434ef7a14b6108e6118ccb&role.id=2eee98054d42475bb7e22a8487ab235e => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:42.126023 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d6b4f-d676-4188-b9fa-1792eaa5c815 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:42.147120 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a95e50-9ac9-402f-94aa-ee54c2da0b95 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:42.236574 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9ac11-92e5-4765-9d5e-36e15e2be1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:42.237580 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9ac11-92e5-4765-9d5e-36e15e2be1a9 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:42.237973 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9ac11-92e5-4765-9d5e-36e15e2be1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:42.238442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9ac11-92e5-4765-9d5e-36e15e2be1a9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:42.239224 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9ac11-92e5-4765-9d5e-36e15e2be1a9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:42.241124 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9ac11-92e5-4765-9d5e-36e15e2be1a9 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:42.256672 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-1ad9ac11-92e5-4765-9d5e-36e15e2be1a9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 03:58:42.256672 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:42.256672 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 03:58:42.256672 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 03:58:42.256672 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 03:58:42.256672 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 03:58:42.256672 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 03:58:42.256672 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:58:42.256672 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 03:58:42.256672 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:42.256672 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 03:58:42.256672 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:42.256672 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:42.256672 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:42.256672 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:42.256672 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:42.257715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:42.257715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:42.257715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:42.257715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:42.257715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:42.257715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:42.257715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:42.257715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 03:58:42.257715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 03:58:42.257715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 03:58:42.257715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 03:58:42.257715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:42.257715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:42.257715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:42.257715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:42.257715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:42.258611 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:42.258611 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:42.258611 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:42.258611 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:42.258611 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:42.258611 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:42.258611 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:42.258611 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:42.258611 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:42.258611 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:42.258611 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:42.258611 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 03:58:42.258611 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:58:42.258611 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 03:58:42.258611 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:42.262370 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 382/765] 10.222.0.49 () {56 vars in 1129 bytes} [Mon Jul 4 03:58:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:42.262643 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d6b4f-d676-4188-b9fa-1792eaa5c815 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:42.264483 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9ac11-92e5-4765-9d5e-36e15e2be1a9 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:42.306021 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0200b3-f8e2-4fdb-8002-0d94d6bc596c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:42.308394 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0200b3-f8e2-4fdb-8002-0d94d6bc596c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:42.309155 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0200b3-f8e2-4fdb-8002-0d94d6bc596c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:42.309650 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0200b3-f8e2-4fdb-8002-0d94d6bc596c None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:42.310730 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0200b3-f8e2-4fdb-8002-0d94d6bc596c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:42.311294 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0200b3-f8e2-4fdb-8002-0d94d6bc596c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:42.313192 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0200b3-f8e2-4fdb-8002-0d94d6bc596c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:42.326961 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 384/766] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:42.334203 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0200b3-f8e2-4fdb-8002-0d94d6bc596c None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:42.386187 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:42.387042 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9ac11-92e5-4765-9d5e-36e15e2be1a9 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:42.441520 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:42.449133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12131704-0f50-4c74-b163-aad21c5fa1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:42.450507 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12131704-0f50-4c74-b163-aad21c5fa1f5 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:42.450806 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12131704-0f50-4c74-b163-aad21c5fa1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:42.451095 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12131704-0f50-4c74-b163-aad21c5fa1f5 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:42.451813 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12131704-0f50-4c74-b163-aad21c5fa1f5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:42.452120 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12131704-0f50-4c74-b163-aad21c5fa1f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:42.453510 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12131704-0f50-4c74-b163-aad21c5fa1f5 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:42.464606 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 383/767] 10.222.0.49 () {56 vars in 1124 bytes} [Mon Jul 4 03:58:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:58:42.470304 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12131704-0f50-4c74-b163-aad21c5fa1f5 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:42.525539 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0200b3-f8e2-4fdb-8002-0d94d6bc596c None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:42.560756 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141dfb9-5db6-4723-b5bf-33d103ec42f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:42.561942 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141dfb9-5db6-4723-b5bf-33d103ec42f9 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:42.562481 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141dfb9-5db6-4723-b5bf-33d103ec42f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:42.562986 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141dfb9-5db6-4723-b5bf-33d103ec42f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:42.570500 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141dfb9-5db6-4723-b5bf-33d103ec42f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:42.572364 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141dfb9-5db6-4723-b5bf-33d103ec42f9 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:42.587673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-7141dfb9-5db6-4723-b5bf-33d103ec42f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:42.587673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:42.587673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:42.587673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:42.587673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:42.587673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:42.587673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:42.587673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:42.587673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:42.587673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:42.587673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:42.587673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:42.587673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 03:58:42.587673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 03:58:42.587673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 03:58:42.588632 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 03:58:42.588632 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:42.588632 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:42.588632 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:42.588632 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:42.588632 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:42.588632 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:42.588632 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:42.588632 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:42.588632 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:42.588632 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:42.588632 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:42.588632 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:42.588632 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:42.588632 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:42.588632 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:42.588632 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:42.589660 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 03:58:42.589660 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 03:58:42.589660 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 03:58:42.589660 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 03:58:42.589660 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 03:58:42.589660 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 03:58:42.589660 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:42.589660 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:42.590294 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12131704-0f50-4c74-b163-aad21c5fa1f5 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:42.592562 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 385/768] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:58:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:42.598289 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141dfb9-5db6-4723-b5bf-33d103ec42f9 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:42.624458 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a474ec4-ee8c-4cfa-829c-4d6d030b8341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:42.625129 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a474ec4-ee8c-4cfa-829c-4d6d030b8341 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:42.625411 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a474ec4-ee8c-4cfa-829c-4d6d030b8341 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:42.626085 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a474ec4-ee8c-4cfa-829c-4d6d030b8341 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:42.626689 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a474ec4-ee8c-4cfa-829c-4d6d030b8341 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:42.627054 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a474ec4-ee8c-4cfa-829c-4d6d030b8341 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:42.628450 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a474ec4-ee8c-4cfa-829c-4d6d030b8341 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:42.638199 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 384/769] 10.222.0.49 () {56 vars in 1124 bytes} [Mon Jul 4 03:58:42 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:42.640890 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a474ec4-ee8c-4cfa-829c-4d6d030b8341 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:42.694623 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:42.758780 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141dfb9-5db6-4723-b5bf-33d103ec42f9 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:42.790868 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:42.826600 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a474ec4-ee8c-4cfa-829c-4d6d030b8341 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:42.830543 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08cc1ce-5c76-4d74-8f32-be8badb1bca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:42.831277 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cc1ce-5c76-4d74-8f32-be8badb1bca1 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:42.831568 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cc1ce-5c76-4d74-8f32-be8badb1bca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:42.831848 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cc1ce-5c76-4d74-8f32-be8badb1bca1 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:42.832709 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08cc1ce-5c76-4d74-8f32-be8badb1bca1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:42.833030 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08cc1ce-5c76-4d74-8f32-be8badb1bca1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:42.834530 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08cc1ce-5c76-4d74-8f32-be8badb1bca1 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:42.862273 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 386/770] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Jul 4 03:58:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:58:42.867887 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08cc1ce-5c76-4d74-8f32-be8badb1bca1 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:42.897416 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6b15e-6f82-4047-91dc-3e6dc61685b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:42.898093 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6b15e-6f82-4047-91dc-3e6dc61685b7 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:42.898401 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6b15e-6f82-4047-91dc-3e6dc61685b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:42.898678 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6b15e-6f82-4047-91dc-3e6dc61685b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:42.899482 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6b15e-6f82-4047-91dc-3e6dc61685b7 None admin] RBAC: Adding query filter params (interface=public, service_id=43205dc98c1b49a9a283732229e772ae, region_id=RegionOne) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:42.904129 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6b15e-6f82-4047-91dc-3e6dc61685b7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:42.905545 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6b15e-6f82-4047-91dc-3e6dc61685b7 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:42.923326 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 385/771] 10.222.0.49 () {56 vars in 1251 bytes} [Mon Jul 4 03:58:42 2022] GET /identity/v3/endpoints?service_id=43205dc98c1b49a9a283732229e772ae&interface=public®ion_id=RegionOne => generated 194 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:42.928375 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6b15e-6f82-4047-91dc-3e6dc61685b7 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:43.058189 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08cc1ce-5c76-4d74-8f32-be8badb1bca1 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:43.064988 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:43.067905 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6b15e-6f82-4047-91dc-3e6dc61685b7 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:43.107965 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0dddd-1692-43de-8257-3c0385625822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:43.109022 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0dddd-1692-43de-8257-3c0385625822 None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:43.109412 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0dddd-1692-43de-8257-3c0385625822 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:43.109793 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0dddd-1692-43de-8257-3c0385625822 None admin] PATH_INFO: `/v3/projects/424a145a22434ef7a14b6108e6118ccb/users/8334e75253f843a980b01c6f0cda6015/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:43.112201 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0dddd-1692-43de-8257-3c0385625822 None admin] RBAC: Authorizing `identity:create_grant(project_id=424a145a22434ef7a14b6108e6118ccb, user_id=8334e75253f843a980b01c6f0cda6015, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:43.113762 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0dddd-1692-43de-8257-3c0385625822 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:43.116353 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069e3b5-deda-4327-8d86-e930560a6c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:43.117299 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069e3b5-deda-4327-8d86-e930560a6c3a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:43.117724 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069e3b5-deda-4327-8d86-e930560a6c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:43.118175 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069e3b5-deda-4327-8d86-e930560a6c3a None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:43.118892 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069e3b5-deda-4327-8d86-e930560a6c3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:43.120249 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069e3b5-deda-4327-8d86-e930560a6c3a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:43.126067 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 386/772] 10.222.0.49 () {56 vars in 1087 bytes} [Mon Jul 4 03:58:42 2022] GET /identity/v3/services => generated 772 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:43.127526 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c6056-b216-4fff-b4eb-968b282e1cdf None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:43.127818 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c6056-b216-4fff-b4eb-968b282e1cdf None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:43.128100 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c6056-b216-4fff-b4eb-968b282e1cdf None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:43.129593 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 387/774] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Jul 4 03:58:42 2022] PUT /identity/v3/projects/424a145a22434ef7a14b6108e6118ccb/users/8334e75253f843a980b01c6f0cda6015/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 03:58:43.130220 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 387/774] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:43.135595 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2bb1fc-249d-42fe-a54a-17d665c32c77 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:43.136340 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2bb1fc-249d-42fe-a54a-17d665c32c77 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:43.136694 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2bb1fc-249d-42fe-a54a-17d665c32c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:43.160583 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-2f2bb1fc-249d-42fe-a54a-17d665c32c77 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:43.162384 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-2f2bb1fc-249d-42fe-a54a-17d665c32c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:43.195696 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:43.264258 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 388/775] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 03:58:43.287939 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c6056-b216-4fff-b4eb-968b282e1cdf None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:43.421323 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c6056-b216-4fff-b4eb-968b282e1cdf None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:43.456776 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ce745-af9c-45c7-b7a9-215dabf378f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:43.457585 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ce745-af9c-45c7-b7a9-215dabf378f2 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:43.457871 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ce745-af9c-45c7-b7a9-215dabf378f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:43.458147 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ce745-af9c-45c7-b7a9-215dabf378f2 None admin] PATH_INFO: `/v3/services/network` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:43.458834 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ce745-af9c-45c7-b7a9-215dabf378f2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:43.460366 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ce745-af9c-45c7-b7a9-215dabf378f2 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:43.472630 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-339ce745-af9c-45c7-b7a9-215dabf378f2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 03:58:43.472630 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:43.472630 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 03:58:43.472630 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 03:58:43.472630 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 03:58:43.472630 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 03:58:43.472630 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 03:58:43.472630 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:58:43.472630 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 03:58:43.472630 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:43.472630 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 03:58:43.472630 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:43.472630 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:43.472630 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:43.472630 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:43.472630 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:43.472630 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:43.473654 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:43.473654 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:43.473654 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:43.473654 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:43.473654 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:43.473654 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:43.473654 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 03:58:43.473654 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 03:58:43.473654 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 03:58:43.473654 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 03:58:43.473654 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:43.473654 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:43.473654 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:43.473654 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:43.473654 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:43.473654 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:43.474524 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:43.474524 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:43.474524 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:43.474524 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:43.474524 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:43.474524 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:43.474524 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:43.474524 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:43.474524 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:43.474524 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:43.474524 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 03:58:43.474524 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:58:43.474524 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 03:58:43.474524 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:43.474524 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 388/776] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:58:43 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:43.480318 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2bb1fc-249d-42fe-a54a-17d665c32c77 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:43.625989 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2bb1fc-249d-42fe-a54a-17d665c32c77 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:43.666364 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96c57c-89c1-4279-96fd-757749f3c21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:43.667046 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96c57c-89c1-4279-96fd-757749f3c21b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:43.667334 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96c57c-89c1-4279-96fd-757749f3c21b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:43.667617 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96c57c-89c1-4279-96fd-757749f3c21b None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:43.668341 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b96c57c-89c1-4279-96fd-757749f3c21b None admin] RBAC: Adding query filter params (name=network) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:43.668652 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b96c57c-89c1-4279-96fd-757749f3c21b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:43.670061 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b96c57c-89c1-4279-96fd-757749f3c21b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:43.675153 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 389/777] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Jul 4 03:58:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:43.680858 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ce745-af9c-45c7-b7a9-215dabf378f2 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:43.704108 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:43.806786 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ce745-af9c-45c7-b7a9-215dabf378f2 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:43.845667 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27655c4-2ea9-4f72-9584-27b7a748778a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:43.846407 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27655c4-2ea9-4f72-9584-27b7a748778a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:43.846698 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27655c4-2ea9-4f72-9584-27b7a748778a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:43.846979 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27655c4-2ea9-4f72-9584-27b7a748778a None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:43.847710 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27655c4-2ea9-4f72-9584-27b7a748778a None admin] RBAC: Adding query filter params (type=network) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:43.848021 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27655c4-2ea9-4f72-9584-27b7a748778a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:43.849503 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27655c4-2ea9-4f72-9584-27b7a748778a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:43.855556 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 389/778] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Jul 4 03:58:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:43.861422 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96c57c-89c1-4279-96fd-757749f3c21b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:43.891149 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:43.967588 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96c57c-89c1-4279-96fd-757749f3c21b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:44.000255 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab0e36-f670-4b95-a828-c9937237e4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:44.000946 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab0e36-f670-4b95-a828-c9937237e4cf None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:44.001238 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab0e36-f670-4b95-a828-c9937237e4cf None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:44.001521 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab0e36-f670-4b95-a828-c9937237e4cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:44.002365 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ab0e36-f670-4b95-a828-c9937237e4cf None admin] RBAC: Adding query filter params (interface=public, service_id=5a2d2fec7929448b94a8cbff6fe21994, region_id=RegionOne) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:44.002687 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ab0e36-f670-4b95-a828-c9937237e4cf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:44.004175 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ab0e36-f670-4b95-a828-c9937237e4cf None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:44.012870 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 390/779] 10.222.0.49 () {56 vars in 1251 bytes} [Mon Jul 4 03:58:43 2022] GET /identity/v3/endpoints?service_id=5a2d2fec7929448b94a8cbff6fe21994&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:44.018305 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27655c4-2ea9-4f72-9584-27b7a748778a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:44.121208 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:44.145187 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27655c4-2ea9-4f72-9584-27b7a748778a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:44.190355 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9138907-5ede-41ab-ab44-806a7f090aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:44.191025 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9138907-5ede-41ab-ab44-806a7f090aea None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:44.191310 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9138907-5ede-41ab-ab44-806a7f090aea None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:44.191590 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9138907-5ede-41ab-ab44-806a7f090aea None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:44.192338 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9138907-5ede-41ab-ab44-806a7f090aea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:44.193728 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9138907-5ede-41ab-ab44-806a7f090aea None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:44.202132 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 390/780] 10.222.0.49 () {56 vars in 1087 bytes} [Mon Jul 4 03:58:44 2022] GET /identity/v3/services => generated 772 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:44.540389 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001d5ad-4720-4bb3-bb1d-01f52a574705 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:44.540945 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001d5ad-4720-4bb3-bb1d-01f52a574705 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:44.540945 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001d5ad-4720-4bb3-bb1d-01f52a574705 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:44.542709 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 391/781] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:44.548191 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfcd33-d862-4e5c-9e50-57c648a2e7dd None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:44.548632 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfcd33-d862-4e5c-9e50-57c648a2e7dd None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:44.548743 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfcd33-d862-4e5c-9e50-57c648a2e7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:44.565977 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-a1dfcd33-d862-4e5c-9e50-57c648a2e7dd None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:44.567296 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a1dfcd33-d862-4e5c-9e50-57c648a2e7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:44.642518 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 391/782] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 03:58:44.663532 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001d5ad-4720-4bb3-bb1d-01f52a574705 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:44.676026 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4a6f3-0603-47fb-9762-ac238bdcb4f6 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:44.676353 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4a6f3-0603-47fb-9762-ac238bdcb4f6 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:44.676596 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4a6f3-0603-47fb-9762-ac238bdcb4f6 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:44.678138 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 392/783] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:44.684405 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5ee79-935d-4e07-b2db-31d05a73ed02 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:44.684693 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5ee79-935d-4e07-b2db-31d05a73ed02 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:44.684970 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5ee79-935d-4e07-b2db-31d05a73ed02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:44.703785 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-7ef5ee79-935d-4e07-b2db-31d05a73ed02 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:44.706530 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7ef5ee79-935d-4e07-b2db-31d05a73ed02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:44.802617 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:44.818430 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001d5ad-4720-4bb3-bb1d-01f52a574705 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:44.822582 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 393/784] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 03:58:44.860868 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab464e-bf2e-419f-ac2b-4af3c3e54b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:44.862074 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab464e-bf2e-419f-ac2b-4af3c3e54b06 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:44.862578 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab464e-bf2e-419f-ac2b-4af3c3e54b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:44.863106 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab464e-bf2e-419f-ac2b-4af3c3e54b06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:44.870997 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5ee79-935d-4e07-b2db-31d05a73ed02 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:44.882186 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:44.889050 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab464e-bf2e-419f-ac2b-4af3c3e54b06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:58:44.903621 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-07ab464e-bf2e-419f-ac2b-4af3c3e54b06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:58:44.903621 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:44.903621 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:44.903621 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:44.903621 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:44.903621 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:44.903621 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:44.903621 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:44.903621 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:44.903621 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:44.903621 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:44.903621 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:44.903621 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:58:44.903621 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:58:44.903621 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:58:44.903621 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:58:44.904602 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:58:44.904602 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:58:44.904602 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:58:44.904602 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:58:44.904602 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:44.904602 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:44.904602 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:44.904602 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:44.904602 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:44.904602 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:44.904602 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:44.904602 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:44.904602 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:44.904602 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:44.904602 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:44.904602 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:44.905464 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:44.905464 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:44.905464 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:44.905464 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:44.905464 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:58:44.905464 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:58:44.905464 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:58:44.905464 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:58:44.905464 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:58:44.905464 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:58:44.905464 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:58:44.905464 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:44.906635 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 392/785] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Jul 4 03:58:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:44.910904 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab464e-bf2e-419f-ac2b-4af3c3e54b06 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:45.031657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5ee79-935d-4e07-b2db-31d05a73ed02 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:45.087091 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9823c3-230a-4b24-952a-9024f4daf2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:45.088607 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9823c3-230a-4b24-952a-9024f4daf2fd None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:45.088886 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9823c3-230a-4b24-952a-9024f4daf2fd None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:45.089159 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9823c3-230a-4b24-952a-9024f4daf2fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:45.105697 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9823c3-230a-4b24-952a-9024f4daf2fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:58:45.116322 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-ee9823c3-230a-4b24-952a-9024f4daf2fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 03:58:45.116322 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:45.116322 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:45.116322 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:45.116322 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:45.116322 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:45.116322 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:45.116322 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:45.116322 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:45.116322 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:45.116322 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:45.116322 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:45.116322 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:58:45.116322 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:58:45.116322 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:58:45.116322 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:58:45.117256 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:58:45.117256 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:58:45.117256 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:58:45.117256 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:58:45.117256 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:45.117256 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:45.117256 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:45.117256 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:45.117256 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:45.117256 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:45.117256 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:45.117256 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:45.117256 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:45.117256 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:45.117256 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:45.117256 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:45.118533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:45.118533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:45.118533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:45.118533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:45.118533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:58:45.118533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:58:45.118533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:58:45.118533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:58:45.118533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:58:45.118533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:58:45.118533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 03:58:45.118533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:45.118533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 394/786] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Jul 4 03:58:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:58:45.122767 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab464e-bf2e-419f-ac2b-4af3c3e54b06 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:45.125992 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9823c3-230a-4b24-952a-9024f4daf2fd None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:45.175598 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7790b290-203d-4a08-a0eb-d7c1a44df801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:45.176421 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790b290-203d-4a08-a0eb-d7c1a44df801 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:45.176813 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790b290-203d-4a08-a0eb-d7c1a44df801 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:45.177095 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790b290-203d-4a08-a0eb-d7c1a44df801 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:45.177856 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7790b290-203d-4a08-a0eb-d7c1a44df801 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:45.178179 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7790b290-203d-4a08-a0eb-d7c1a44df801 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:45.180027 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7790b290-203d-4a08-a0eb-d7c1a44df801 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:45.190463 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 393/787] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:58:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:58:45.203435 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7790b290-203d-4a08-a0eb-d7c1a44df801 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:45.230884 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:45.239321 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:45.268077 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9823c3-230a-4b24-952a-9024f4daf2fd None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:45.304915 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d97be0-f85a-4dd7-8e19-6597a7793494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:45.306329 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d97be0-f85a-4dd7-8e19-6597a7793494 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:45.306821 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d97be0-f85a-4dd7-8e19-6597a7793494 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:45.307376 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d97be0-f85a-4dd7-8e19-6597a7793494 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:45.308372 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d97be0-f85a-4dd7-8e19-6597a7793494 None admin] RBAC: Adding query filter params (name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:45.308905 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d97be0-f85a-4dd7-8e19-6597a7793494 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:45.310834 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d97be0-f85a-4dd7-8e19-6597a7793494 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:45.324495 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 395/788] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Jul 4 03:58:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:45.325968 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d97be0-f85a-4dd7-8e19-6597a7793494 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:45.383709 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7790b290-203d-4a08-a0eb-d7c1a44df801 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:45.450775 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf91ed-71cd-43c2-958d-364eb7d455b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:45.451587 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf91ed-71cd-43c2-958d-364eb7d455b2 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:45.451868 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf91ed-71cd-43c2-958d-364eb7d455b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:45.452143 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf91ed-71cd-43c2-958d-364eb7d455b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:45.464024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf91ed-71cd-43c2-958d-364eb7d455b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:45.465707 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf91ed-71cd-43c2-958d-364eb7d455b2 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:45.482630 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-75bf91ed-71cd-43c2-958d-364eb7d455b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:45.482630 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:45.482630 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:45.482630 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:45.482630 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:45.482630 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:45.482630 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:45.482630 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:45.482630 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:45.482630 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:45.482630 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:45.482630 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:45.482630 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:45.482630 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:45.482630 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:45.483579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:45.483579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:45.483579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:45.483579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:45.483579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:45.483579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:45.483579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:45.483579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:45.483579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:45.483579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:45.483579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:45.483579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:45.483579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:45.483579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:45.483579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:45.483579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:45.483579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:45.484701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:45.484701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:45.484701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:45.484701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:45.484701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 394/789] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:45.504185 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d97be0-f85a-4dd7-8e19-6597a7793494 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:45.515228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf91ed-71cd-43c2-958d-364eb7d455b2 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:45.540087 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0b10f-b5dc-4cc7-8d97-4b41d12f87a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:45.541173 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0b10f-b5dc-4cc7-8d97-4b41d12f87a7 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:45.541712 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0b10f-b5dc-4cc7-8d97-4b41d12f87a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:45.542272 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0b10f-b5dc-4cc7-8d97-4b41d12f87a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:45.546473 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:45.568655 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0b10f-b5dc-4cc7-8d97-4b41d12f87a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:45.572175 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0b10f-b5dc-4cc7-8d97-4b41d12f87a7 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:45.606525 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-17e0b10f-b5dc-4cc7-8d97-4b41d12f87a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:45.606525 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:45.606525 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:45.606525 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:45.606525 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:45.606525 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:45.606525 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:45.606525 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:45.606525 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:45.606525 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:45.606525 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:45.606525 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:45.606525 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:45.606525 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:45.606525 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:45.607603 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:45.607603 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:45.607603 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:45.607603 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:45.607603 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:45.607603 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:45.607603 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:45.607603 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:45.607603 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:45.607603 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:45.607603 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:45.607603 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:45.607603 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:45.607603 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:45.607603 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:45.607603 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:45.607603 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:45.608501 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:45.608501 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:45.608501 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:45.608501 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:45.614262 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 396/790] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:58:45.618726 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53deb627-0220-47c1-bcc1-e86763668695 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:45.619173 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53deb627-0220-47c1-bcc1-e86763668695 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:45.619615 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53deb627-0220-47c1-bcc1-e86763668695 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:45.621333 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 397/791] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 03:58:45.625713 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53deb627-0220-47c1-bcc1-e86763668695 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:45.643091 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:45.684226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf91ed-71cd-43c2-958d-364eb7d455b2 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:45.722484 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425b8b6-c9a9-4bf3-ab15-ad48d3b7730a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:45.723225 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425b8b6-c9a9-4bf3-ab15-ad48d3b7730a None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:45.723518 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425b8b6-c9a9-4bf3-ab15-ad48d3b7730a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:45.723796 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425b8b6-c9a9-4bf3-ab15-ad48d3b7730a None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:45.724554 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1425b8b6-c9a9-4bf3-ab15-ad48d3b7730a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:45.724862 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1425b8b6-c9a9-4bf3-ab15-ad48d3b7730a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:45.726445 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1425b8b6-c9a9-4bf3-ab15-ad48d3b7730a None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:45.735979 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53deb627-0220-47c1-bcc1-e86763668695 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:45.738981 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 395/792] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:45.740482 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b073266-2268-4d02-b249-6f01f8c4100c None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:45.740976 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b073266-2268-4d02-b249-6f01f8c4100c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:45.741457 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b073266-2268-4d02-b249-6f01f8c4100c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:45.760325 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-3b073266-2268-4d02-b249-6f01f8c4100c None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:45.761867 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3b073266-2268-4d02-b249-6f01f8c4100c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:45.770857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e1122-bc58-4fbb-a196-82971586e055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:45.771549 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e1122-bc58-4fbb-a196-82971586e055 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:45.771826 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e1122-bc58-4fbb-a196-82971586e055 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:45.772141 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e1122-bc58-4fbb-a196-82971586e055 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:45.772976 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e1122-bc58-4fbb-a196-82971586e055 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:45.773285 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e1122-bc58-4fbb-a196-82971586e055 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:45.774700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e1122-bc58-4fbb-a196-82971586e055 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:45.786566 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 398/793] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:45.787863 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc79207-723d-4d91-bdcd-2b739a82783b None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:45.788143 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc79207-723d-4d91-bdcd-2b739a82783b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:45.788420 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc79207-723d-4d91-bdcd-2b739a82783b None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:45.789800 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 399/794] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:45.790564 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc79207-723d-4d91-bdcd-2b739a82783b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:45.836446 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:45.844677 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 396/795] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 03:58:45.845806 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b073266-2268-4d02-b249-6f01f8c4100c None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:45.904323 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc79207-723d-4d91-bdcd-2b739a82783b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:45.914943 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:45.947180 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b87303-8759-4f54-b245-9594d360a531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:45.947987 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b87303-8759-4f54-b245-9594d360a531 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:45.948255 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b87303-8759-4f54-b245-9594d360a531 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:45.948528 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b87303-8759-4f54-b245-9594d360a531 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:45.955581 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b87303-8759-4f54-b245-9594d360a531 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:45.957021 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b87303-8759-4f54-b245-9594d360a531 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:45.965114 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b073266-2268-4d02-b249-6f01f8c4100c None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:45.974367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-d4b87303-8759-4f54-b245-9594d360a531 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 04 03:58:45.974367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:45.974367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:45.974367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:45.974367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:45.974367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:45.974367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:45.974367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:45.974367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:45.974367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:45.974367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:45.974367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:45.974367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 03:58:45.974367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 03:58:45.974367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 03:58:45.974367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 03:58:45.975383 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:45.975383 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:45.975383 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 03:58:45.975383 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:45.975383 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 03:58:45.975383 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:45.975383 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:45.975383 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:45.975383 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:45.975383 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:45.975383 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:45.975383 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:45.975383 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:45.975383 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:45.975383 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:45.975383 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:45.975383 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:45.975383 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:45.976930 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:45.976930 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:45.976930 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 03:58:45.976930 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 03:58:45.976930 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 03:58:45.976930 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 03:58:45.976930 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 03:58:45.976930 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 03:58:45.976930 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 04 03:58:45.976930 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:45.976930 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 400/796] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Jul 4 03:58:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:45.977574 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d1af7-622b-45d7-bb0a-8aa6f18d7775 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:45.977574 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d1af7-622b-45d7-bb0a-8aa6f18d7775 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:45.977707 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d1af7-622b-45d7-bb0a-8aa6f18d7775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:45.998662 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-531d1af7-622b-45d7-bb0a-8aa6f18d7775 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:46.000365 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-531d1af7-622b-45d7-bb0a-8aa6f18d7775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:46.003485 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8fd3a-5fb2-4e7b-8589-97321f2c7894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:46.004316 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8fd3a-5fb2-4e7b-8589-97321f2c7894 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:46.004602 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8fd3a-5fb2-4e7b-8589-97321f2c7894 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:46.004881 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8fd3a-5fb2-4e7b-8589-97321f2c7894 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:46.012534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8fd3a-5fb2-4e7b-8589-97321f2c7894 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:46.014446 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8fd3a-5fb2-4e7b-8589-97321f2c7894 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:46.029849 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-f5a8fd3a-5fb2-4e7b-8589-97321f2c7894 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 03:58:46.029849 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:46.029849 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:46.029849 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:46.029849 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:46.029849 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:46.029849 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:46.029849 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:46.029849 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:46.029849 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:46.029849 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:46.029849 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:46.029849 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 03:58:46.029849 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 03:58:46.029849 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 03:58:46.029849 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 03:58:46.030995 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:46.030995 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:46.030995 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 03:58:46.030995 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:46.030995 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 03:58:46.030995 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:46.030995 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:46.030995 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:46.030995 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:46.030995 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:46.030995 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:46.030995 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:46.030995 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:46.030995 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:46.030995 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:46.030995 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:46.030995 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:46.030995 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:46.031948 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:46.031948 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:46.031948 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 03:58:46.031948 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 03:58:46.031948 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 03:58:46.031948 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 03:58:46.031948 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 03:58:46.031948 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 03:58:46.031948 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 03:58:46.031948 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:46.031948 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 397/797] 10.222.0.49 () {56 vars in 1117 bytes} [Mon Jul 4 03:58:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:46.032575 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8fd3a-5fb2-4e7b-8589-97321f2c7894 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:46.078192 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 401/798] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 03:58:46.078192 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d1af7-622b-45d7-bb0a-8aa6f18d7775 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:46.114785 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:46.156335 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8fd3a-5fb2-4e7b-8589-97321f2c7894 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:46.176362 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:46.193113 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d1af7-622b-45d7-bb0a-8aa6f18d7775 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:46.197283 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922126d-e518-4f16-8c2d-30b7b5c58040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:46.198259 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922126d-e518-4f16-8c2d-30b7b5c58040 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:46.198558 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922126d-e518-4f16-8c2d-30b7b5c58040 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:46.198840 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922126d-e518-4f16-8c2d-30b7b5c58040 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:46.199516 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922126d-e518-4f16-8c2d-30b7b5c58040 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:46.200932 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922126d-e518-4f16-8c2d-30b7b5c58040 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:46.213700 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-c922126d-e518-4f16-8c2d-30b7b5c58040 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 03:58:46.213700 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:46.213700 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 03:58:46.213700 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 03:58:46.213700 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 03:58:46.213700 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 03:58:46.213700 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 03:58:46.213700 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:58:46.213700 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 03:58:46.213700 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:46.213700 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 03:58:46.213700 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:46.213700 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:46.213700 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:46.213700 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:46.213700 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:46.214707 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:46.214707 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:46.214707 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:46.214707 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:46.214707 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:46.214707 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:46.214707 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:46.214707 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 03:58:46.214707 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 03:58:46.214707 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 03:58:46.214707 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 03:58:46.214707 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:46.214707 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:46.214707 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:46.214707 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:46.214707 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:46.215540 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:46.215540 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:46.215540 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:46.215540 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:46.215540 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:46.215540 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:46.215540 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:46.215540 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:46.215540 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:46.215540 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:46.215540 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:46.215540 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 03:58:46.215540 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:58:46.215540 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 04 03:58:46.215540 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:46.215540 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 398/799] 10.222.0.49 () {56 vars in 1129 bytes} [Mon Jul 4 03:58:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:46.216414 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922126d-e518-4f16-8c2d-30b7b5c58040 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:46.233984 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba5783-1393-4346-9fc0-e79f9cb55934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:46.234695 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba5783-1393-4346-9fc0-e79f9cb55934 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:46.234977 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba5783-1393-4346-9fc0-e79f9cb55934 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:46.235256 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba5783-1393-4346-9fc0-e79f9cb55934 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:46.236098 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba5783-1393-4346-9fc0-e79f9cb55934 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:46.236410 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba5783-1393-4346-9fc0-e79f9cb55934 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:46.237845 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba5783-1393-4346-9fc0-e79f9cb55934 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:46.259739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 402/800] 10.222.0.49 () {56 vars in 1135 bytes} [Mon Jul 4 03:58:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:46.259739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba5783-1393-4346-9fc0-e79f9cb55934 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:46.329731 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922126d-e518-4f16-8c2d-30b7b5c58040 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:46.349796 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:46.362618 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba5783-1393-4346-9fc0-e79f9cb55934 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:46.374456 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ce737-09c3-4737-af3c-eca2179a3142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:46.375273 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ce737-09c3-4737-af3c-eca2179a3142 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:46.375560 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ce737-09c3-4737-af3c-eca2179a3142 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:46.376073 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ce737-09c3-4737-af3c-eca2179a3142 None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:46.377393 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ce737-09c3-4737-af3c-eca2179a3142 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:46.377710 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ce737-09c3-4737-af3c-eca2179a3142 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:46.379350 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ce737-09c3-4737-af3c-eca2179a3142 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:46.399368 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b31c48-1d50-438c-83c0-8a11b346b6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:46.400275 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b31c48-1d50-438c-83c0-8a11b346b6a1 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:46.400566 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b31c48-1d50-438c-83c0-8a11b346b6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:46.400845 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b31c48-1d50-438c-83c0-8a11b346b6a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:46.406485 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 399/801] 10.222.0.49 () {56 vars in 1149 bytes} [Mon Jul 4 03:58:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:46.406485 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ce737-09c3-4737-af3c-eca2179a3142 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:46.416415 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b31c48-1d50-438c-83c0-8a11b346b6a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:58:46.425065 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-31b31c48-1d50-438c-83c0-8a11b346b6a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:58:46.425065 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:46.425065 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:46.425065 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:46.425065 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:46.425065 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:46.425065 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:46.425065 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:46.425065 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:46.425065 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:46.425065 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:46.425065 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:46.425065 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:58:46.425065 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:58:46.425065 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:58:46.425065 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:58:46.426546 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:58:46.426546 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:58:46.426546 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:58:46.426546 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:58:46.426546 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:46.426546 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:46.426546 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:46.426546 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:46.426546 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:46.426546 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:46.426546 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:46.426546 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:46.426546 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:46.426546 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:46.426546 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:46.426546 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:46.427384 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:46.427384 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:46.427384 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:46.427384 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:46.427384 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:58:46.427384 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:58:46.427384 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:58:46.427384 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:58:46.427384 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:58:46.427384 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:58:46.427384 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:58:46.427384 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:46.427384 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 403/802] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Jul 4 03:58:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:46.427384 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b31c48-1d50-438c-83c0-8a11b346b6a1 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:46.456547 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:46.520780 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ce737-09c3-4737-af3c-eca2179a3142 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:46.545367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b31c48-1d50-438c-83c0-8a11b346b6a1 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:46.557806 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb3365-b880-4b7d-8c95-ec234952ccbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:46.558559 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb3365-b880-4b7d-8c95-ec234952ccbc None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:46.558843 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb3365-b880-4b7d-8c95-ec234952ccbc None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:46.559126 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb3365-b880-4b7d-8c95-ec234952ccbc None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:46.559840 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb3365-b880-4b7d-8c95-ec234952ccbc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:46.560151 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb3365-b880-4b7d-8c95-ec234952ccbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:46.561554 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb3365-b880-4b7d-8c95-ec234952ccbc None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:46.570618 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 400/803] 10.222.0.49 () {56 vars in 1124 bytes} [Mon Jul 4 03:58:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:46.570618 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb3365-b880-4b7d-8c95-ec234952ccbc None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:46.584056 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6ef06-3a2f-4849-a499-e80a5352b5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:46.585010 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6ef06-3a2f-4849-a499-e80a5352b5a4 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:46.585255 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6ef06-3a2f-4849-a499-e80a5352b5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:46.585538 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6ef06-3a2f-4849-a499-e80a5352b5a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:46.596902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6ef06-3a2f-4849-a499-e80a5352b5a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:46.598418 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6ef06-3a2f-4849-a499-e80a5352b5a4 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:46.607997 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:46.618319 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-77e6ef06-3a2f-4849-a499-e80a5352b5a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:46.618319 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:46.618319 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:46.618319 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:46.618319 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:46.618319 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:46.618319 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:46.618319 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:46.618319 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:46.618319 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:46.618319 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:46.618319 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:46.618319 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:46.618319 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:46.618319 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:46.619225 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:46.619225 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:46.619225 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:46.619225 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:46.619225 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:46.619225 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:46.619225 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:46.619225 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:46.619225 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:46.619225 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:46.619225 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:46.619225 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:46.619225 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:46.619225 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:46.619225 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:46.619225 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:46.619225 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:46.620124 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:46.620124 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:46.620124 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:46.620124 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:46.620124 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 404/804] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:46.620404 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6ef06-3a2f-4849-a499-e80a5352b5a4 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:46.677591 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb3365-b880-4b7d-8c95-ec234952ccbc None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:46.679412 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:46.714845 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437a757-9f2d-4435-bc7b-f2e18c96275c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:46.716109 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437a757-9f2d-4435-bc7b-f2e18c96275c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:46.716402 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437a757-9f2d-4435-bc7b-f2e18c96275c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:46.716683 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437a757-9f2d-4435-bc7b-f2e18c96275c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:46.727328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437a757-9f2d-4435-bc7b-f2e18c96275c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:46.728323 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6ef06-3a2f-4849-a499-e80a5352b5a4 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:46.728827 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437a757-9f2d-4435-bc7b-f2e18c96275c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:46.746738 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-a437a757-9f2d-4435-bc7b-f2e18c96275c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:46.746738 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:46.746738 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:46.746738 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:46.746738 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:46.746738 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:46.746738 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:46.746738 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:46.746738 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:46.746738 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:46.746738 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:46.746738 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:46.746738 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:46.746738 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:46.746738 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:46.747677 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:46.747677 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:46.747677 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:46.747677 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:46.747677 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:46.747677 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:46.747677 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:46.747677 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:46.747677 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:46.747677 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:46.747677 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:46.747677 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:46.747677 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:46.747677 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:46.747677 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:46.747677 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:46.747677 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:46.748575 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:46.748575 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:46.748575 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:46.748575 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:46.752521 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 401/805] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:46.753290 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437a757-9f2d-4435-bc7b-f2e18c96275c None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:46.768340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d26b30-40b2-4028-8b3c-b158c7c35eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:46.769013 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d26b30-40b2-4028-8b3c-b158c7c35eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:46.769306 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d26b30-40b2-4028-8b3c-b158c7c35eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:46.769589 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d26b30-40b2-4028-8b3c-b158c7c35eb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:46.770386 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d26b30-40b2-4028-8b3c-b158c7c35eb2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:46.770703 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d26b30-40b2-4028-8b3c-b158c7c35eb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:46.772155 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d26b30-40b2-4028-8b3c-b158c7c35eb2 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:46.780375 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 405/806] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:58:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:46.781176 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d26b30-40b2-4028-8b3c-b158c7c35eb2 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:46.842245 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:46.856695 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437a757-9f2d-4435-bc7b-f2e18c96275c None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:46.879959 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d26b30-40b2-4028-8b3c-b158c7c35eb2 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:46.890954 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0f9ee-3591-4f7c-aec8-67e93105f669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:46.891624 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0f9ee-3591-4f7c-aec8-67e93105f669 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:46.891909 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0f9ee-3591-4f7c-aec8-67e93105f669 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:46.892190 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0f9ee-3591-4f7c-aec8-67e93105f669 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:46.892895 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e0f9ee-3591-4f7c-aec8-67e93105f669 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:46.893204 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e0f9ee-3591-4f7c-aec8-67e93105f669 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:46.894652 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e0f9ee-3591-4f7c-aec8-67e93105f669 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:46.899372 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 402/807] 10.222.0.49 () {56 vars in 1124 bytes} [Mon Jul 4 03:58:46 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:46.900561 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef563e70-26be-48ea-b016-1858ae656df7 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:46.900848 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef563e70-26be-48ea-b016-1858ae656df7 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:46.901125 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef563e70-26be-48ea-b016-1858ae656df7 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:46.902553 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 403/808] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:46.906957 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef563e70-26be-48ea-b016-1858ae656df7 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:46.913314 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d732c4-9bfc-4d22-a351-0f58a1711a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:46.913981 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d732c4-9bfc-4d22-a351-0f58a1711a99 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:46.914312 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d732c4-9bfc-4d22-a351-0f58a1711a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:46.914628 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d732c4-9bfc-4d22-a351-0f58a1711a99 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:46.915374 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d732c4-9bfc-4d22-a351-0f58a1711a99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:46.915690 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d732c4-9bfc-4d22-a351-0f58a1711a99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:46.917076 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d732c4-9bfc-4d22-a351-0f58a1711a99 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:46.926034 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:46.929675 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 406/809] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:46.930451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d732c4-9bfc-4d22-a351-0f58a1711a99 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:47.018888 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef563e70-26be-48ea-b016-1858ae656df7 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:47.037295 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d732c4-9bfc-4d22-a351-0f58a1711a99 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:47.060146 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:47.061852 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94018ce-5c20-4b62-be0d-be1207efe04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:47.062638 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94018ce-5c20-4b62-be0d-be1207efe04e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:47.062956 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94018ce-5c20-4b62-be0d-be1207efe04e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:47.063241 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94018ce-5c20-4b62-be0d-be1207efe04e None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:47.063976 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94018ce-5c20-4b62-be0d-be1207efe04e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:47.064290 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94018ce-5c20-4b62-be0d-be1207efe04e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:47.065706 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94018ce-5c20-4b62-be0d-be1207efe04e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:47.071823 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676bb98b-9c37-45de-b3a3-f39c86561f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:47.072615 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676bb98b-9c37-45de-b3a3-f39c86561f5e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:47.072899 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676bb98b-9c37-45de-b3a3-f39c86561f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:47.073174 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676bb98b-9c37-45de-b3a3-f39c86561f5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:47.077688 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 404/810] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:47.078514 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94018ce-5c20-4b62-be0d-be1207efe04e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:47.086188 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676bb98b-9c37-45de-b3a3-f39c86561f5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:47.087744 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676bb98b-9c37-45de-b3a3-f39c86561f5e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:47.106703 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-676bb98b-9c37-45de-b3a3-f39c86561f5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:47.106703 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:47.106703 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:47.106703 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:47.106703 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:47.106703 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:47.106703 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:47.106703 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:47.106703 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:47.106703 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:47.106703 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:47.106703 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:47.106703 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:47.106703 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:47.106703 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:47.107782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:47.107782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:47.107782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:47.107782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:47.107782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:47.107782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:47.107782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:47.107782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:47.107782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:47.107782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:47.107782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:47.107782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:47.107782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:47.107782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:47.107782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:47.107782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:47.107782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:47.113444 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:47.113444 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:47.113444 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:47.113444 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:47.113444 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 407/811] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:47.113444 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9caded5-720c-42f0-b432-89029ed10c26 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:47.113444 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9caded5-720c-42f0-b432-89029ed10c26 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:47.113444 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9caded5-720c-42f0-b432-89029ed10c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:47.126773 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-a9caded5-720c-42f0-b432-89029ed10c26 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:47.128016 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a9caded5-720c-42f0-b432-89029ed10c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:47.159834 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:47.181945 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94018ce-5c20-4b62-be0d-be1207efe04e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:47.195155 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 408/812] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 03:58:47.195985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9caded5-720c-42f0-b432-89029ed10c26 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:47.233776 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53929794-6e4e-4458-aa77-97e2151ed698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:47.234865 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53929794-6e4e-4458-aa77-97e2151ed698 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:47.235156 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53929794-6e4e-4458-aa77-97e2151ed698 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:47.235440 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53929794-6e4e-4458-aa77-97e2151ed698 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:47.236556 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53929794-6e4e-4458-aa77-97e2151ed698 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:47.238295 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53929794-6e4e-4458-aa77-97e2151ed698 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:47.258777 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 405/813] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Jul 4 03:58:47 2022] POST /identity/v3/endpoints => generated 346 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 03:58:47.259587 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53929794-6e4e-4458-aa77-97e2151ed698 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:47.304008 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9caded5-720c-42f0-b432-89029ed10c26 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:47.306594 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:47.354725 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc2954-bf59-479f-8d56-36bb5574e932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:47.356677 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc2954-bf59-479f-8d56-36bb5574e932 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:47.356677 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc2954-bf59-479f-8d56-36bb5574e932 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:47.356862 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc2954-bf59-479f-8d56-36bb5574e932 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:47.364484 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc2954-bf59-479f-8d56-36bb5574e932 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:47.366045 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc2954-bf59-479f-8d56-36bb5574e932 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:47.381442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-26fc2954-bf59-479f-8d56-36bb5574e932 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:47.381442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:47.381442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:47.381442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:47.381442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:47.381442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:47.381442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:47.381442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:47.381442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:47.381442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:47.381442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:47.381442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:47.381442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 03:58:47.381442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 03:58:47.381442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 03:58:47.382486 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 03:58:47.382486 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:47.382486 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:47.382486 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:47.382486 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:47.382486 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:47.382486 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:47.382486 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:47.382486 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:47.382486 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:47.382486 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:47.382486 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:47.382486 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:47.382486 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:47.382486 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:47.382486 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:47.382486 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:47.383393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 03:58:47.383393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 03:58:47.383393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 03:58:47.383393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 03:58:47.383393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 03:58:47.383393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 03:58:47.383393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:47.383393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:47.383393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 409/814] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:58:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:47.384325 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc2954-bf59-479f-8d56-36bb5574e932 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:47.400596 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53929794-6e4e-4458-aa77-97e2151ed698 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:47.436531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b026c0-37e9-40c3-bf94-841ba5ad933d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:47.437201 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b026c0-37e9-40c3-bf94-841ba5ad933d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:47.437489 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b026c0-37e9-40c3-bf94-841ba5ad933d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:47.437773 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b026c0-37e9-40c3-bf94-841ba5ad933d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:47.439813 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:47.446759 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b026c0-37e9-40c3-bf94-841ba5ad933d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:47.449127 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b026c0-37e9-40c3-bf94-841ba5ad933d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:47.466805 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-a0b026c0-37e9-40c3-bf94-841ba5ad933d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:47.466805 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:47.466805 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:47.466805 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:47.466805 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:47.466805 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:47.466805 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:47.466805 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:47.466805 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:47.466805 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:47.466805 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:47.466805 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:47.466805 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 03:58:47.466805 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 03:58:47.466805 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 03:58:47.467786 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 03:58:47.467786 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:47.467786 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:47.467786 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:47.467786 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:47.467786 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:47.467786 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:47.467786 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:47.467786 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:47.467786 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:47.467786 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:47.467786 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:47.467786 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:47.467786 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:47.467786 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:47.467786 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:47.467786 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:47.468704 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 03:58:47.468704 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 03:58:47.468704 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 03:58:47.468704 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 03:58:47.468704 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 03:58:47.468704 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 03:58:47.468704 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:47.468704 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:47.468704 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 406/815] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:58:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:47.469770 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b026c0-37e9-40c3-bf94-841ba5ad933d None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:47.503670 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc2954-bf59-479f-8d56-36bb5574e932 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:47.540060 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9652f-e131-4b14-8b11-5b6496bb509e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:47.540732 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9652f-e131-4b14-8b11-5b6496bb509e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:47.541020 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9652f-e131-4b14-8b11-5b6496bb509e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:47.541303 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9652f-e131-4b14-8b11-5b6496bb509e None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:47.542034 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9652f-e131-4b14-8b11-5b6496bb509e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:47.542385 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9652f-e131-4b14-8b11-5b6496bb509e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:47.543771 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9652f-e131-4b14-8b11-5b6496bb509e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:47.560130 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 410/816] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:47.560965 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9652f-e131-4b14-8b11-5b6496bb509e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:47.580233 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b026c0-37e9-40c3-bf94-841ba5ad933d None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:47.584738 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:47.620574 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ded04-3652-4a14-b9d7-4ea1ee3d93e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:47.622343 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ded04-3652-4a14-b9d7-4ea1ee3d93e5 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:47.622859 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ded04-3652-4a14-b9d7-4ea1ee3d93e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:47.623482 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ded04-3652-4a14-b9d7-4ea1ee3d93e5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:47.624787 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ded04-3652-4a14-b9d7-4ea1ee3d93e5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:47.626684 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ded04-3652-4a14-b9d7-4ea1ee3d93e5 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:47.640579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-d26ded04-3652-4a14-b9d7-4ea1ee3d93e5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 03:58:47.640579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:47.640579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 03:58:47.640579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 03:58:47.640579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 03:58:47.640579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 03:58:47.640579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 03:58:47.640579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:58:47.640579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 03:58:47.640579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:47.640579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 03:58:47.640579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:47.640579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:47.640579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:47.640579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:47.640579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:47.640579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:47.641779 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:47.641779 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:47.641779 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:47.641779 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:47.641779 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:47.641779 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:47.641779 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 03:58:47.641779 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 03:58:47.641779 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 03:58:47.641779 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 03:58:47.641779 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:47.641779 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:47.641779 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:47.641779 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:47.641779 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:47.641779 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:47.642717 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:47.642717 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:47.642717 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:47.642717 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:47.642717 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:47.642717 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:47.642717 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:47.642717 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:47.642717 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:47.642717 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:47.642717 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 03:58:47.642717 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:58:47.642717 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 04 03:58:47.642717 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:47.642717 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 407/817] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:58:47 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:47.643541 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ded04-3652-4a14-b9d7-4ea1ee3d93e5 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:47.672163 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9652f-e131-4b14-8b11-5b6496bb509e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:47.705999 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894ec21-07ef-4073-ba77-939c83a26f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:47.706598 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894ec21-07ef-4073-ba77-939c83a26f5b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:47.706887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894ec21-07ef-4073-ba77-939c83a26f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:47.707178 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894ec21-07ef-4073-ba77-939c83a26f5b None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:47.707969 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894ec21-07ef-4073-ba77-939c83a26f5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:47.708283 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894ec21-07ef-4073-ba77-939c83a26f5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:47.709768 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894ec21-07ef-4073-ba77-939c83a26f5b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:47.713695 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:47.722106 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 411/818] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Jul 4 03:58:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:47.723249 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894ec21-07ef-4073-ba77-939c83a26f5b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:47.764721 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ded04-3652-4a14-b9d7-4ea1ee3d93e5 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:47.801883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c09fb7-e912-4116-b44e-f102983690f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:47.802589 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c09fb7-e912-4116-b44e-f102983690f7 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:47.802873 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c09fb7-e912-4116-b44e-f102983690f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:47.803151 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c09fb7-e912-4116-b44e-f102983690f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:47.803935 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c09fb7-e912-4116-b44e-f102983690f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:47.804249 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c09fb7-e912-4116-b44e-f102983690f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:47.805708 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c09fb7-e912-4116-b44e-f102983690f7 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:47.813005 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:47.825225 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 408/819] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Jul 4 03:58:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:47.825225 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c09fb7-e912-4116-b44e-f102983690f7 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:47.832781 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894ec21-07ef-4073-ba77-939c83a26f5b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:47.867124 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a0246-2b6c-4400-9e78-3b7aab1933b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:47.868145 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a0246-2b6c-4400-9e78-3b7aab1933b3 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:47.868431 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a0246-2b6c-4400-9e78-3b7aab1933b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:47.868710 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a0246-2b6c-4400-9e78-3b7aab1933b3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:47.876057 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a0246-2b6c-4400-9e78-3b7aab1933b3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:47.877532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a0246-2b6c-4400-9e78-3b7aab1933b3 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:47.892775 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-a85a0246-2b6c-4400-9e78-3b7aab1933b3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 03:58:47.892775 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:47.892775 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:47.892775 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:47.892775 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:47.892775 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:47.892775 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:47.892775 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:47.892775 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:47.892775 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:47.892775 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:47.892775 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:47.892775 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 03:58:47.892775 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 03:58:47.892775 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 03:58:47.892775 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 03:58:47.893755 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:47.893755 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:47.893755 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 03:58:47.893755 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:47.893755 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 03:58:47.893755 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:47.893755 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:47.893755 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:47.893755 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:47.893755 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:47.893755 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:47.893755 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:47.893755 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:47.893755 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:47.893755 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:47.893755 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:47.893755 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:47.893755 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:47.895420 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:47.895420 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:47.895420 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 03:58:47.895420 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 03:58:47.895420 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 03:58:47.895420 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 03:58:47.895420 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 03:58:47.895420 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 03:58:47.895420 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 03:58:47.895420 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:47.895420 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 412/820] 10.222.0.49 () {56 vars in 1093 bytes} [Mon Jul 4 03:58:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:47.895420 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a0246-2b6c-4400-9e78-3b7aab1933b3 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:47.942370 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c09fb7-e912-4116-b44e-f102983690f7 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:47.960030 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:47.978751 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757b5a7-0560-431a-86fc-1aba411f9971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:47.979432 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757b5a7-0560-431a-86fc-1aba411f9971 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:47.979720 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757b5a7-0560-431a-86fc-1aba411f9971 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:47.979999 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757b5a7-0560-431a-86fc-1aba411f9971 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:47.980708 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4757b5a7-0560-431a-86fc-1aba411f9971 None admin] RBAC: Adding query filter params (name=network) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:47.981020 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4757b5a7-0560-431a-86fc-1aba411f9971 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:47.982495 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4757b5a7-0560-431a-86fc-1aba411f9971 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:47.991635 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 409/821] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Jul 4 03:58:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:47.991635 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757b5a7-0560-431a-86fc-1aba411f9971 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:48.013743 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a0246-2b6c-4400-9e78-3b7aab1933b3 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:48.048342 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ba2c7-7af2-4b59-af01-e53f26d9fd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:48.049245 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ba2c7-7af2-4b59-af01-e53f26d9fd09 None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:48.049536 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ba2c7-7af2-4b59-af01-e53f26d9fd09 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:48.049814 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ba2c7-7af2-4b59-af01-e53f26d9fd09 None admin] PATH_INFO: `/v3/projects/424a145a22434ef7a14b6108e6118ccb/users/24f93fdc98ff425791da3e2194b3a671/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:48.051844 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ba2c7-7af2-4b59-af01-e53f26d9fd09 None admin] RBAC: Authorizing `identity:create_grant(project_id=424a145a22434ef7a14b6108e6118ccb, user_id=24f93fdc98ff425791da3e2194b3a671, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:48.053360 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ba2c7-7af2-4b59-af01-e53f26d9fd09 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:48.062506 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:48.074248 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 413/822] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Jul 4 03:58:47 2022] PUT /identity/v3/projects/424a145a22434ef7a14b6108e6118ccb/users/24f93fdc98ff425791da3e2194b3a671/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 03:58:48.075254 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ba2c7-7af2-4b59-af01-e53f26d9fd09 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:48.110622 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757b5a7-0560-431a-86fc-1aba411f9971 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:48.155672 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac763107-46ff-4224-b821-2a4d011607da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:48.156732 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac763107-46ff-4224-b821-2a4d011607da None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:48.157061 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac763107-46ff-4224-b821-2a4d011607da None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:48.157349 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac763107-46ff-4224-b821-2a4d011607da None admin] PATH_INFO: `/v3/projects/424a145a22434ef7a14b6108e6118ccb/users/03e7f908f0a7499792e59e31d497edb7/roles/7fd75ec0129248b28b5254e00d4f6f0b` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:48.176175 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac763107-46ff-4224-b821-2a4d011607da None admin] RBAC: Authorizing `identity:create_grant(project_id=424a145a22434ef7a14b6108e6118ccb, user_id=03e7f908f0a7499792e59e31d497edb7, role_id=7fd75ec0129248b28b5254e00d4f6f0b)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:48.177676 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac763107-46ff-4224-b821-2a4d011607da None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:48.192740 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ba2c7-7af2-4b59-af01-e53f26d9fd09 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:48.202236 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 410/823] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Jul 4 03:58:47 2022] PUT /identity/v3/projects/424a145a22434ef7a14b6108e6118ccb/users/03e7f908f0a7499792e59e31d497edb7/roles/7fd75ec0129248b28b5254e00d4f6f0b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 03:58:48.203513 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac763107-46ff-4224-b821-2a4d011607da None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:48.263152 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af070d-3fe0-4f1c-b0e7-7a4095945bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:48.264097 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af070d-3fe0-4f1c-b0e7-7a4095945bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:48.264390 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af070d-3fe0-4f1c-b0e7-7a4095945bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:48.264671 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af070d-3fe0-4f1c-b0e7-7a4095945bb8 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:48.265553 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af070d-3fe0-4f1c-b0e7-7a4095945bb8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:48.265875 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af070d-3fe0-4f1c-b0e7-7a4095945bb8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:48.267418 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af070d-3fe0-4f1c-b0e7-7a4095945bb8 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:48.270587 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:48.291610 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 414/824] 10.222.0.49 () {56 vars in 1133 bytes} [Mon Jul 4 03:58:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:48.297689 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af070d-3fe0-4f1c-b0e7-7a4095945bb8 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:48.358934 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac763107-46ff-4224-b821-2a4d011607da None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:48.365575 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:48.408828 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca538fd5-ca03-4b55-887c-b7f45ed1dc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:48.409914 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca538fd5-ca03-4b55-887c-b7f45ed1dc69 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:48.410429 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca538fd5-ca03-4b55-887c-b7f45ed1dc69 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:48.410948 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca538fd5-ca03-4b55-887c-b7f45ed1dc69 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:48.412004 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca538fd5-ca03-4b55-887c-b7f45ed1dc69 None admin] RBAC: Adding query filter params (type=network) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:48.412502 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca538fd5-ca03-4b55-887c-b7f45ed1dc69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:48.414422 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca538fd5-ca03-4b55-887c-b7f45ed1dc69 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:48.418021 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af070d-3fe0-4f1c-b0e7-7a4095945bb8 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:48.420539 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 411/825] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Jul 4 03:58:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:48.426386 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca538fd5-ca03-4b55-887c-b7f45ed1dc69 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:48.457792 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e7670-0e35-4ba8-8903-cd846ced3b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:48.458490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e7670-0e35-4ba8-8903-cd846ced3b55 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:48.458777 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e7670-0e35-4ba8-8903-cd846ced3b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:48.459059 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e7670-0e35-4ba8-8903-cd846ced3b55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:48.557385 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca538fd5-ca03-4b55-887c-b7f45ed1dc69 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:48.566510 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:48.587787 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e7670-0e35-4ba8-8903-cd846ced3b55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:48.590108 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e7670-0e35-4ba8-8903-cd846ced3b55 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:48.623467 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc230b0b-192b-4e4d-9cfb-6000b6e36daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:48.624156 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc230b0b-192b-4e4d-9cfb-6000b6e36daf None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:48.624452 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc230b0b-192b-4e4d-9cfb-6000b6e36daf None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:48.624733 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc230b0b-192b-4e4d-9cfb-6000b6e36daf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:48.625508 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc230b0b-192b-4e4d-9cfb-6000b6e36daf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:48.626948 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc230b0b-192b-4e4d-9cfb-6000b6e36daf None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:48.653117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:48.699721 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 415/826] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:58:48 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 04 03:58:48.704568 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 412/827] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Jul 4 03:58:48 2022] POST /identity/v3/endpoints => generated 327 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 03:58:48.706662 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e7670-0e35-4ba8-8903-cd846ced3b55 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:48.823810 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e7670-0e35-4ba8-8903-cd846ced3b55 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:48.868683 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e7b10-7787-424d-82ff-f24aff40bb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:48.869892 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e7b10-7787-424d-82ff-f24aff40bb88 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:48.870396 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e7b10-7787-424d-82ff-f24aff40bb88 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:48.870886 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e7b10-7787-424d-82ff-f24aff40bb88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:48.883166 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e7b10-7787-424d-82ff-f24aff40bb88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:48.885066 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e7b10-7787-424d-82ff-f24aff40bb88 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:48.904305 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-c69e7b10-7787-424d-82ff-f24aff40bb88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:48.904305 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:48.904305 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:48.904305 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:48.904305 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:48.904305 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:48.904305 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:48.904305 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:48.904305 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:48.904305 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:48.904305 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:48.904305 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:48.904305 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:48.904305 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:48.904305 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:48.905265 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:48.905265 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:48.905265 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:48.905265 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:48.905265 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:48.905265 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:48.905265 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:48.905265 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:48.905265 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:48.905265 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:48.905265 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:48.905265 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:48.905265 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:48.905265 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:48.905265 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:48.905265 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:48.905265 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:48.906187 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:48.906187 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:48.906187 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:48.906187 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:48.908597 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 416/828] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:48.913977 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc230b0b-192b-4e4d-9cfb-6000b6e36daf None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:49.050514 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc230b0b-192b-4e4d-9cfb-6000b6e36daf None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:49.092209 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70403c-e204-43fe-b54a-a186c0e1aacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:49.093218 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70403c-e204-43fe-b54a-a186c0e1aacb None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:49.093712 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70403c-e204-43fe-b54a-a186c0e1aacb None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:49.094238 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70403c-e204-43fe-b54a-a186c0e1aacb None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:49.095167 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e70403c-e204-43fe-b54a-a186c0e1aacb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:49.095675 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e70403c-e204-43fe-b54a-a186c0e1aacb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:49.097366 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e70403c-e204-43fe-b54a-a186c0e1aacb None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:49.115665 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 413/829] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:49.120750 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e7b10-7787-424d-82ff-f24aff40bb88 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:49.130422 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:49.227941 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e7b10-7787-424d-82ff-f24aff40bb88 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:49.262910 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623629d-4b50-4247-b025-9a49fc7fc32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:49.264087 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623629d-4b50-4247-b025-9a49fc7fc32b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:49.264608 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623629d-4b50-4247-b025-9a49fc7fc32b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:49.265099 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623629d-4b50-4247-b025-9a49fc7fc32b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:49.272524 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6623629d-4b50-4247-b025-9a49fc7fc32b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:49.274283 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6623629d-4b50-4247-b025-9a49fc7fc32b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:49.288660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-6623629d-4b50-4247-b025-9a49fc7fc32b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:49.288660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:49.288660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:49.288660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:49.288660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:49.288660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:49.288660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:49.288660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:49.288660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:49.288660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:49.288660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:49.288660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:49.288660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 03:58:49.288660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 03:58:49.288660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 03:58:49.289561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 03:58:49.289561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:49.289561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:49.289561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:49.289561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:49.289561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:49.289561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:49.289561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:49.289561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:49.289561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:49.289561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:49.289561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:49.289561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:49.289561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:49.289561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:49.289561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:49.289561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:49.290574 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 03:58:49.290574 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 03:58:49.290574 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 03:58:49.290574 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 03:58:49.290574 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 03:58:49.290574 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 03:58:49.290574 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:49.290574 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:49.293092 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 417/830] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:58:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:49.298527 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70403c-e204-43fe-b54a-a186c0e1aacb None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:49.314001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:49.412620 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70403c-e204-43fe-b54a-a186c0e1aacb None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:49.421897 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e99b2-4ae2-4442-a668-26a3d8f1dca0 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:49.422465 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e99b2-4ae2-4442-a668-26a3d8f1dca0 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:49.422967 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e99b2-4ae2-4442-a668-26a3d8f1dca0 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:49.424814 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 418/831] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 03:58:49.429849 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c200fe-36ec-44e9-a652-7f79c2cd2384 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:49.430481 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c200fe-36ec-44e9-a652-7f79c2cd2384 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:49.430983 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c200fe-36ec-44e9-a652-7f79c2cd2384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:49.449978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-62c200fe-36ec-44e9-a652-7f79c2cd2384 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:49.451578 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-62c200fe-36ec-44e9-a652-7f79c2cd2384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:49.452804 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792ad5f-6085-4543-8084-f504f008cdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:49.453491 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792ad5f-6085-4543-8084-f504f008cdc1 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:49.453782 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792ad5f-6085-4543-8084-f504f008cdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:49.454068 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792ad5f-6085-4543-8084-f504f008cdc1 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:49.455104 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792ad5f-6085-4543-8084-f504f008cdc1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:49.455424 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792ad5f-6085-4543-8084-f504f008cdc1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:49.457695 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792ad5f-6085-4543-8084-f504f008cdc1 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:49.472856 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 414/832] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Jul 4 03:58:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:58:49.478602 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792ad5f-6085-4543-8084-f504f008cdc1 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:49.535486 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:49.548808 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 419/833] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 03:58:49.571122 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c200fe-36ec-44e9-a652-7f79c2cd2384 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:49.578542 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:49.609999 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792ad5f-6085-4543-8084-f504f008cdc1 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:49.647114 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2818d4-0a21-4bf3-aa6f-3969dd2704cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:49.647840 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2818d4-0a21-4bf3-aa6f-3969dd2704cf None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:49.648127 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2818d4-0a21-4bf3-aa6f-3969dd2704cf None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:49.648407 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2818d4-0a21-4bf3-aa6f-3969dd2704cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:49.649247 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2818d4-0a21-4bf3-aa6f-3969dd2704cf None admin] RBAC: Adding query filter params (role.id=2eee98054d42475bb7e22a8487ab235e, scope.project.id=424a145a22434ef7a14b6108e6118ccb, user.id=8334e75253f843a980b01c6f0cda6015) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:49.649566 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2818d4-0a21-4bf3-aa6f-3969dd2704cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:49.651295 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2818d4-0a21-4bf3-aa6f-3969dd2704cf None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:49.658085 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 415/834] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:58:49 2022] GET /identity/v3/role_assignments?user.id=8334e75253f843a980b01c6f0cda6015&scope.project.id=424a145a22434ef7a14b6108e6118ccb&role.id=2eee98054d42475bb7e22a8487ab235e => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:58:49.680995 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c200fe-36ec-44e9-a652-7f79c2cd2384 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:49.721438 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c9aef-0e1a-485e-95e6-00189332d5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:49.722287 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c9aef-0e1a-485e-95e6-00189332d5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:49.722574 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c9aef-0e1a-485e-95e6-00189332d5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:49.722855 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c9aef-0e1a-485e-95e6-00189332d5e4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:49.723537 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c9aef-0e1a-485e-95e6-00189332d5e4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:49.724957 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c9aef-0e1a-485e-95e6-00189332d5e4 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:49.738061 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-3a8c9aef-0e1a-485e-95e6-00189332d5e4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 03:58:49.738061 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:49.738061 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 03:58:49.738061 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 03:58:49.738061 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 03:58:49.738061 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 03:58:49.738061 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 03:58:49.738061 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:58:49.738061 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 03:58:49.738061 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:49.738061 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 03:58:49.738061 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:49.738061 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:49.738061 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:49.738061 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:49.738061 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:49.738061 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:49.739148 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:49.739148 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:49.739148 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:49.739148 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:49.739148 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:49.739148 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:49.739148 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 03:58:49.739148 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 03:58:49.739148 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 03:58:49.739148 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 03:58:49.739148 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:49.739148 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:49.739148 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:49.739148 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:49.739148 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:49.739148 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:49.740700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:49.740700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:49.740700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:49.740700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:49.740700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:49.740700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:49.740700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:49.740700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:49.740700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:49.740700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:49.740700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 03:58:49.740700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:58:49.740700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 03:58:49.740700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:49.740700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 420/835] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Jul 4 03:58:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:58:49.745595 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2818d4-0a21-4bf3-aa6f-3969dd2704cf None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:49.864632 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2818d4-0a21-4bf3-aa6f-3969dd2704cf None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:49.905196 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd078db-6259-476f-b8a4-18fd789bb690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:49.905882 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd078db-6259-476f-b8a4-18fd789bb690 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:49.906200 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd078db-6259-476f-b8a4-18fd789bb690 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:49.906478 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd078db-6259-476f-b8a4-18fd789bb690 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:49.907197 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd078db-6259-476f-b8a4-18fd789bb690 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:49.907509 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd078db-6259-476f-b8a4-18fd789bb690 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:49.908917 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd078db-6259-476f-b8a4-18fd789bb690 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:49.911227 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:49.915030 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 416/836] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Jul 4 03:58:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:49.920651 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c9aef-0e1a-485e-95e6-00189332d5e4 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:49.985155 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:50.028581 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c9aef-0e1a-485e-95e6-00189332d5e4 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:50.063541 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4602b-ff87-45ab-8585-dffe586e9815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:50.064518 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4602b-ff87-45ab-8585-dffe586e9815 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:50.065015 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4602b-ff87-45ab-8585-dffe586e9815 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:50.065484 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4602b-ff87-45ab-8585-dffe586e9815 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:50.066415 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f4602b-ff87-45ab-8585-dffe586e9815 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:50.066904 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f4602b-ff87-45ab-8585-dffe586e9815 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:50.068467 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f4602b-ff87-45ab-8585-dffe586e9815 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:50.073915 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 421/837] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Jul 4 03:58:49 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:50.513527 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e0051-b520-4ae1-ab30-9701653c70ef None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:50.514286 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e0051-b520-4ae1-ab30-9701653c70ef None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:50.514804 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e0051-b520-4ae1-ab30-9701653c70ef None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:50.516683 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 417/838] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:50.522312 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370c0f5-6805-4ba6-b274-6f53b8dd93c3 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:50.522853 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370c0f5-6805-4ba6-b274-6f53b8dd93c3 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:50.523339 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370c0f5-6805-4ba6-b274-6f53b8dd93c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:50.540780 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-3370c0f5-6805-4ba6-b274-6f53b8dd93c3 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:50.542319 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3370c0f5-6805-4ba6-b274-6f53b8dd93c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:50.549158 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b68ae-2dee-4a4f-b3e2-3f6b70d640cc None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:50.549450 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b68ae-2dee-4a4f-b3e2-3f6b70d640cc None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:50.549730 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b68ae-2dee-4a4f-b3e2-3f6b70d640cc None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:50.551336 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 418/839] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:50.557791 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191830a-068b-49c5-b746-a0e767f68fe6 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:50.558086 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191830a-068b-49c5-b746-a0e767f68fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:50.558404 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191830a-068b-49c5-b746-a0e767f68fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:50.577444 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-0191830a-068b-49c5-b746-a0e767f68fe6 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:50.578991 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0191830a-068b-49c5-b746-a0e767f68fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:50.626200 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 422/840] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 03:58:50.650284 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370c0f5-6805-4ba6-b274-6f53b8dd93c3 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:50.656534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 419/841] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 03:58:50.681601 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191830a-068b-49c5-b746-a0e767f68fe6 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:50.713510 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:50.767691 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370c0f5-6805-4ba6-b274-6f53b8dd93c3 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:50.800499 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191830a-068b-49c5-b746-a0e767f68fe6 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:50.806963 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b9184-f7c0-46f7-8b1e-d5a3c8b511ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:50.807930 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b9184-f7c0-46f7-8b1e-d5a3c8b511ac None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:50.808217 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b9184-f7c0-46f7-8b1e-d5a3c8b511ac None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:50.808495 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b9184-f7c0-46f7-8b1e-d5a3c8b511ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:50.819784 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8b9184-f7c0-46f7-8b1e-d5a3c8b511ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:58:50.827628 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-4b8b9184-f7c0-46f7-8b1e-d5a3c8b511ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 03:58:50.827628 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:50.827628 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:50.827628 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:50.827628 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:50.827628 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:50.827628 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:50.827628 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:50.827628 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:50.827628 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:50.827628 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:50.827628 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:50.827628 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:58:50.827628 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:58:50.827628 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:58:50.827628 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:58:50.828689 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:58:50.828689 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:58:50.828689 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:58:50.828689 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:58:50.828689 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:50.828689 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:50.828689 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:50.828689 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:50.828689 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:50.828689 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:50.828689 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:50.828689 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:50.828689 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:50.828689 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:50.828689 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:50.828689 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:50.829550 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:50.829550 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:50.829550 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:50.829550 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:50.829550 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:58:50.829550 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:58:50.829550 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:58:50.829550 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:58:50.829550 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:58:50.829550 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:58:50.829550 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 03:58:50.829550 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:50.829550 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 423/842] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Jul 4 03:58:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:58:50.835064 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b9184-f7c0-46f7-8b1e-d5a3c8b511ac None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:50.841599 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:50.851397 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002b9f3-16c4-4c10-8efa-90caa22450bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:50.853252 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002b9f3-16c4-4c10-8efa-90caa22450bf None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:50.853908 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002b9f3-16c4-4c10-8efa-90caa22450bf None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:50.854538 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002b9f3-16c4-4c10-8efa-90caa22450bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:50.869694 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1002b9f3-16c4-4c10-8efa-90caa22450bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:58:50.880057 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-1002b9f3-16c4-4c10-8efa-90caa22450bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:58:50.880057 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:50.880057 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:50.880057 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:50.880057 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:50.880057 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:50.880057 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:50.880057 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:50.880057 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:50.880057 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:50.880057 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:50.880057 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:50.880057 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:58:50.880057 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:58:50.880057 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:58:50.880057 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:58:50.881113 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:58:50.881113 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:58:50.881113 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:58:50.881113 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:58:50.881113 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:50.881113 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:50.881113 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:50.881113 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:50.881113 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:50.881113 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:50.881113 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:50.881113 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:50.881113 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:50.881113 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:50.881113 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:50.881113 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:50.882183 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:50.882183 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:50.882183 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:50.882183 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:50.882183 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:58:50.882183 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:58:50.882183 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:58:50.882183 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:58:50.882183 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:58:50.882183 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:58:50.882183 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:58:50.882183 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:50.884432 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 420/843] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Jul 4 03:58:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:50.889954 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002b9f3-16c4-4c10-8efa-90caa22450bf None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:50.945952 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b9184-f7c0-46f7-8b1e-d5a3c8b511ac None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:50.960205 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:50.991014 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5968c57f-bfc7-40ab-91d2-01b630caa248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:50.991688 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968c57f-bfc7-40ab-91d2-01b630caa248 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:50.991973 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968c57f-bfc7-40ab-91d2-01b630caa248 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:50.992252 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968c57f-bfc7-40ab-91d2-01b630caa248 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:50.993003 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5968c57f-bfc7-40ab-91d2-01b630caa248 None admin] RBAC: Adding query filter params (name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:50.993314 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5968c57f-bfc7-40ab-91d2-01b630caa248 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:50.994864 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5968c57f-bfc7-40ab-91d2-01b630caa248 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:51.003908 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 424/844] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Jul 4 03:58:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:58:51.009199 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5968c57f-bfc7-40ab-91d2-01b630caa248 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:51.023847 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002b9f3-16c4-4c10-8efa-90caa22450bf None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:51.065322 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13147f-a760-496a-8f90-128a3f20e5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:51.066317 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13147f-a760-496a-8f90-128a3f20e5f5 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:51.066903 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13147f-a760-496a-8f90-128a3f20e5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:51.067329 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13147f-a760-496a-8f90-128a3f20e5f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:51.068531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13147f-a760-496a-8f90-128a3f20e5f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:51.069016 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13147f-a760-496a-8f90-128a3f20e5f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:51.070602 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13147f-a760-496a-8f90-128a3f20e5f5 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:51.086357 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 421/845] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:58:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:58:51.087418 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13147f-a760-496a-8f90-128a3f20e5f5 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:51.136740 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5968c57f-bfc7-40ab-91d2-01b630caa248 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:51.145456 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:51.185851 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c8582-dc3b-4707-8d33-5a82bbfc2e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:51.186700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c8582-dc3b-4707-8d33-5a82bbfc2e4d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:51.187375 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c8582-dc3b-4707-8d33-5a82bbfc2e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:51.187674 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c8582-dc3b-4707-8d33-5a82bbfc2e4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:51.202749 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754c8582-dc3b-4707-8d33-5a82bbfc2e4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:51.203548 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13147f-a760-496a-8f90-128a3f20e5f5 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:51.204237 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754c8582-dc3b-4707-8d33-5a82bbfc2e4d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:51.227387 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-754c8582-dc3b-4707-8d33-5a82bbfc2e4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:51.227387 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:51.227387 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:51.227387 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:51.227387 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:51.227387 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:51.227387 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:51.227387 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:51.227387 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:51.227387 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:51.227387 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:51.227387 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:51.227387 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:51.227387 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:51.227387 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:51.228531 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:51.228531 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:51.228531 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:51.228531 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:51.228531 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:51.228531 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:51.228531 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:51.228531 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:51.228531 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:51.228531 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:51.228531 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:51.228531 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:51.228531 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:51.228531 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:51.228531 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:51.228531 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:51.228531 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:51.229459 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:51.229459 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:51.229459 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:51.229459 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:51.229459 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 425/846] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:58:51.234348 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c8582-dc3b-4707-8d33-5a82bbfc2e4d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:51.246664 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a5969a-0016-44a6-8b80-5e7c622420b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:51.247996 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5969a-0016-44a6-8b80-5e7c622420b9 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:51.248467 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5969a-0016-44a6-8b80-5e7c622420b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:51.248920 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5969a-0016-44a6-8b80-5e7c622420b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:51.260476 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a5969a-0016-44a6-8b80-5e7c622420b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:51.262567 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a5969a-0016-44a6-8b80-5e7c622420b9 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:51.270561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:51.281389 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-c2a5969a-0016-44a6-8b80-5e7c622420b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:51.281389 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:51.281389 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:51.281389 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:51.281389 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:51.281389 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:51.281389 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:51.281389 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:51.281389 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:51.281389 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:51.281389 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:51.281389 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:51.281389 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:51.281389 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:51.281389 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:51.282315 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:51.282315 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:51.282315 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:51.282315 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:51.282315 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:51.282315 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:51.282315 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:51.282315 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:51.282315 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:51.282315 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:51.282315 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:51.282315 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:51.282315 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:51.282315 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:51.282315 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:51.282315 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:51.282315 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:51.283242 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:51.283242 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:51.283242 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:51.283242 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:51.289735 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 422/847] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:51.291050 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a5969a-0016-44a6-8b80-5e7c622420b9 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:51.357218 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c8582-dc3b-4707-8d33-5a82bbfc2e4d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:51.393099 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b64983-df2a-4c33-89d5-af828f2a8038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:51.393841 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b64983-df2a-4c33-89d5-af828f2a8038 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:51.394052 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b64983-df2a-4c33-89d5-af828f2a8038 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:51.394402 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b64983-df2a-4c33-89d5-af828f2a8038 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:51.395098 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b64983-df2a-4c33-89d5-af828f2a8038 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:51.395411 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b64983-df2a-4c33-89d5-af828f2a8038 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:51.397025 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b64983-df2a-4c33-89d5-af828f2a8038 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:51.399949 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a5969a-0016-44a6-8b80-5e7c622420b9 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:51.402550 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:51.410461 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 426/848] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:58:51.415801 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b64983-df2a-4c33-89d5-af828f2a8038 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:51.446684 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29c130-5742-4772-80c0-e6f9089df61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:51.447972 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29c130-5742-4772-80c0-e6f9089df61c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:51.448766 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29c130-5742-4772-80c0-e6f9089df61c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:51.449520 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29c130-5742-4772-80c0-e6f9089df61c None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:51.450714 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29c130-5742-4772-80c0-e6f9089df61c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:51.451530 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29c130-5742-4772-80c0-e6f9089df61c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:51.453581 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29c130-5742-4772-80c0-e6f9089df61c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:51.522444 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:51.538123 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b64983-df2a-4c33-89d5-af828f2a8038 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:51.576111 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01894e64-3998-4139-bece-635bfa714ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:51.577206 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01894e64-3998-4139-bece-635bfa714ef9 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:51.577642 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01894e64-3998-4139-bece-635bfa714ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:51.578071 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01894e64-3998-4139-bece-635bfa714ef9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:51.586773 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01894e64-3998-4139-bece-635bfa714ef9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:51.588541 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01894e64-3998-4139-bece-635bfa714ef9 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:51.605019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-01894e64-3998-4139-bece-635bfa714ef9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 03:58:51.605019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:51.605019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:51.605019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:51.605019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:51.605019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:51.605019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:51.605019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:51.605019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:51.605019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:51.605019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:51.605019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:51.605019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 03:58:51.605019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 03:58:51.605019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 03:58:51.605019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 03:58:51.606183 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:51.606183 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:51.606183 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 03:58:51.606183 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:51.606183 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 03:58:51.606183 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:51.606183 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:51.606183 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:51.606183 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:51.606183 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:51.606183 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:51.606183 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:51.606183 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:51.606183 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:51.606183 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:51.606183 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:51.606183 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:51.606183 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:51.607141 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:51.607141 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:51.607141 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 03:58:51.607141 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 03:58:51.607141 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 03:58:51.607141 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 03:58:51.607141 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 03:58:51.607141 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 03:58:51.607141 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 03:58:51.607141 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:51.614758 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 427/849] 10.222.0.49 () {56 vars in 1117 bytes} [Mon Jul 4 03:58:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:51.616655 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01894e64-3998-4139-bece-635bfa714ef9 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:51.622296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 423/850] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:58:51.624345 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29c130-5742-4772-80c0-e6f9089df61c None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:51.754085 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01894e64-3998-4139-bece-635bfa714ef9 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:51.768959 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29c130-5742-4772-80c0-e6f9089df61c None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:51.793242 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef841b-eb32-4109-ae9c-afce092b7107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:51.794111 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef841b-eb32-4109-ae9c-afce092b7107 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:51.794429 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef841b-eb32-4109-ae9c-afce092b7107 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:51.794709 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef841b-eb32-4109-ae9c-afce092b7107 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:51.796214 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eef841b-eb32-4109-ae9c-afce092b7107 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:51.796539 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eef841b-eb32-4109-ae9c-afce092b7107 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:51.798547 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eef841b-eb32-4109-ae9c-afce092b7107 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:51.806881 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654bdb08-a8c3-4b2f-b75c-37eecf03e944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:51.807702 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bdb08-a8c3-4b2f-b75c-37eecf03e944 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:51.807985 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bdb08-a8c3-4b2f-b75c-37eecf03e944 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:51.808265 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bdb08-a8c3-4b2f-b75c-37eecf03e944 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:51.815880 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654bdb08-a8c3-4b2f-b75c-37eecf03e944 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:51.817440 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654bdb08-a8c3-4b2f-b75c-37eecf03e944 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:51.821209 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 428/851] 10.222.0.49 () {56 vars in 1149 bytes} [Mon Jul 4 03:58:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:58:51.822820 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72b08c-5ed0-4ede-94cb-11444b1d97d3 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:51.823269 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72b08c-5ed0-4ede-94cb-11444b1d97d3 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:51.823676 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72b08c-5ed0-4ede-94cb-11444b1d97d3 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:51.825823 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 429/852] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:51.826759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de72b08c-5ed0-4ede-94cb-11444b1d97d3 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:51.834571 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-654bdb08-a8c3-4b2f-b75c-37eecf03e944 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 04 03:58:51.834571 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:51.834571 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:51.834571 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:51.834571 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:51.834571 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:51.834571 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:51.834571 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:51.834571 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:51.834571 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:51.834571 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:51.834571 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:51.834571 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 03:58:51.834571 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 03:58:51.834571 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 03:58:51.834571 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 03:58:51.835655 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:51.835655 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:51.835655 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 03:58:51.835655 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:51.835655 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 03:58:51.835655 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:51.835655 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:51.835655 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:51.835655 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:51.835655 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:51.835655 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:51.835655 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:51.835655 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:51.835655 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:51.835655 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:51.835655 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:51.835655 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:51.835655 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:51.836794 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:51.836794 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:51.836794 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 03:58:51.836794 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 03:58:51.836794 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 03:58:51.836794 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 03:58:51.836794 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 03:58:51.836794 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 03:58:51.836794 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 04 03:58:51.836794 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:51.840240 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 424/853] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Jul 4 03:58:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:51.841578 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:51.841976 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884406f-72f3-4d59-adb6-6a1929109e9b None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:51.842305 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884406f-72f3-4d59-adb6-6a1929109e9b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:51.842592 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884406f-72f3-4d59-adb6-6a1929109e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:51.859895 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-5884406f-72f3-4d59-adb6-6a1929109e9b None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:51.861094 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5884406f-72f3-4d59-adb6-6a1929109e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:51.879362 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:51.932598 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 425/854] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:51 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 03:58:51.933748 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884406f-72f3-4d59-adb6-6a1929109e9b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:51.965979 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de72b08c-5ed0-4ede-94cb-11444b1d97d3 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:52.002710 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097dc1b1-93b0-491e-9861-9c8d6c6f4fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:52.003367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dc1b1-93b0-491e-9861-9c8d6c6f4fdc None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:52.003656 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dc1b1-93b0-491e-9861-9c8d6c6f4fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:52.003933 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dc1b1-93b0-491e-9861-9c8d6c6f4fdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:52.052720 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884406f-72f3-4d59-adb6-6a1929109e9b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:52.082389 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097dc1b1-93b0-491e-9861-9c8d6c6f4fdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:52.083860 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097dc1b1-93b0-491e-9861-9c8d6c6f4fdc None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:52.091120 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e713a13-e173-4b28-a647-2388ba8c56cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:52.091927 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:52.092224 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e713a13-e173-4b28-a647-2388ba8c56cb None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:52.092875 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e713a13-e173-4b28-a647-2388ba8c56cb None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:52.093182 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e713a13-e173-4b28-a647-2388ba8c56cb None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:52.094108 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e713a13-e173-4b28-a647-2388ba8c56cb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:52.094480 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e713a13-e173-4b28-a647-2388ba8c56cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:52.095969 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e713a13-e173-4b28-a647-2388ba8c56cb None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:52.114358 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 426/855] 10.222.0.49 () {56 vars in 1135 bytes} [Mon Jul 4 03:58:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:52.115294 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e713a13-e173-4b28-a647-2388ba8c56cb None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:52.136741 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:52.193621 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 430/856] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:58:51 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 03:58:52.195249 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7cae0-f6f0-4fb3-ad33-c85c46f1c676 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:52.195556 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7cae0-f6f0-4fb3-ad33-c85c46f1c676 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:52.195832 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7cae0-f6f0-4fb3-ad33-c85c46f1c676 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:52.197269 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 431/857] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:52.197874 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7cae0-f6f0-4fb3-ad33-c85c46f1c676 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:52.230697 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e713a13-e173-4b28-a647-2388ba8c56cb None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:52.265599 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97450a29-14df-4c6a-8875-95c396624490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:52.266454 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97450a29-14df-4c6a-8875-95c396624490 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:52.266737 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97450a29-14df-4c6a-8875-95c396624490 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:52.267019 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97450a29-14df-4c6a-8875-95c396624490 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:52.267670 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97450a29-14df-4c6a-8875-95c396624490 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:52.269066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97450a29-14df-4c6a-8875-95c396624490 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:52.281176 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-97450a29-14df-4c6a-8875-95c396624490 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 03:58:52.281176 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:52.281176 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 03:58:52.281176 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 03:58:52.281176 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 03:58:52.281176 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 03:58:52.281176 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 03:58:52.281176 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:58:52.281176 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 03:58:52.281176 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:52.281176 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 03:58:52.281176 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:52.281176 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:52.281176 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:52.281176 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:52.281176 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:52.282133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:52.282133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:52.282133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:52.282133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:52.282133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:52.282133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:52.282133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:52.282133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 03:58:52.282133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 03:58:52.282133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 03:58:52.282133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 03:58:52.282133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:52.282133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:52.282133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:52.282133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:52.282133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:52.283024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:52.283024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:52.283024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:52.283024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:52.283024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:52.283024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:52.283024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:52.283024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:52.283024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:52.283024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:52.283024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:52.283024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 03:58:52.283024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:58:52.283024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 03:58:52.283024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:52.283024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 427/858] 10.222.0.49 () {56 vars in 1132 bytes} [Mon Jul 4 03:58:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:52.283880 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97450a29-14df-4c6a-8875-95c396624490 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:52.302639 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7cae0-f6f0-4fb3-ad33-c85c46f1c676 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:52.310251 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:52.336504 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87dbefa-1d30-4e39-ab2c-212cb6f7fa69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:52.337167 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87dbefa-1d30-4e39-ab2c-212cb6f7fa69 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:52.337452 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87dbefa-1d30-4e39-ab2c-212cb6f7fa69 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:52.337735 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87dbefa-1d30-4e39-ab2c-212cb6f7fa69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:52.358088 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:52.380025 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97450a29-14df-4c6a-8875-95c396624490 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:52.402898 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87dbefa-1d30-4e39-ab2c-212cb6f7fa69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:52.404371 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87dbefa-1d30-4e39-ab2c-212cb6f7fa69 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:52.413188 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13362e-a0d1-4bcc-a440-c3ed782ab59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:52.413991 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13362e-a0d1-4bcc-a440-c3ed782ab59f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:52.414306 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13362e-a0d1-4bcc-a440-c3ed782ab59f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:52.414585 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13362e-a0d1-4bcc-a440-c3ed782ab59f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:52.424913 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13362e-a0d1-4bcc-a440-c3ed782ab59f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:52.426394 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13362e-a0d1-4bcc-a440-c3ed782ab59f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:52.442987 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-eb13362e-a0d1-4bcc-a440-c3ed782ab59f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:52.442987 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:52.442987 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:52.442987 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:52.442987 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:52.442987 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:52.442987 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:52.442987 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:52.442987 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:52.442987 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:52.442987 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:52.442987 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:52.442987 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:52.442987 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:52.442987 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:52.444008 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:52.444008 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:52.444008 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:52.444008 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:52.444008 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:52.444008 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:52.444008 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:52.444008 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:52.444008 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:52.444008 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:52.444008 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:52.444008 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:52.444008 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:52.444008 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:52.444008 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:52.444008 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:52.444008 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:52.445467 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:52.445467 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:52.445467 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:52.445467 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:52.445467 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 428/859] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:52.445823 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520966d-bf9c-47f7-a7a4-7a565bf362f4 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:52.446020 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520966d-bf9c-47f7-a7a4-7a565bf362f4 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:52.446353 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520966d-bf9c-47f7-a7a4-7a565bf362f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:52.462738 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-5520966d-bf9c-47f7-a7a4-7a565bf362f4 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:52.463928 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5520966d-bf9c-47f7-a7a4-7a565bf362f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:52.506878 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 432/860] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:58:52 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 03:58:52.507660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87dbefa-1d30-4e39-ab2c-212cb6f7fa69 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:52.516097 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:52.536494 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 429/861] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 03:58:52.537320 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520966d-bf9c-47f7-a7a4-7a565bf362f4 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:52.597768 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:52.606227 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87dbefa-1d30-4e39-ab2c-212cb6f7fa69 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:52.638480 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520966d-bf9c-47f7-a7a4-7a565bf362f4 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:52.639936 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6444d5-dc1a-459a-9c72-4a72dde2e41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:52.640605 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6444d5-dc1a-459a-9c72-4a72dde2e41b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:52.640891 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6444d5-dc1a-459a-9c72-4a72dde2e41b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:52.641170 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6444d5-dc1a-459a-9c72-4a72dde2e41b None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:52.641882 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6444d5-dc1a-459a-9c72-4a72dde2e41b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:52.642219 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6444d5-dc1a-459a-9c72-4a72dde2e41b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:52.643594 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6444d5-dc1a-459a-9c72-4a72dde2e41b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:52.648399 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 433/862] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Jul 4 03:58:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:52.648997 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6444d5-dc1a-459a-9c72-4a72dde2e41b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:52.671736 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a19bfc-90ac-4815-b5ab-71a4ba15e88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:52.672403 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a19bfc-90ac-4815-b5ab-71a4ba15e88c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:52.672687 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a19bfc-90ac-4815-b5ab-71a4ba15e88c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:52.672960 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a19bfc-90ac-4815-b5ab-71a4ba15e88c None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:52.673685 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a19bfc-90ac-4815-b5ab-71a4ba15e88c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:52.673989 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a19bfc-90ac-4815-b5ab-71a4ba15e88c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:52.675411 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a19bfc-90ac-4815-b5ab-71a4ba15e88c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:52.686356 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 430/863] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:52.687110 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a19bfc-90ac-4815-b5ab-71a4ba15e88c None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:52.716079 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:52.747761 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6444d5-dc1a-459a-9c72-4a72dde2e41b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:52.781341 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1ac34-6217-44e8-a1f9-fe987b7ee34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:52.782194 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1ac34-6217-44e8-a1f9-fe987b7ee34e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:52.782495 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1ac34-6217-44e8-a1f9-fe987b7ee34e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:52.782779 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1ac34-6217-44e8-a1f9-fe987b7ee34e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:52.785770 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a19bfc-90ac-4815-b5ab-71a4ba15e88c None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:52.794696 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae1ac34-6217-44e8-a1f9-fe987b7ee34e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:52.796152 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae1ac34-6217-44e8-a1f9-fe987b7ee34e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:52.802223 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:52.813533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-9ae1ac34-6217-44e8-a1f9-fe987b7ee34e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:52.813533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:52.813533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:52.813533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:52.813533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:52.813533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:52.813533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:52.813533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:52.813533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:52.813533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:52.813533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:52.813533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:52.813533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:52.813533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:52.813533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:52.814660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:52.814660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:52.814660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:52.814660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:52.814660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:52.814660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:52.814660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:52.814660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:52.814660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:52.814660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:52.814660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:52.814660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:52.814660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:52.814660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:52.814660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:52.814660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:52.814660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:52.815629 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:52.815629 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:52.815629 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:52.815629 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:52.815629 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 434/864] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:52.815629 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1ac34-6217-44e8-a1f9-fe987b7ee34e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:52.822324 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4efde-ca39-481a-a694-6a4bbb3f4d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:52.823001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4efde-ca39-481a-a694-6a4bbb3f4d93 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:52.823286 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4efde-ca39-481a-a694-6a4bbb3f4d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:52.823563 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4efde-ca39-481a-a694-6a4bbb3f4d93 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:52.824291 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4efde-ca39-481a-a694-6a4bbb3f4d93 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:52.825688 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4efde-ca39-481a-a694-6a4bbb3f4d93 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:52.840457 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 431/865] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Jul 4 03:58:52 2022] POST /identity/v3/services => generated 251 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 03:58:52.841408 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4efde-ca39-481a-a694-6a4bbb3f4d93 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:52.935467 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1ac34-6217-44e8-a1f9-fe987b7ee34e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:52.961470 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:52.962520 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4efde-ca39-481a-a694-6a4bbb3f4d93 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:52.983138 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d863288-f8b0-4422-988a-bfa56d73febe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:52.984153 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d863288-f8b0-4422-988a-bfa56d73febe None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:52.984444 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d863288-f8b0-4422-988a-bfa56d73febe None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:52.984723 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d863288-f8b0-4422-988a-bfa56d73febe None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:52.985450 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d863288-f8b0-4422-988a-bfa56d73febe None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:52.985757 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d863288-f8b0-4422-988a-bfa56d73febe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:52.987691 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d863288-f8b0-4422-988a-bfa56d73febe None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:52.993119 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 435/866] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Jul 4 03:58:52 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:52.999722 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d863288-f8b0-4422-988a-bfa56d73febe None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:53.002326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720f6b4-1930-4c17-b842-4558d1b8b1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:53.003219 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720f6b4-1930-4c17-b842-4558d1b8b1bc None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:53.003564 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720f6b4-1930-4c17-b842-4558d1b8b1bc None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:53.003998 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720f6b4-1930-4c17-b842-4558d1b8b1bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:53.014011 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720f6b4-1930-4c17-b842-4558d1b8b1bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:53.016432 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720f6b4-1930-4c17-b842-4558d1b8b1bc None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:53.037245 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-2720f6b4-1930-4c17-b842-4558d1b8b1bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:53.037245 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:53.037245 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:53.037245 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:53.037245 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:53.037245 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:53.037245 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:53.037245 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:53.037245 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:53.037245 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:53.037245 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:53.037245 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:53.037245 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 03:58:53.037245 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 03:58:53.037245 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 03:58:53.038417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 03:58:53.038417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:53.038417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:53.038417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:53.038417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:53.038417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:53.038417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:53.038417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:53.038417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:53.038417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:53.038417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:53.038417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:53.038417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:53.038417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:53.038417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:53.038417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:53.038417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:53.039356 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 03:58:53.039356 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 03:58:53.039356 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 03:58:53.039356 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 03:58:53.039356 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 03:58:53.039356 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 03:58:53.039356 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:53.039356 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:53.039356 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 432/867] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:58:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:53.045993 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720f6b4-1930-4c17-b842-4558d1b8b1bc None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:53.095022 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:53.127750 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d863288-f8b0-4422-988a-bfa56d73febe None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:53.180073 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9eac57-35c8-4f82-aa54-257baba3481e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:53.180768 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9eac57-35c8-4f82-aa54-257baba3481e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:53.181055 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9eac57-35c8-4f82-aa54-257baba3481e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:53.181339 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9eac57-35c8-4f82-aa54-257baba3481e None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:53.182079 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9eac57-35c8-4f82-aa54-257baba3481e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:53.182474 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720f6b4-1930-4c17-b842-4558d1b8b1bc None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:53.184152 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9eac57-35c8-4f82-aa54-257baba3481e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:53.186233 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9eac57-35c8-4f82-aa54-257baba3481e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:53.199498 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 436/868] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:53.205022 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9eac57-35c8-4f82-aa54-257baba3481e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:53.228476 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884ea67-f591-45fa-8319-34858cb46f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:53.229936 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884ea67-f591-45fa-8319-34858cb46f33 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:53.230764 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884ea67-f591-45fa-8319-34858cb46f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:53.231229 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884ea67-f591-45fa-8319-34858cb46f33 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:53.232451 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884ea67-f591-45fa-8319-34858cb46f33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:53.233359 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884ea67-f591-45fa-8319-34858cb46f33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:53.235540 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4884ea67-f591-45fa-8319-34858cb46f33 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:53.252528 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 433/869] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Jul 4 03:58:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:53.257816 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884ea67-f591-45fa-8319-34858cb46f33 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:53.262846 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:53.323550 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9eac57-35c8-4f82-aa54-257baba3481e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:53.360344 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:53.361871 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd030b1c-e404-4d10-a832-e2099a0b65b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:53.362929 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd030b1c-e404-4d10-a832-e2099a0b65b2 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:53.363443 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd030b1c-e404-4d10-a832-e2099a0b65b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:53.363918 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd030b1c-e404-4d10-a832-e2099a0b65b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:53.367821 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884ea67-f591-45fa-8319-34858cb46f33 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:53.373154 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd030b1c-e404-4d10-a832-e2099a0b65b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:53.374931 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd030b1c-e404-4d10-a832-e2099a0b65b2 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:53.390804 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-bd030b1c-e404-4d10-a832-e2099a0b65b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:53.390804 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:53.390804 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:53.390804 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:53.390804 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:53.390804 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:53.390804 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:53.390804 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:53.390804 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:53.390804 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:53.390804 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:53.390804 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:53.390804 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 03:58:53.390804 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 03:58:53.390804 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 03:58:53.391751 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 03:58:53.391751 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:53.391751 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:53.391751 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:53.391751 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:53.391751 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:53.391751 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:53.391751 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:53.391751 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:53.391751 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:53.391751 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:53.391751 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:53.391751 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:53.391751 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:53.391751 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:53.391751 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:53.391751 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:53.392679 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 03:58:53.392679 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 03:58:53.392679 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 03:58:53.392679 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 03:58:53.392679 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 03:58:53.392679 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 03:58:53.392679 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:53.392679 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:53.395448 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 437/870] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:58:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:58:53.402213 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd030b1c-e404-4d10-a832-e2099a0b65b2 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:53.409746 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56cb679-dcea-4203-9520-402779dd3195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:53.414890 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cb679-dcea-4203-9520-402779dd3195 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:53.415406 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cb679-dcea-4203-9520-402779dd3195 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:53.415821 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cb679-dcea-4203-9520-402779dd3195 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:53.416803 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56cb679-dcea-4203-9520-402779dd3195 None admin] RBAC: Adding query filter params (role.id=7fd75ec0129248b28b5254e00d4f6f0b, scope.project.id=424a145a22434ef7a14b6108e6118ccb, user.id=03e7f908f0a7499792e59e31d497edb7) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:53.417287 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56cb679-dcea-4203-9520-402779dd3195 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:53.419023 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56cb679-dcea-4203-9520-402779dd3195 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:53.426200 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 434/871] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:58:53 2022] GET /identity/v3/role_assignments?user.id=03e7f908f0a7499792e59e31d497edb7&scope.project.id=424a145a22434ef7a14b6108e6118ccb&role.id=7fd75ec0129248b28b5254e00d4f6f0b => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:58:53.525703 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd030b1c-e404-4d10-a832-e2099a0b65b2 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:53.533620 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:53.564633 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bae35-0cee-401f-8505-5760e68b12a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:53.565322 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bae35-0cee-401f-8505-5760e68b12a5 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:53.565612 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bae35-0cee-401f-8505-5760e68b12a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:53.565897 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bae35-0cee-401f-8505-5760e68b12a5 None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:53.566735 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3bae35-0cee-401f-8505-5760e68b12a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:53.567055 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3bae35-0cee-401f-8505-5760e68b12a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:53.568539 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3bae35-0cee-401f-8505-5760e68b12a5 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:53.581778 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 438/872] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Jul 4 03:58:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:58:53.587933 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56cb679-dcea-4203-9520-402779dd3195 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:53.691748 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56cb679-dcea-4203-9520-402779dd3195 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:53.727532 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2ac2c-a782-45ab-93f2-75317dda6599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:53.728201 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2ac2c-a782-45ab-93f2-75317dda6599 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:53.728489 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2ac2c-a782-45ab-93f2-75317dda6599 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:53.728768 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2ac2c-a782-45ab-93f2-75317dda6599 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:53.729606 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb2ac2c-a782-45ab-93f2-75317dda6599 None admin] RBAC: Adding query filter params (role.id=2eee98054d42475bb7e22a8487ab235e, scope.project.id=424a145a22434ef7a14b6108e6118ccb, user.id=24f93fdc98ff425791da3e2194b3a671) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:53.729924 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb2ac2c-a782-45ab-93f2-75317dda6599 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:53.731424 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb2ac2c-a782-45ab-93f2-75317dda6599 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:53.737575 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 435/873] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:58:53 2022] GET /identity/v3/role_assignments?user.id=24f93fdc98ff425791da3e2194b3a671&scope.project.id=424a145a22434ef7a14b6108e6118ccb&role.id=2eee98054d42475bb7e22a8487ab235e => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:54.925581 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be736f-e4f3-4a11-8872-1f65cddd2ce7 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:54.926248 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be736f-e4f3-4a11-8872-1f65cddd2ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:54.926248 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be736f-e4f3-4a11-8872-1f65cddd2ce7 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:54.927763 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 439/874] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:54.933153 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd33c6-ab6d-40f9-bfea-57ba2f5e851d None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:54.933554 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd33c6-ab6d-40f9-bfea-57ba2f5e851d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:54.933735 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd33c6-ab6d-40f9-bfea-57ba2f5e851d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:54.951170 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-f8cd33c6-ab6d-40f9-bfea-57ba2f5e851d None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:54.952393 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f8cd33c6-ab6d-40f9-bfea-57ba2f5e851d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:54.970877 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:55.029229 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 436/875] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:54 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 03:58:55.052196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be736f-e4f3-4a11-8872-1f65cddd2ce7 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:55.105302 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9846e8a-ecf6-4c7e-be0a-b8375a886070 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:55.105756 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9846e8a-ecf6-4c7e-be0a-b8375a886070 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:55.106164 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9846e8a-ecf6-4c7e-be0a-b8375a886070 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:55.107831 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 437/876] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 03:58:55.113015 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac0aa1-cb10-4128-ad12-34c61e0ee353 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:55.113340 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac0aa1-cb10-4128-ad12-34c61e0ee353 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:55.113625 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac0aa1-cb10-4128-ad12-34c61e0ee353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:55.135117 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-85ac0aa1-cb10-4128-ad12-34c61e0ee353 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:55.136668 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-85ac0aa1-cb10-4128-ad12-34c61e0ee353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:55.157209 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be736f-e4f3-4a11-8872-1f65cddd2ce7 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:55.192176 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3158c4-ee3d-4a46-a93a-275faf17a5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:55.192899 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3158c4-ee3d-4a46-a93a-275faf17a5da None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:55.193187 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3158c4-ee3d-4a46-a93a-275faf17a5da None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:55.193466 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3158c4-ee3d-4a46-a93a-275faf17a5da None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:55.194255 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3158c4-ee3d-4a46-a93a-275faf17a5da None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:55.195646 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3158c4-ee3d-4a46-a93a-275faf17a5da None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:55.209562 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-af3158c4-ee3d-4a46-a93a-275faf17a5da None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 03:58:55.209562 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:55.209562 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 03:58:55.209562 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 03:58:55.209562 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 03:58:55.209562 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 03:58:55.209562 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 03:58:55.209562 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:58:55.209562 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 03:58:55.209562 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:55.209562 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 03:58:55.209562 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:55.209562 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:55.209562 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:55.209562 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:55.209562 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:55.209562 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:55.210609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:55.210609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:55.210609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:55.210609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:55.210609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:55.210609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:55.210609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 03:58:55.210609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 03:58:55.210609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 03:58:55.210609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 03:58:55.210609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:55.210609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:55.210609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:55.210609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:55.210609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:55.210609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:55.211437 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:55.211437 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:55.211437 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:55.211437 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:55.211437 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:55.211437 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:55.211437 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:55.211437 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:55.211437 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:55.211437 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:55.211437 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 03:58:55.211437 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:58:55.211437 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 03:58:55.211437 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:55.211437 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 440/878] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Jul 4 03:58:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:55.218364 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 438/878] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:55 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 03:58:55.219395 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3158c4-ee3d-4a46-a93a-275faf17a5da None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:55.233304 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac0aa1-cb10-4128-ad12-34c61e0ee353 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:55.262571 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:55.318120 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:55.329759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3158c4-ee3d-4a46-a93a-275faf17a5da None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:55.344860 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac0aa1-cb10-4128-ad12-34c61e0ee353 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:55.372083 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbcfea6-42d7-444e-a612-67ef8f3e38f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:55.372920 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbcfea6-42d7-444e-a612-67ef8f3e38f1 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:55.373575 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbcfea6-42d7-444e-a612-67ef8f3e38f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:55.373954 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbcfea6-42d7-444e-a612-67ef8f3e38f1 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:55.375270 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbcfea6-42d7-444e-a612-67ef8f3e38f1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:55.375931 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbcfea6-42d7-444e-a612-67ef8f3e38f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:55.378038 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbcfea6-42d7-444e-a612-67ef8f3e38f1 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:55.383129 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201aa19f-8e5f-4ac3-b21f-56cc7c507191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:55.388264 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 441/879] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Jul 4 03:58:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:55.388410 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201aa19f-8e5f-4ac3-b21f-56cc7c507191 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:55.388410 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201aa19f-8e5f-4ac3-b21f-56cc7c507191 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:55.388410 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201aa19f-8e5f-4ac3-b21f-56cc7c507191 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:55.388410 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201aa19f-8e5f-4ac3-b21f-56cc7c507191 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:55.389424 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201aa19f-8e5f-4ac3-b21f-56cc7c507191 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:55.391180 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbcfea6-42d7-444e-a612-67ef8f3e38f1 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:55.413029 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 439/880] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Jul 4 03:58:55 2022] POST /identity/v3/services => generated 269 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 03:58:55.514417 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:55.522329 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbcfea6-42d7-444e-a612-67ef8f3e38f1 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:55.568034 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ab421-3a2d-4f42-9d30-b124a8ea0a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:55.568813 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ab421-3a2d-4f42-9d30-b124a8ea0a1d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:55.569109 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ab421-3a2d-4f42-9d30-b124a8ea0a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:55.569392 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ab421-3a2d-4f42-9d30-b124a8ea0a1d None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:55.570181 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ab421-3a2d-4f42-9d30-b124a8ea0a1d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:55.570511 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ab421-3a2d-4f42-9d30-b124a8ea0a1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:55.571902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ab421-3a2d-4f42-9d30-b124a8ea0a1d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:55.577453 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 442/881] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Jul 4 03:58:55 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:55.583002 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201aa19f-8e5f-4ac3-b21f-56cc7c507191 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:55.645252 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfbffb-3f81-41f1-a655-6a989348cc5f None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:55.645599 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfbffb-3f81-41f1-a655-6a989348cc5f None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:55.645827 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfbffb-3f81-41f1-a655-6a989348cc5f None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:55.647621 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 443/882] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 03:58:55.652631 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d367d8-5fba-4dd0-a4d5-385f8fdd67dc None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:55.652925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d367d8-5fba-4dd0-a4d5-385f8fdd67dc None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:55.653213 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d367d8-5fba-4dd0-a4d5-385f8fdd67dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:55.671231 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-a6d367d8-5fba-4dd0-a4d5-385f8fdd67dc None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:55.672432 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a6d367d8-5fba-4dd0-a4d5-385f8fdd67dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:55.702596 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201aa19f-8e5f-4ac3-b21f-56cc7c507191 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:55.746283 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca340ad-18f0-4e0b-9999-a3beb35ce461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:55.747370 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca340ad-18f0-4e0b-9999-a3beb35ce461 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:55.747860 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca340ad-18f0-4e0b-9999-a3beb35ce461 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:55.748347 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca340ad-18f0-4e0b-9999-a3beb35ce461 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:55.749348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca340ad-18f0-4e0b-9999-a3beb35ce461 None admin] RBAC: Adding query filter params (interface=public, service_id=4a69f789da9d474193875e2077546370, region_id=RegionOne) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:55.749875 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca340ad-18f0-4e0b-9999-a3beb35ce461 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:55.750299 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 444/883] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 03:58:55.751783 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca340ad-18f0-4e0b-9999-a3beb35ce461 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:55.757821 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 440/884] 10.222.0.49 () {56 vars in 1251 bytes} [Mon Jul 4 03:58:55 2022] GET /identity/v3/endpoints?service_id=4a69f789da9d474193875e2077546370&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:58:55.763850 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d367d8-5fba-4dd0-a4d5-385f8fdd67dc None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:55.769224 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca340ad-18f0-4e0b-9999-a3beb35ce461 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:55.781382 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:55.853918 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:55.871818 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d367d8-5fba-4dd0-a4d5-385f8fdd67dc None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:55.879686 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca340ad-18f0-4e0b-9999-a3beb35ce461 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:55.908409 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67baff-a891-4de1-bed9-9b18db7fae81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:55.909429 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67baff-a891-4de1-bed9-9b18db7fae81 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:55.909788 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67baff-a891-4de1-bed9-9b18db7fae81 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:55.910106 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67baff-a891-4de1-bed9-9b18db7fae81 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:55.910817 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67baff-a891-4de1-bed9-9b18db7fae81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:55.912751 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67baff-a891-4de1-bed9-9b18db7fae81 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:55.913916 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4449a7a-f3fd-4ec3-a0de-1b50a1237791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:55.914762 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4449a7a-f3fd-4ec3-a0de-1b50a1237791 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:55.915053 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4449a7a-f3fd-4ec3-a0de-1b50a1237791 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:55.915329 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4449a7a-f3fd-4ec3-a0de-1b50a1237791 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:55.922489 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 445/885] 10.222.0.49 () {56 vars in 1087 bytes} [Mon Jul 4 03:58:55 2022] GET /identity/v3/services => generated 1268 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 03:58:55.924070 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5185e-8de9-44e6-91b1-0bd88baceff2 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:55.924370 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5185e-8de9-44e6-91b1-0bd88baceff2 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:55.924658 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5185e-8de9-44e6-91b1-0bd88baceff2 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:55.930386 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 446/886] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:55.932021 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae984da-9d45-40d0-8d88-e36074b96143 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:55.932270 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae984da-9d45-40d0-8d88-e36074b96143 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:55.932574 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae984da-9d45-40d0-8d88-e36074b96143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:55.939233 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4449a7a-f3fd-4ec3-a0de-1b50a1237791 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:58:55.947805 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-f4449a7a-f3fd-4ec3-a0de-1b50a1237791 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 03:58:55.947805 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:55.947805 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:55.947805 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:55.947805 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:55.947805 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:55.947805 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:55.947805 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:55.947805 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:55.947805 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:55.947805 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:55.947805 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:55.947805 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:58:55.947805 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:58:55.947805 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:58:55.947805 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:58:55.948844 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:58:55.948844 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:58:55.948844 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:58:55.948844 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:58:55.948844 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:55.948844 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:55.948844 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:55.948844 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:55.948844 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:55.948844 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:55.948844 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:55.948844 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:55.948844 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:55.948844 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:55.948844 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:55.948844 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:55.949686 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:55.949686 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:55.949686 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:55.949686 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:55.949686 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:58:55.949686 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:58:55.949686 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:58:55.949686 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:58:55.949686 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:58:55.949686 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:58:55.949686 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 03:58:55.949686 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:55.954180 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 441/887] 10.222.0.49 () {56 vars in 1120 bytes} [Mon Jul 4 03:58:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:58:55.955582 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4449a7a-f3fd-4ec3-a0de-1b50a1237791 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:55.966701 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-aae984da-9d45-40d0-8d88-e36074b96143 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:55.966701 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-aae984da-9d45-40d0-8d88-e36074b96143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:56.048290 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 447/888] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 03:58:56.052086 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:56.071105 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae984da-9d45-40d0-8d88-e36074b96143 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:56.096487 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4449a7a-f3fd-4ec3-a0de-1b50a1237791 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:56.134752 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7315a48-705d-4997-99e7-b31a7ff90fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:56.135473 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7315a48-705d-4997-99e7-b31a7ff90fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:56.136121 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7315a48-705d-4997-99e7-b31a7ff90fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:56.136528 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7315a48-705d-4997-99e7-b31a7ff90fc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:56.137286 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7315a48-705d-4997-99e7-b31a7ff90fc2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:56.137678 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7315a48-705d-4997-99e7-b31a7ff90fc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:56.139450 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7315a48-705d-4997-99e7-b31a7ff90fc2 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:56.153247 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 442/889] 10.222.0.49 () {56 vars in 1115 bytes} [Mon Jul 4 03:58:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:58:56.155835 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7315a48-705d-4997-99e7-b31a7ff90fc2 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:56.163958 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:56.191534 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae984da-9d45-40d0-8d88-e36074b96143 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:56.229518 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe5a17-0f11-42ed-baf0-8db647f71dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:56.230826 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe5a17-0f11-42ed-baf0-8db647f71dff None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:56.231344 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe5a17-0f11-42ed-baf0-8db647f71dff None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:56.231837 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe5a17-0f11-42ed-baf0-8db647f71dff None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:56.232695 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe5a17-0f11-42ed-baf0-8db647f71dff None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:56.234340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe5a17-0f11-42ed-baf0-8db647f71dff None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:56.247834 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-20fe5a17-0f11-42ed-baf0-8db647f71dff None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 03:58:56.247834 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:56.247834 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 03:58:56.247834 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 03:58:56.247834 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 03:58:56.247834 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 03:58:56.247834 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 03:58:56.247834 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:58:56.247834 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 03:58:56.247834 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:56.247834 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 03:58:56.247834 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:56.247834 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:56.247834 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:56.247834 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:56.247834 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:56.247834 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:56.248844 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:56.248844 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:56.248844 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:56.248844 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:56.248844 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:56.248844 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:56.248844 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 03:58:56.248844 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 03:58:56.248844 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 03:58:56.248844 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 03:58:56.248844 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:56.248844 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:56.248844 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:56.248844 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:56.248844 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:56.248844 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:56.249715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:56.249715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:56.249715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:56.249715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:56.249715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:56.249715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:56.249715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:56.249715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:56.249715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:56.249715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:56.249715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 03:58:56.249715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:58:56.249715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 03:58:56.249715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:56.252934 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 448/890] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Jul 4 03:58:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:56.259121 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe5a17-0f11-42ed-baf0-8db647f71dff None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:56.270031 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7315a48-705d-4997-99e7-b31a7ff90fc2 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:56.298221 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:56.307375 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b86874-0675-43d3-811d-1f62c7adcd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:56.308188 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b86874-0675-43d3-811d-1f62c7adcd8f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:56.308393 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b86874-0675-43d3-811d-1f62c7adcd8f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:56.308673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b86874-0675-43d3-811d-1f62c7adcd8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:56.321229 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b86874-0675-43d3-811d-1f62c7adcd8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:56.322737 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b86874-0675-43d3-811d-1f62c7adcd8f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:56.340536 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-87b86874-0675-43d3-811d-1f62c7adcd8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:56.340536 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:56.340536 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:56.340536 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:56.340536 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:56.340536 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:56.340536 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:56.340536 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:56.340536 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:56.340536 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:56.340536 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:56.340536 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:56.340536 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:56.340536 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:56.340536 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:56.341473 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:56.341473 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:56.341473 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:56.341473 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:56.341473 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:56.341473 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:56.341473 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:56.341473 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:56.341473 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:56.341473 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:56.341473 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:56.341473 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:56.341473 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:56.341473 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:56.341473 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:56.341473 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:56.341473 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:56.342841 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:56.342841 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:56.342841 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:56.342841 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:56.347456 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 443/891] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:58:56.348294 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b86874-0675-43d3-811d-1f62c7adcd8f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:56.373920 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe5a17-0f11-42ed-baf0-8db647f71dff None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:56.411452 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7816aa-9f8b-4e60-a85b-5476fa103592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:56.412120 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7816aa-9f8b-4e60-a85b-5476fa103592 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:56.412437 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7816aa-9f8b-4e60-a85b-5476fa103592 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:56.412796 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7816aa-9f8b-4e60-a85b-5476fa103592 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:56.413433 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7816aa-9f8b-4e60-a85b-5476fa103592 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:56.413744 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7816aa-9f8b-4e60-a85b-5476fa103592 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:56.415221 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7816aa-9f8b-4e60-a85b-5476fa103592 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:56.425165 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 449/892] 10.222.0.49 () {56 vars in 1122 bytes} [Mon Jul 4 03:58:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:58:56.426272 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7816aa-9f8b-4e60-a85b-5476fa103592 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:56.436292 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:56.476556 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b86874-0675-43d3-811d-1f62c7adcd8f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:56.519218 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e59091-3ba1-4a4f-8194-6e2f94ff69b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:56.520427 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e59091-3ba1-4a4f-8194-6e2f94ff69b7 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:56.520856 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e59091-3ba1-4a4f-8194-6e2f94ff69b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:56.521292 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e59091-3ba1-4a4f-8194-6e2f94ff69b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:56.522561 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e59091-3ba1-4a4f-8194-6e2f94ff69b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:56.523433 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e59091-3ba1-4a4f-8194-6e2f94ff69b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:56.525502 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e59091-3ba1-4a4f-8194-6e2f94ff69b7 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:56.540898 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 444/893] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:58:56.547026 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e59091-3ba1-4a4f-8194-6e2f94ff69b7 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:56.550431 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7816aa-9f8b-4e60-a85b-5476fa103592 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:56.586828 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9ec06-bccb-47dc-8227-e80b392a32e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:56.587425 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9ec06-bccb-47dc-8227-e80b392a32e6 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:56.587711 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9ec06-bccb-47dc-8227-e80b392a32e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:56.587988 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9ec06-bccb-47dc-8227-e80b392a32e6 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:56.588814 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9ec06-bccb-47dc-8227-e80b392a32e6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:56.589129 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9ec06-bccb-47dc-8227-e80b392a32e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:56.590560 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9ec06-bccb-47dc-8227-e80b392a32e6 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:56.607194 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:56.607521 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 450/894] 10.222.0.49 () {56 vars in 1122 bytes} [Mon Jul 4 03:58:56 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:56.675100 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e59091-3ba1-4a4f-8194-6e2f94ff69b7 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:56.712938 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae3df6-9a77-4a18-bd92-7d668d9df09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:56.714066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae3df6-9a77-4a18-bd92-7d668d9df09d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:56.714524 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae3df6-9a77-4a18-bd92-7d668d9df09d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:56.714943 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae3df6-9a77-4a18-bd92-7d668d9df09d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:56.723412 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae3df6-9a77-4a18-bd92-7d668d9df09d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:56.725360 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae3df6-9a77-4a18-bd92-7d668d9df09d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:56.742460 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-08ae3df6-9a77-4a18-bd92-7d668d9df09d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 03:58:56.742460 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:56.742460 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:56.742460 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:56.742460 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:56.742460 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:56.742460 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:56.742460 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:56.742460 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:56.742460 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:56.742460 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:56.742460 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:56.742460 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 03:58:56.742460 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 03:58:56.742460 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 03:58:56.742460 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 03:58:56.743718 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:56.743718 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:56.743718 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 03:58:56.743718 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:56.743718 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 03:58:56.743718 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:58:56.743718 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:56.743718 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:56.743718 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:56.743718 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:56.743718 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:56.743718 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:56.743718 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:56.743718 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:56.743718 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:56.743718 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:56.743718 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:56.743718 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:56.744926 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:56.744926 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:56.744926 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 03:58:56.744926 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 03:58:56.744926 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 03:58:56.744926 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 03:58:56.744926 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 03:58:56.744926 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 03:58:56.744926 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 03:58:56.744926 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:56.747380 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 445/895] 10.222.0.49 () {56 vars in 1117 bytes} [Mon Jul 4 03:58:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:56.755848 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9ec06-bccb-47dc-8227-e80b392a32e6 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:56.827838 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:56.859250 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9ec06-bccb-47dc-8227-e80b392a32e6 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:56.893037 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a54085-1796-4480-af1d-c550a2279898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:56.893712 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a54085-1796-4480-af1d-c550a2279898 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:56.893998 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a54085-1796-4480-af1d-c550a2279898 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:56.894308 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a54085-1796-4480-af1d-c550a2279898 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:56.895154 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a54085-1796-4480-af1d-c550a2279898 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:56.895479 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a54085-1796-4480-af1d-c550a2279898 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:56.896975 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a54085-1796-4480-af1d-c550a2279898 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:56.914722 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 451/896] 10.222.0.49 () {56 vars in 1149 bytes} [Mon Jul 4 03:58:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:56.920357 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae3df6-9a77-4a18-bd92-7d668d9df09d None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:57.032434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:57.036314 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae3df6-9a77-4a18-bd92-7d668d9df09d None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:57.072150 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f903f-9379-48c2-9581-ffa58f4aff8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:57.073171 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f903f-9379-48c2-9581-ffa58f4aff8a None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:57.073668 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f903f-9379-48c2-9581-ffa58f4aff8a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:57.074216 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f903f-9379-48c2-9581-ffa58f4aff8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:57.153507 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2f903f-9379-48c2-9581-ffa58f4aff8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:57.154950 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2f903f-9379-48c2-9581-ffa58f4aff8a None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:57.253365 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:57.258189 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 446/897] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:58:56 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 03:58:57.264846 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a54085-1796-4480-af1d-c550a2279898 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:57.366333 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a54085-1796-4480-af1d-c550a2279898 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:57.398549 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:57.402098 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f95c6-e974-45b2-ad08-d72f3dcb5c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:57.402982 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f95c6-e974-45b2-ad08-d72f3dcb5c02 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:57.403269 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f95c6-e974-45b2-ad08-d72f3dcb5c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:57.404807 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f95c6-e974-45b2-ad08-d72f3dcb5c02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:57.414591 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f95c6-e974-45b2-ad08-d72f3dcb5c02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:57.416144 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f95c6-e974-45b2-ad08-d72f3dcb5c02 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:57.434372 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-ec2f95c6-e974-45b2-ad08-d72f3dcb5c02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:57.434372 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:57.434372 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:57.434372 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:57.434372 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:57.434372 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:57.434372 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:57.434372 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:57.434372 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:57.434372 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:57.434372 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:57.434372 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:57.434372 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:58:57.434372 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:58:57.434372 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:58:57.435406 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:58:57.435406 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:57.435406 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:57.435406 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:57.435406 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:57.435406 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:57.435406 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:57.435406 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:57.435406 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:57.435406 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:57.435406 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:57.435406 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:57.435406 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:57.435406 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:57.435406 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:57.435406 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:57.435406 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:57.436285 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:58:57.436285 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:58:57.436285 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:58:57.436285 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:57.436285 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 452/898] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:58:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:57.443278 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f903f-9379-48c2-9581-ffa58f4aff8a None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:57.529897 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c141a59-2476-4243-bd00-63045928512b None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:57.530236 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c141a59-2476-4243-bd00-63045928512b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:57.530490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c141a59-2476-4243-bd00-63045928512b None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:57.533033 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 453/899] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:57.536980 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56e578-6d7a-4098-84e6-b77fd2d13290 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:57.537392 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56e578-6d7a-4098-84e6-b77fd2d13290 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:57.537677 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56e578-6d7a-4098-84e6-b77fd2d13290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:57.548089 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f903f-9379-48c2-9581-ffa58f4aff8a None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:57.555189 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-5e56e578-6d7a-4098-84e6-b77fd2d13290 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:57.556658 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-5e56e578-6d7a-4098-84e6-b77fd2d13290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:57.585356 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ebf00-921e-4b0e-ad43-7dd79c4b0c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:57.586471 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ebf00-921e-4b0e-ad43-7dd79c4b0c46 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:57.586987 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ebf00-921e-4b0e-ad43-7dd79c4b0c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:57.587478 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ebf00-921e-4b0e-ad43-7dd79c4b0c46 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:57.588405 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ebf00-921e-4b0e-ad43-7dd79c4b0c46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:57.588918 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ebf00-921e-4b0e-ad43-7dd79c4b0c46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:57.590653 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ebf00-921e-4b0e-ad43-7dd79c4b0c46 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:57.603781 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 447/900] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:57.609444 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ebf00-921e-4b0e-ad43-7dd79c4b0c46 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:57.630284 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 454/901] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:57 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 03:58:57.648435 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56e578-6d7a-4098-84e6-b77fd2d13290 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:57.672434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:57.724909 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ebf00-921e-4b0e-ad43-7dd79c4b0c46 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:57.753815 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56e578-6d7a-4098-84e6-b77fd2d13290 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:57.765707 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:57.773319 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da90c78-fd6b-40f2-9466-dd42f69c3017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:57.774723 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da90c78-fd6b-40f2-9466-dd42f69c3017 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:57.775244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da90c78-fd6b-40f2-9466-dd42f69c3017 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:57.775750 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da90c78-fd6b-40f2-9466-dd42f69c3017 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:57.785603 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da90c78-fd6b-40f2-9466-dd42f69c3017 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:57.787920 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da90c78-fd6b-40f2-9466-dd42f69c3017 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:57.790936 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953d42d-2ab7-46f9-ace7-698c234b77b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:57.791680 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953d42d-2ab7-46f9-ace7-698c234b77b1 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:57.791961 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953d42d-2ab7-46f9-ace7-698c234b77b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:57.792236 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953d42d-2ab7-46f9-ace7-698c234b77b1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:57.792888 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953d42d-2ab7-46f9-ace7-698c234b77b1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:57.794293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953d42d-2ab7-46f9-ace7-698c234b77b1 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:57.805832 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-9da90c78-fd6b-40f2-9466-dd42f69c3017 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:57.805832 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:57.805832 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:57.805832 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:57.805832 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:57.805832 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:57.805832 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:57.805832 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:57.805832 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:57.805832 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:57.805832 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:57.805832 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:57.805832 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 03:58:57.805832 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 03:58:57.805832 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 03:58:57.806801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 03:58:57.806801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:57.806801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:57.806801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:57.806801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:57.806801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:57.806801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:57.806801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:57.806801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:57.806801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:57.806801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:57.806801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:57.806801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:57.806801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:57.806801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:57.806801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:57.806801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:57.807712 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 03:58:57.807712 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 03:58:57.807712 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 03:58:57.807712 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 03:58:57.807712 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 03:58:57.807712 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 03:58:57.807712 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:58:57.807712 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:57.808138 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-8953d42d-2ab7-46f9-ace7-698c234b77b1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 03:58:57.808138 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:57.808138 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 03:58:57.808138 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 03:58:57.808138 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 03:58:57.808138 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 03:58:57.808138 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 03:58:57.808138 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:58:57.808138 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 03:58:57.808138 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:57.808138 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 03:58:57.808138 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:57.808138 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:57.808138 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:57.808138 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:57.808138 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:57.810649 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:57.810649 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:57.810649 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:57.810649 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:57.810649 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:57.810649 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:57.810649 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:57.810649 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 03:58:57.810649 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 03:58:57.810649 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 03:58:57.810649 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 03:58:57.810649 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:57.810649 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:57.810649 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:57.810649 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:57.810649 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:57.811517 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:57.811517 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:57.811517 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:57.811517 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:57.811517 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:57.811517 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:57.811517 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:57.811517 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:57.811517 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:57.811517 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:57.811517 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:57.811517 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 03:58:57.811517 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:58:57.811517 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 03:58:57.811517 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:58:57.815430 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 455/902] 10.222.0.49 () {56 vars in 1132 bytes} [Mon Jul 4 03:58:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:58:57.820880 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 448/903] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:58:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:58:57.821448 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953d42d-2ab7-46f9-ace7-698c234b77b1 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:57.824886 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da90c78-fd6b-40f2-9466-dd42f69c3017 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:57.948088 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da90c78-fd6b-40f2-9466-dd42f69c3017 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:57.949923 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953d42d-2ab7-46f9-ace7-698c234b77b1 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:57.970445 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:57.986132 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c6db7-52ec-4b24-b9ce-3eb5408de76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:57.986951 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c6db7-52ec-4b24-b9ce-3eb5408de76a None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:57.987304 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c6db7-52ec-4b24-b9ce-3eb5408de76a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:57.987648 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c6db7-52ec-4b24-b9ce-3eb5408de76a None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:57.988684 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c6db7-52ec-4b24-b9ce-3eb5408de76a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:57.989347 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c6db7-52ec-4b24-b9ce-3eb5408de76a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:57.991315 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c6db7-52ec-4b24-b9ce-3eb5408de76a None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:57.995500 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230bf04-4135-48c3-809f-fb4fba965e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:57.996245 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230bf04-4135-48c3-809f-fb4fba965e04 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:57.996598 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230bf04-4135-48c3-809f-fb4fba965e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:57.996945 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230bf04-4135-48c3-809f-fb4fba965e04 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:57.997729 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230bf04-4135-48c3-809f-fb4fba965e04 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:57.998107 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230bf04-4135-48c3-809f-fb4fba965e04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:57.999677 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230bf04-4135-48c3-809f-fb4fba965e04 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:58.006265 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 456/904] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Jul 4 03:58:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:58.010309 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 449/905] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Jul 4 03:58:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:58.012265 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e107a4a-9ad1-4472-8eac-d0e7b68ca166 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:58.012735 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e107a4a-9ad1-4472-8eac-d0e7b68ca166 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:58.013026 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e107a4a-9ad1-4472-8eac-d0e7b68ca166 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:58.014591 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 457/906] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:58.015550 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c6db7-52ec-4b24-b9ce-3eb5408de76a None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:58.016532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e107a4a-9ad1-4472-8eac-d0e7b68ca166 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:58.060396 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:58.118721 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c6db7-52ec-4b24-b9ce-3eb5408de76a None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:58.125981 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e107a4a-9ad1-4472-8eac-d0e7b68ca166 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:58.155700 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef20de4-d5f6-4969-82c4-3c0a833ed2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:58.156382 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef20de4-d5f6-4969-82c4-3c0a833ed2b6 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:58.156673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef20de4-d5f6-4969-82c4-3c0a833ed2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:58.157127 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef20de4-d5f6-4969-82c4-3c0a833ed2b6 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:58.157693 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef20de4-d5f6-4969-82c4-3c0a833ed2b6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:58.157981 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef20de4-d5f6-4969-82c4-3c0a833ed2b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:58.159428 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef20de4-d5f6-4969-82c4-3c0a833ed2b6 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:58.162101 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3869de-b1f0-44a8-84b9-165cbec3750c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:58.162920 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3869de-b1f0-44a8-84b9-165cbec3750c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:58.163205 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3869de-b1f0-44a8-84b9-165cbec3750c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:58.163486 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3869de-b1f0-44a8-84b9-165cbec3750c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:58.164320 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3869de-b1f0-44a8-84b9-165cbec3750c None admin] RBAC: Adding query filter params (role.id=bc829c0c3f7b402c930a7f1d58b27331, scope.project.id=424a145a22434ef7a14b6108e6118ccb, user.id=03e7f908f0a7499792e59e31d497edb7) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:58.169174 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3869de-b1f0-44a8-84b9-165cbec3750c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:58.169307 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 450/907] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Jul 4 03:58:58 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:58.169307 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde17bc-c614-49b2-8721-1c5571c12f8e None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:58.169470 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3869de-b1f0-44a8-84b9-165cbec3750c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:58.169555 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde17bc-c614-49b2-8721-1c5571c12f8e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:58.169555 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde17bc-c614-49b2-8721-1c5571c12f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:58.174659 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 458/908] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:58:58 2022] GET /identity/v3/role_assignments?user.id=03e7f908f0a7499792e59e31d497edb7&scope.project.id=424a145a22434ef7a14b6108e6118ccb&role.id=bc829c0c3f7b402c930a7f1d58b27331 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:58.179631 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3869de-b1f0-44a8-84b9-165cbec3750c None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:58.186400 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-edde17bc-c614-49b2-8721-1c5571c12f8e None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:58.188268 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-edde17bc-c614-49b2-8721-1c5571c12f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:58.240933 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:58.270566 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 451/909] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:58 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 03:58:58.295393 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde17bc-c614-49b2-8721-1c5571c12f8e None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:58.306178 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3869de-b1f0-44a8-84b9-165cbec3750c None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:58.308618 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:58.348276 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099cbb6d-b0da-4f23-b7fd-f1b95c30c98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:58.349067 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cbb6d-b0da-4f23-b7fd-f1b95c30c98d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:58.349340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cbb6d-b0da-4f23-b7fd-f1b95c30c98d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:58.349624 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cbb6d-b0da-4f23-b7fd-f1b95c30c98d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:58.350557 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099cbb6d-b0da-4f23-b7fd-f1b95c30c98d None admin] RBAC: Adding query filter params (interface=public, service_id=f8927be53c934be68c17bf177306e98f, region_id=RegionOne) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:58.350881 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099cbb6d-b0da-4f23-b7fd-f1b95c30c98d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:58.352284 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099cbb6d-b0da-4f23-b7fd-f1b95c30c98d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:58.358661 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 459/910] 10.222.0.49 () {56 vars in 1251 bytes} [Mon Jul 4 03:58:58 2022] GET /identity/v3/endpoints?service_id=f8927be53c934be68c17bf177306e98f&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:58.365351 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099cbb6d-b0da-4f23-b7fd-f1b95c30c98d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:58.422087 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde17bc-c614-49b2-8721-1c5571c12f8e None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:58.471809 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6933f-7ddb-4f13-94be-d3355a744c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:58.472636 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6933f-7ddb-4f13-94be-d3355a744c65 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:58.472921 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6933f-7ddb-4f13-94be-d3355a744c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:58.473198 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6933f-7ddb-4f13-94be-d3355a744c65 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:58.473861 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c6933f-7ddb-4f13-94be-d3355a744c65 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:58.475401 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c6933f-7ddb-4f13-94be-d3355a744c65 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:58.487544 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-94c6933f-7ddb-4f13-94be-d3355a744c65 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 03:58:58.487544 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:58.487544 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 03:58:58.487544 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 03:58:58.487544 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 03:58:58.487544 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 03:58:58.487544 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 03:58:58.487544 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:58:58.487544 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 03:58:58.487544 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:58.487544 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 03:58:58.487544 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:58.487544 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:58:58.487544 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:58:58.487544 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:58:58.487544 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:58:58.487544 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:58:58.488970 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:58:58.488970 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:58:58.488970 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:58:58.488970 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:58:58.488970 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:58:58.488970 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:58:58.488970 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 03:58:58.488970 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 03:58:58.488970 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 03:58:58.488970 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 03:58:58.488970 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:58:58.488970 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:58:58.488970 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:58:58.488970 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:58:58.488970 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:58:58.488970 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:58:58.489801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:58:58.489801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:58:58.489801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:58:58.489801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:58:58.489801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:58:58.489801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:58:58.489801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:58:58.489801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:58:58.489801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:58:58.489801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:58:58.489801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 03:58:58.489801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:58:58.489801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 04 03:58:58.489801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:58:58.489801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 452/911] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Jul 4 03:58:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:58:58.496464 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6933f-7ddb-4f13-94be-d3355a744c65 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:58.504419 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099cbb6d-b0da-4f23-b7fd-f1b95c30c98d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:58.543800 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4bfa9-d1f6-4036-8b7d-bd418384f68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:58.544478 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4bfa9-d1f6-4036-8b7d-bd418384f68e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:58.544768 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4bfa9-d1f6-4036-8b7d-bd418384f68e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:58.545050 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4bfa9-d1f6-4036-8b7d-bd418384f68e None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:58.545747 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c4bfa9-d1f6-4036-8b7d-bd418384f68e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:58.547197 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c4bfa9-d1f6-4036-8b7d-bd418384f68e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:58.550971 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:58.554953 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 460/912] 10.222.0.49 () {56 vars in 1087 bytes} [Mon Jul 4 03:58:58 2022] GET /identity/v3/services => generated 1268 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 03:58:58.618208 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6933f-7ddb-4f13-94be-d3355a744c65 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:58.656741 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822df7d6-03e7-411c-a146-15a21f5ad315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:58.657622 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822df7d6-03e7-411c-a146-15a21f5ad315 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:58.658009 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822df7d6-03e7-411c-a146-15a21f5ad315 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:58.658412 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822df7d6-03e7-411c-a146-15a21f5ad315 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:58.659251 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822df7d6-03e7-411c-a146-15a21f5ad315 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:58.659666 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822df7d6-03e7-411c-a146-15a21f5ad315 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:58.661216 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822df7d6-03e7-411c-a146-15a21f5ad315 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:58.667418 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 453/913] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Jul 4 03:58:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:58.672868 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4bfa9-d1f6-4036-8b7d-bd418384f68e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:58.706857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:58.764992 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e02579-9231-4290-88a1-e79b5f1a84ea None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:58.765206 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e02579-9231-4290-88a1-e79b5f1a84ea None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:58.765496 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e02579-9231-4290-88a1-e79b5f1a84ea None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:58.766918 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 454/914] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:58:58.778474 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91354510-7304-4fb4-931f-8689ffad9052 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:58.778765 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91354510-7304-4fb4-931f-8689ffad9052 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:58.779042 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91354510-7304-4fb4-931f-8689ffad9052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:58.795922 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4bfa9-d1f6-4036-8b7d-bd418384f68e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:58.797775 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-91354510-7304-4fb4-931f-8689ffad9052 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:58:58.799304 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-91354510-7304-4fb4-931f-8689ffad9052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:58:58.847711 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b2cfd-7414-40f0-919f-dbe7deb15fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:58.848887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b2cfd-7414-40f0-919f-dbe7deb15fb8 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:58.849846 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b2cfd-7414-40f0-919f-dbe7deb15fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:58.850411 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b2cfd-7414-40f0-919f-dbe7deb15fb8 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:58.851564 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037b2cfd-7414-40f0-919f-dbe7deb15fb8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:58:58.852289 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037b2cfd-7414-40f0-919f-dbe7deb15fb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:58.854301 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037b2cfd-7414-40f0-919f-dbe7deb15fb8 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:58.862037 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 461/915] 10.222.0.49 () {56 vars in 1114 bytes} [Mon Jul 4 03:58:58 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:58:58.867393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b2cfd-7414-40f0-919f-dbe7deb15fb8 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:58.870471 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 455/916] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:58:58 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 03:58:58.894930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91354510-7304-4fb4-931f-8689ffad9052 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:58:58.928439 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:58.996255 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:58:59.006712 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b2cfd-7414-40f0-919f-dbe7deb15fb8 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:59.017283 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91354510-7304-4fb4-931f-8689ffad9052 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:58:59.054879 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158d59f-74e9-4b16-8721-da5807021b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:59.055366 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d69f5-e1ff-4c33-8743-6e1ddeafe139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:58:59.055984 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158d59f-74e9-4b16-8721-da5807021b25 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:59.056102 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d69f5-e1ff-4c33-8743-6e1ddeafe139 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:58:59.056334 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d69f5-e1ff-4c33-8743-6e1ddeafe139 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:59.056614 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d69f5-e1ff-4c33-8743-6e1ddeafe139 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:59.056830 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158d59f-74e9-4b16-8721-da5807021b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:58:59.057247 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158d59f-74e9-4b16-8721-da5807021b25 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:58:59.057356 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d69f5-e1ff-4c33-8743-6e1ddeafe139 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:59.058276 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a158d59f-74e9-4b16-8721-da5807021b25 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:58:59.058798 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d69f5-e1ff-4c33-8743-6e1ddeafe139 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:59.059976 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a158d59f-74e9-4b16-8721-da5807021b25 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:58:59.074014 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 456/917] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Jul 4 03:58:58 2022] POST /identity/v3/services => generated 241 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 03:58:59.087882 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 462/918] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Jul 4 03:58:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 03:59:00.231782 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f06834-6880-4c42-bed3-f2bfd56e0a16 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:00.232288 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f06834-6880-4c42-bed3-f2bfd56e0a16 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:00.232288 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f06834-6880-4c42-bed3-f2bfd56e0a16 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:00.233908 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 457/919] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:59:00.239506 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650489c-d292-4de0-82f3-b9b531cd39e5 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:00.239933 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650489c-d292-4de0-82f3-b9b531cd39e5 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:00.240101 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650489c-d292-4de0-82f3-b9b531cd39e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:00.257164 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-1650489c-d292-4de0-82f3-b9b531cd39e5 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:59:00.258395 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1650489c-d292-4de0-82f3-b9b531cd39e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:59:00.335108 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 463/920] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:59:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 03:59:00.357189 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f06834-6880-4c42-bed3-f2bfd56e0a16 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:00.448405 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:00.458657 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f06834-6880-4c42-bed3-f2bfd56e0a16 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:00.493417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8364ca-db98-47db-82d5-d5b946c48819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:00.494187 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8364ca-db98-47db-82d5-d5b946c48819 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:00.494617 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8364ca-db98-47db-82d5-d5b946c48819 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:00.494908 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8364ca-db98-47db-82d5-d5b946c48819 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:00.508762 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8364ca-db98-47db-82d5-d5b946c48819 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:59:00.519012 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-ea8364ca-db98-47db-82d5-d5b946c48819 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 03:59:00.519012 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:00.519012 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:00.519012 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:00.519012 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:00.519012 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:00.519012 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:00.519012 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:00.519012 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:00.519012 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:00.519012 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:00.519012 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:00.519012 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:59:00.519012 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:59:00.519012 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:59:00.519012 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:59:00.519947 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:59:00.519947 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:59:00.519947 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:59:00.519947 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:59:00.519947 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:00.519947 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:00.519947 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:00.519947 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:00.519947 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:00.519947 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:00.519947 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:00.519947 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:00.519947 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:00.519947 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:00.519947 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:00.519947 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:00.520787 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:00.520787 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:00.520787 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:00.520787 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:00.520787 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:59:00.520787 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:59:00.520787 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:59:00.520787 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:59:00.520787 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:59:00.520787 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:59:00.520787 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 03:59:00.520787 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:00.520787 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 458/921] 10.222.0.49 () {56 vars in 1120 bytes} [Mon Jul 4 03:59:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:59:00.526736 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650489c-d292-4de0-82f3-b9b531cd39e5 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:00.603478 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:00.627246 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650489c-d292-4de0-82f3-b9b531cd39e5 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:00.666516 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29936a41-62bc-445b-ae73-a678e36e363f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:00.667556 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29936a41-62bc-445b-ae73-a678e36e363f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:00.668095 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29936a41-62bc-445b-ae73-a678e36e363f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:00.668566 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29936a41-62bc-445b-ae73-a678e36e363f None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:00.669516 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29936a41-62bc-445b-ae73-a678e36e363f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:00.670023 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29936a41-62bc-445b-ae73-a678e36e363f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:00.671628 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29936a41-62bc-445b-ae73-a678e36e363f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:00.680770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 464/922] 10.222.0.49 () {56 vars in 1115 bytes} [Mon Jul 4 03:59:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:00.686446 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8364ca-db98-47db-82d5-d5b946c48819 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:00.727633 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a622097-a55f-4764-9622-11eaddabe9e4 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:00.728277 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a622097-a55f-4764-9622-11eaddabe9e4 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:00.728773 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a622097-a55f-4764-9622-11eaddabe9e4 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:00.730655 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 465/923] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:59:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:59:00.736838 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cd95f-ae68-4b9b-abc2-17b46a2acf1e None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:00.737133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cd95f-ae68-4b9b-abc2-17b46a2acf1e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:00.737416 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cd95f-ae68-4b9b-abc2-17b46a2acf1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:00.755723 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-be7cd95f-ae68-4b9b-abc2-17b46a2acf1e None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:59:00.757020 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-be7cd95f-ae68-4b9b-abc2-17b46a2acf1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:59:00.808327 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8364ca-db98-47db-82d5-d5b946c48819 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:00.846202 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 466/924] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:59:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 03:59:00.858244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6768388-afe0-4abb-b225-28b7e95624d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:00.859268 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6768388-afe0-4abb-b225-28b7e95624d6 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:00.859809 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6768388-afe0-4abb-b225-28b7e95624d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:00.860239 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6768388-afe0-4abb-b225-28b7e95624d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:00.865604 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7cd95f-ae68-4b9b-abc2-17b46a2acf1e None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:00.875336 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6768388-afe0-4abb-b225-28b7e95624d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:00.877276 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6768388-afe0-4abb-b225-28b7e95624d6 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:00.901406 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-b6768388-afe0-4abb-b225-28b7e95624d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:59:00.901406 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:00.901406 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:00.901406 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:00.901406 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:00.901406 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:00.901406 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:00.901406 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:00.901406 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:00.901406 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:00.901406 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:00.901406 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:00.901406 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:59:00.901406 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:59:00.901406 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:59:00.902455 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:59:00.902455 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:00.902455 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:00.902455 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:00.902455 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:00.902455 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:00.902455 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:00.902455 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:00.902455 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:00.902455 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:00.902455 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:00.902455 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:00.902455 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:00.902455 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:00.902455 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:00.902455 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:00.902455 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:00.903390 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:59:00.903390 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:59:00.903390 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:59:00.903390 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:00.903390 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 459/925] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:59:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:59:00.909407 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6768388-afe0-4abb-b225-28b7e95624d6 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:00.913452 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:00.951725 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:01.001183 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7cd95f-ae68-4b9b-abc2-17b46a2acf1e None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:01.023804 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6768388-afe0-4abb-b225-28b7e95624d6 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:01.047316 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb40a1-3595-4aba-b787-b536af2faf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:01.048148 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb40a1-3595-4aba-b787-b536af2faf0b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:01.048436 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb40a1-3595-4aba-b787-b536af2faf0b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:01.048717 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb40a1-3595-4aba-b787-b536af2faf0b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:01.049385 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb40a1-3595-4aba-b787-b536af2faf0b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:01.050842 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb40a1-3595-4aba-b787-b536af2faf0b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:01.064283 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec69a9-e503-4148-9f26-1e832a88f492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:01.064491 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-9dcb40a1-3595-4aba-b787-b536af2faf0b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 03:59:01.064491 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:01.064491 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 03:59:01.064491 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 03:59:01.064491 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 03:59:01.064491 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 03:59:01.064491 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 03:59:01.064491 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:59:01.064491 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 03:59:01.064491 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:59:01.064491 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 03:59:01.064491 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:59:01.064491 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:01.064491 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:01.064491 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:01.064491 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:01.065367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:01.065367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:01.065367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:01.065367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:01.065367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:01.065367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:01.065367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:01.065367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 03:59:01.065367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 03:59:01.065367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 03:59:01.065367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 03:59:01.065367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:01.065367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:01.065367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:01.065367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:01.065367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:01.066232 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:01.066232 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:01.066232 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:01.066232 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:01.066232 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:01.066232 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:01.066232 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:01.066232 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:01.066232 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:01.066232 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:01.066232 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:01.066232 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 03:59:01.066232 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:59:01.066232 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 04 03:59:01.066232 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:59:01.068325 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec69a9-e503-4148-9f26-1e832a88f492 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:01.068818 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec69a9-e503-4148-9f26-1e832a88f492 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:01.069289 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec69a9-e503-4148-9f26-1e832a88f492 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:01.070271 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec69a9-e503-4148-9f26-1e832a88f492 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:01.070781 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec69a9-e503-4148-9f26-1e832a88f492 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:01.070970 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 467/926] 10.222.0.49 () {56 vars in 1132 bytes} [Mon Jul 4 03:59:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:59:01.072005 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb40a1-3595-4aba-b787-b536af2faf0b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:01.072861 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec69a9-e503-4148-9f26-1e832a88f492 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:01.090543 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 460/927] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:01.096276 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec69a9-e503-4148-9f26-1e832a88f492 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:01.172424 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:01.186001 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb40a1-3595-4aba-b787-b536af2faf0b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:01.211805 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec69a9-e503-4148-9f26-1e832a88f492 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:01.217639 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:01.222991 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028d213-7802-41d9-8e2b-8e45524c0e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:01.223664 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028d213-7802-41d9-8e2b-8e45524c0e58 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:01.223950 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028d213-7802-41d9-8e2b-8e45524c0e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:01.224231 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028d213-7802-41d9-8e2b-8e45524c0e58 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:01.225024 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028d213-7802-41d9-8e2b-8e45524c0e58 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:01.225334 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028d213-7802-41d9-8e2b-8e45524c0e58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:01.226778 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028d213-7802-41d9-8e2b-8e45524c0e58 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:01.231480 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 468/928] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Jul 4 03:59:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:59:01.231480 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d720638-a145-4870-9b0e-abb9aa1244f5 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:01.231480 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d720638-a145-4870-9b0e-abb9aa1244f5 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:01.231480 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d720638-a145-4870-9b0e-abb9aa1244f5 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:01.231480 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 469/929] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:59:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:59:01.231480 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807d0ef-3e19-466b-a6e6-bd0e57abffea None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:01.236433 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807d0ef-3e19-466b-a6e6-bd0e57abffea None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:01.236433 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807d0ef-3e19-466b-a6e6-bd0e57abffea None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:01.238311 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 470/930] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:59:01.239246 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807d0ef-3e19-466b-a6e6-bd0e57abffea None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:01.254417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd778a3-e34d-46bc-bba4-7d8bb52847c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:01.255245 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd778a3-e34d-46bc-bba4-7d8bb52847c3 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:01.255529 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd778a3-e34d-46bc-bba4-7d8bb52847c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:01.255867 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd778a3-e34d-46bc-bba4-7d8bb52847c3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:01.263587 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd778a3-e34d-46bc-bba4-7d8bb52847c3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:01.265074 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd778a3-e34d-46bc-bba4-7d8bb52847c3 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:01.280539 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-6cd778a3-e34d-46bc-bba4-7d8bb52847c3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 03:59:01.280539 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:01.280539 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:01.280539 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:01.280539 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:01.280539 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:01.280539 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:01.280539 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:01.280539 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:01.280539 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:01.280539 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:01.280539 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:01.280539 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 03:59:01.280539 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 03:59:01.280539 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 03:59:01.280539 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 03:59:01.281516 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:01.281516 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:01.281516 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 03:59:01.281516 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:59:01.281516 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 03:59:01.281516 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:59:01.281516 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:01.281516 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:01.281516 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:01.281516 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:01.281516 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:01.281516 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:01.281516 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:01.281516 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:01.281516 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:01.281516 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:01.281516 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:01.281516 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:01.282514 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:01.282514 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:01.282514 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 03:59:01.282514 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 03:59:01.282514 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 03:59:01.282514 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 03:59:01.282514 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 03:59:01.282514 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 03:59:01.282514 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 03:59:01.282514 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:01.282514 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 461/931] 10.222.0.49 () {56 vars in 1117 bytes} [Mon Jul 4 03:59:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:59:01.283128 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca6a4b-204b-45f3-8b80-53a59fd270d4 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:01.283128 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca6a4b-204b-45f3-8b80-53a59fd270d4 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:01.283474 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca6a4b-204b-45f3-8b80-53a59fd270d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:01.299255 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-99ca6a4b-204b-45f3-8b80-53a59fd270d4 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:59:01.300446 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-99ca6a4b-204b-45f3-8b80-53a59fd270d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:59:01.343248 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807d0ef-3e19-466b-a6e6-bd0e57abffea None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:01.370716 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 462/932] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:59:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 03:59:01.371866 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982712e-cde6-4bdb-95f4-5f94f429c9a4 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:01.372142 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982712e-cde6-4bdb-95f4-5f94f429c9a4 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:01.372423 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982712e-cde6-4bdb-95f4-5f94f429c9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:01.380216 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911535f-694a-46d6-b1fb-049fc682085e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:01.380945 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911535f-694a-46d6-b1fb-049fc682085e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:01.381239 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911535f-694a-46d6-b1fb-049fc682085e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:01.381514 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911535f-694a-46d6-b1fb-049fc682085e None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:01.382244 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e911535f-694a-46d6-b1fb-049fc682085e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:01.382557 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e911535f-694a-46d6-b1fb-049fc682085e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:01.383939 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e911535f-694a-46d6-b1fb-049fc682085e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:01.389291 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 471/933] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Jul 4 03:59:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:01.389559 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-b982712e-cde6-4bdb-95f4-5f94f429c9a4 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:59:01.389943 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911535f-694a-46d6-b1fb-049fc682085e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:01.390869 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b982712e-cde6-4bdb-95f4-5f94f429c9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:59:01.444972 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:01.448904 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:01.465530 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 463/934] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:59:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 03:59:01.466110 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982712e-cde6-4bdb-95f4-5f94f429c9a4 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:01.494032 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911535f-694a-46d6-b1fb-049fc682085e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:01.529451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123e5f1-5711-4992-9dab-24e4e48013ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:01.530129 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123e5f1-5711-4992-9dab-24e4e48013ac None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:01.530447 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123e5f1-5711-4992-9dab-24e4e48013ac None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:01.530782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123e5f1-5711-4992-9dab-24e4e48013ac None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:01.531581 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6123e5f1-5711-4992-9dab-24e4e48013ac None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:01.531898 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6123e5f1-5711-4992-9dab-24e4e48013ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:01.533347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6123e5f1-5711-4992-9dab-24e4e48013ac None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:01.551414 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 472/935] 10.222.0.49 () {56 vars in 1149 bytes} [Mon Jul 4 03:59:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:01.552231 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123e5f1-5711-4992-9dab-24e4e48013ac None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:01.567897 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982712e-cde6-4bdb-95f4-5f94f429c9a4 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:01.601157 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4620050-2756-4b89-b8a2-e0edb59d3cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:01.601823 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4620050-2756-4b89-b8a2-e0edb59d3cda None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:01.602109 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4620050-2756-4b89-b8a2-e0edb59d3cda None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:01.602436 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4620050-2756-4b89-b8a2-e0edb59d3cda None admin] PATH_INFO: `/v3/endpoints` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:01.603215 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4620050-2756-4b89-b8a2-e0edb59d3cda None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:01.604615 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4620050-2756-4b89-b8a2-e0edb59d3cda None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:01.624420 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 464/936] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Jul 4 03:59:01 2022] POST /identity/v3/endpoints => generated 347 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 03:59:01.625334 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4620050-2756-4b89-b8a2-e0edb59d3cda None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:01.652852 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123e5f1-5711-4992-9dab-24e4e48013ac None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:01.671420 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:01.679196 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:01.700240 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec2876-24b3-4866-9f19-3392410aa602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:01.701064 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec2876-24b3-4866-9f19-3392410aa602 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:01.701499 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec2876-24b3-4866-9f19-3392410aa602 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:01.701667 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec2876-24b3-4866-9f19-3392410aa602 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:01.702380 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec2876-24b3-4866-9f19-3392410aa602 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:01.703877 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec2876-24b3-4866-9f19-3392410aa602 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:01.716669 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-6bec2876-24b3-4866-9f19-3392410aa602 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 03:59:01.716669 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:01.716669 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 03:59:01.716669 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 03:59:01.716669 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 03:59:01.716669 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 03:59:01.716669 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 03:59:01.716669 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:59:01.716669 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 03:59:01.716669 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:59:01.716669 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 03:59:01.716669 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:59:01.716669 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:01.716669 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:01.716669 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:01.716669 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:01.716669 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:01.717792 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:01.717792 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:01.717792 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:01.717792 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:01.717792 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:01.717792 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:01.717792 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 03:59:01.717792 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 03:59:01.717792 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 03:59:01.717792 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 03:59:01.717792 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:01.717792 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:01.717792 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:01.717792 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:01.717792 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:01.717792 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:01.718660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:01.718660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:01.718660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:01.718660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:01.718660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:01.718660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:01.718660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:01.718660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:01.718660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:01.718660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:01.718660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 03:59:01.718660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:59:01.718660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 03:59:01.718660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:59:01.718660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 473/937] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Jul 4 03:59:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:59:01.719491 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec2876-24b3-4866-9f19-3392410aa602 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:01.754630 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4620050-2756-4b89-b8a2-e0edb59d3cda None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:01.794581 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda4353-7907-475f-8345-e7f6a1e8e86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:01.795184 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda4353-7907-475f-8345-e7f6a1e8e86b None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:01.795477 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda4353-7907-475f-8345-e7f6a1e8e86b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:01.795776 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda4353-7907-475f-8345-e7f6a1e8e86b None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:01.796483 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda4353-7907-475f-8345-e7f6a1e8e86b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:01.797951 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda4353-7907-475f-8345-e7f6a1e8e86b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:01.799909 dv-cinder-742162-5-smb devstack@keystone.service[80363]: WARNING keystone.server.flask.common [None req-9fda4353-7907-475f-8345-e7f6a1e8e86b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 04 03:59:01.822606 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.sql.core [None req-9fda4353-7907-475f-8345-e7f6a1e8e86b None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 04 03:59:01.822606 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 04 03:59:01.822606 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [parameters: {'id': 'f282c2fdb87a4a3593e1367f24e4a429', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 04 03:59:01.822606 dv-cinder-742162-5-smb devstack@keystone.service[80363]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80363) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 04 03:59:01.830106 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-9fda4353-7907-475f-8345-e7f6a1e8e86b None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f282c2fdb87a4a3593e1367f24e4a429.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f282c2fdb87a4a3593e1367f24e4a429. Jul 04 03:59:01.830106 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:01.830106 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 04 03:59:01.830106 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 04 03:59:01.830106 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 04 03:59:01.830106 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 04 03:59:01.830106 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 04 03:59:01.830106 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application result = self._query(query) Jul 04 03:59:01.830106 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 04 03:59:01.830106 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application conn.query(q) Jul 04 03:59:01.830106 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 04 03:59:01.830106 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 04 03:59:01.830106 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 04 03:59:01.831117 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application result.read() Jul 04 03:59:01.831117 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 04 03:59:01.831117 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 04 03:59:01.831117 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 04 03:59:01.831117 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 04 03:59:01.831117 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 04 03:59:01.831117 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 04 03:59:01.831117 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 04 03:59:01.831117 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 04 03:59:01.831117 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 04 03:59:01.831117 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:01.831117 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 04 03:59:01.831117 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:01.831117 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:01.831117 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 04 03:59:01.831117 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 04 03:59:01.831117 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 04 03:59:01.831117 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 04 03:59:01.832228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 04 03:59:01.832228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application next(self.gen) Jul 04 03:59:01.832228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 04 03:59:01.832228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application yield resource Jul 04 03:59:01.832228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 04 03:59:01.832228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application next(self.gen) Jul 04 03:59:01.832228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 04 03:59:01.832228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self.session.rollback() Jul 04 03:59:01.832228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 04 03:59:01.832228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self.force_reraise() Jul 04 03:59:01.832228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 04 03:59:01.832228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise self.value Jul 04 03:59:01.832228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 04 03:59:01.832228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 04 03:59:01.832228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 04 03:59:01.832228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application session.commit() Jul 04 03:59:01.832228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 04 03:59:01.833195 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 04 03:59:01.833195 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 04 03:59:01.833195 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._prepare_impl() Jul 04 03:59:01.833195 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 04 03:59:01.833195 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self.session.flush() Jul 04 03:59:01.833195 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 04 03:59:01.833195 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._flush(objects) Jul 04 03:59:01.833195 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 04 03:59:01.833195 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 04 03:59:01.833195 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 04 03:59:01.833195 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application compat.raise_( Jul 04 03:59:01.833195 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 04 03:59:01.833195 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception Jul 04 03:59:01.833195 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 04 03:59:01.833195 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application flush_context.execute() Jul 04 03:59:01.833195 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 04 03:59:01.833195 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rec.execute(self) Jul 04 03:59:01.834228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 04 03:59:01.834228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 04 03:59:01.834228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 04 03:59:01.834228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 04 03:59:01.834228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 04 03:59:01.834228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 04 03:59:01.834228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 04 03:59:01.834228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 04 03:59:01.834228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 04 03:59:01.834228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 04 03:59:01.834228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 04 03:59:01.834228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 04 03:59:01.834228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 04 03:59:01.834228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 04 03:59:01.834228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 04 03:59:01.835043 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 04 03:59:01.835043 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 04 03:59:01.835043 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception Jul 04 03:59:01.835043 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 04 03:59:01.835043 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 04 03:59:01.835043 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 04 03:59:01.835043 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 04 03:59:01.835043 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 04 03:59:01.835043 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application result = self._query(query) Jul 04 03:59:01.835043 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 04 03:59:01.835043 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application conn.query(q) Jul 04 03:59:01.835043 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 04 03:59:01.835043 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 04 03:59:01.835043 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 04 03:59:01.835043 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application result.read() Jul 04 03:59:01.835043 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 04 03:59:01.835043 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 04 03:59:01.835956 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 04 03:59:01.835956 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 04 03:59:01.835956 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 04 03:59:01.835956 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 04 03:59:01.835956 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 04 03:59:01.835956 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 04 03:59:01.835956 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 04 03:59:01.835956 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 04 03:59:01.835956 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [parameters: {'id': 'f282c2fdb87a4a3593e1367f24e4a429', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 04 03:59:01.835956 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 04 03:59:01.835956 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:01.835956 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 03:59:01.835956 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:01.835956 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:01.835956 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 04 03:59:01.837441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 04 03:59:01.837441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 04 03:59:01.837441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 04 03:59:01.837441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 04 03:59:01.837441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:01.837441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 03:59:01.837441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:01.837441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:01.837441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:01.837441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:01.837441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:01.837441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:01.837441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:01.837441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:01.837441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:01.837441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:01.837441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:01.839472 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:01.839472 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 04 03:59:01.839472 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 04 03:59:01.839472 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:01.839472 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:01.839472 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 04 03:59:01.839472 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 04 03:59:01.839472 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f282c2fdb87a4a3593e1367f24e4a429. Jul 04 03:59:01.839472 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:01.839472 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 465/938] 10.222.0.49 () {60 vars in 1140 bytes} [Mon Jul 4 03:59:01 2022] POST /identity/v3/projects => generated 262 bytes in 207 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:59:01.839472 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda4353-7907-475f-8345-e7f6a1e8e86b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:01.844422 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec2876-24b3-4866-9f19-3392410aa602 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:01.881143 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b8805-eee7-4769-96e9-9d55e38a6e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:01.882290 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b8805-eee7-4769-96e9-9d55e38a6e02 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:01.882584 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b8805-eee7-4769-96e9-9d55e38a6e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:01.882865 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b8805-eee7-4769-96e9-9d55e38a6e02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:01.894088 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b8805-eee7-4769-96e9-9d55e38a6e02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:01.895581 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b8805-eee7-4769-96e9-9d55e38a6e02 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:01.913196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-b79b8805-eee7-4769-96e9-9d55e38a6e02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:59:01.913196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:01.913196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:01.913196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:01.913196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:01.913196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:01.913196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:01.913196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:01.913196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:01.913196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:01.913196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:01.913196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:01.913196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:59:01.913196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:59:01.913196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:59:01.914346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:59:01.914346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:01.914346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:01.914346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:01.914346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:01.914346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:01.914346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:01.914346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:01.914346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:01.914346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:01.914346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:01.914346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:01.914346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:01.914346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:01.914346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:01.914346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:01.914346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:01.915250 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:59:01.915250 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:59:01.915250 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:59:01.915250 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:59:01.915250 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 474/939] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:59:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:59:01.915250 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b8805-eee7-4769-96e9-9d55e38a6e02 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:01.948741 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:01.960432 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:01.972972 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda4353-7907-475f-8345-e7f6a1e8e86b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:02.009173 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050b12e-9dd6-4748-8f3e-2f8e25d4e340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:02.009855 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050b12e-9dd6-4748-8f3e-2f8e25d4e340 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:02.010140 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050b12e-9dd6-4748-8f3e-2f8e25d4e340 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:02.010760 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050b12e-9dd6-4748-8f3e-2f8e25d4e340 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:02.011573 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050b12e-9dd6-4748-8f3e-2f8e25d4e340 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:02.011785 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050b12e-9dd6-4748-8f3e-2f8e25d4e340 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:02.013384 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050b12e-9dd6-4748-8f3e-2f8e25d4e340 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:02.021380 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 466/940] 10.222.0.49 () {56 vars in 1122 bytes} [Mon Jul 4 03:59:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:02.022059 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050b12e-9dd6-4748-8f3e-2f8e25d4e340 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:02.033000 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b8805-eee7-4769-96e9-9d55e38a6e02 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:02.067559 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4773c4-088d-4afc-abc1-c42fa76d7c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:02.068488 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4773c4-088d-4afc-abc1-c42fa76d7c57 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:02.068845 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4773c4-088d-4afc-abc1-c42fa76d7c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:02.069197 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4773c4-088d-4afc-abc1-c42fa76d7c57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:02.076177 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4773c4-088d-4afc-abc1-c42fa76d7c57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:02.077650 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4773c4-088d-4afc-abc1-c42fa76d7c57 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:02.092144 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-fd4773c4-088d-4afc-abc1-c42fa76d7c57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:59:02.092144 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:02.092144 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:02.092144 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:02.092144 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:02.092144 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:02.092144 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:02.092144 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:02.092144 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:02.092144 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:02.092144 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:02.092144 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:02.092144 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 03:59:02.092144 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 03:59:02.092144 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 03:59:02.093200 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 03:59:02.093200 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:02.093200 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:02.093200 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:02.093200 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:02.093200 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:02.093200 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:02.093200 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:02.093200 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:02.093200 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:02.093200 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:02.093200 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:02.093200 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:02.093200 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:02.093200 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:02.093200 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:02.093200 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:02.094142 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 03:59:02.094142 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 03:59:02.094142 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 03:59:02.094142 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 03:59:02.094142 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 03:59:02.094142 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 03:59:02.094142 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:59:02.094142 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:59:02.094142 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 475/941] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:59:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:59:02.094683 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4773c4-088d-4afc-abc1-c42fa76d7c57 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:02.134822 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050b12e-9dd6-4748-8f3e-2f8e25d4e340 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:02.171159 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4968611-8242-405b-9333-75c18e63f185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:02.171829 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4968611-8242-405b-9333-75c18e63f185 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:02.172116 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4968611-8242-405b-9333-75c18e63f185 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:02.172394 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4968611-8242-405b-9333-75c18e63f185 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:02.173120 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4968611-8242-405b-9333-75c18e63f185 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:02.173422 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4968611-8242-405b-9333-75c18e63f185 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:02.174861 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4968611-8242-405b-9333-75c18e63f185 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:02.191806 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 467/942] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:59:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:02.191806 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4968611-8242-405b-9333-75c18e63f185 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:02.192051 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:02.200530 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4773c4-088d-4afc-abc1-c42fa76d7c57 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:02.215319 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:02.242410 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc477d1-03c6-43c0-ad2c-06b0a515c2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:02.243098 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc477d1-03c6-43c0-ad2c-06b0a515c2d2 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:02.243385 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc477d1-03c6-43c0-ad2c-06b0a515c2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:02.243665 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc477d1-03c6-43c0-ad2c-06b0a515c2d2 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:02.244385 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc477d1-03c6-43c0-ad2c-06b0a515c2d2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:02.244697 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc477d1-03c6-43c0-ad2c-06b0a515c2d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:02.246095 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc477d1-03c6-43c0-ad2c-06b0a515c2d2 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:02.251866 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 476/943] 10.222.0.49 () {56 vars in 1122 bytes} [Mon Jul 4 03:59:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:02.252521 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc477d1-03c6-43c0-ad2c-06b0a515c2d2 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:02.307874 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4968611-8242-405b-9333-75c18e63f185 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:02.347623 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b5058-3d10-488b-83bd-52dc3df05281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:02.348208 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b5058-3d10-488b-83bd-52dc3df05281 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:02.348493 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b5058-3d10-488b-83bd-52dc3df05281 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:02.348773 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b5058-3d10-488b-83bd-52dc3df05281 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:02.349565 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b5058-3d10-488b-83bd-52dc3df05281 None admin] RBAC: Adding query filter params (name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:02.350028 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b5058-3d10-488b-83bd-52dc3df05281 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:02.351361 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b5058-3d10-488b-83bd-52dc3df05281 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:02.358798 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc477d1-03c6-43c0-ad2c-06b0a515c2d2 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:02.378201 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 468/944] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Jul 4 03:59:02 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:02.378201 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b5058-3d10-488b-83bd-52dc3df05281 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:02.412866 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993d689-5f91-46dc-9b38-3386ac2f3ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:02.413787 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993d689-5f91-46dc-9b38-3386ac2f3ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:02.414365 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993d689-5f91-46dc-9b38-3386ac2f3ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:02.414721 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993d689-5f91-46dc-9b38-3386ac2f3ed1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:02.424866 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2993d689-5f91-46dc-9b38-3386ac2f3ed1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:02.427443 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2993d689-5f91-46dc-9b38-3386ac2f3ed1 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:02.446368 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-2993d689-5f91-46dc-9b38-3386ac2f3ed1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:59:02.446368 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:02.446368 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:02.446368 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:02.446368 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:02.446368 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:02.446368 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:02.446368 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:02.446368 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:02.446368 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:02.446368 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:02.446368 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:02.446368 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 03:59:02.446368 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 03:59:02.446368 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 03:59:02.447532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 03:59:02.447532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:02.447532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:02.447532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:02.447532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:02.447532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:02.447532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:02.447532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:02.447532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:02.447532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:02.447532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:02.447532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:02.447532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:02.447532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:02.447532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:02.447532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:02.447532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:02.448465 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 03:59:02.448465 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 03:59:02.448465 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 03:59:02.448465 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 03:59:02.448465 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 03:59:02.448465 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 03:59:02.448465 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:59:02.448465 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:59:02.450039 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 477/945] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:59:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:59:02.455147 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993d689-5f91-46dc-9b38-3386ac2f3ed1 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:02.483500 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:02.486911 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:02.511042 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b5058-3d10-488b-83bd-52dc3df05281 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:02.556558 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d451d-04d4-4167-90f1-1d166deb1319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:02.557233 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d451d-04d4-4167-90f1-1d166deb1319 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:02.557518 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d451d-04d4-4167-90f1-1d166deb1319 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:02.557797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d451d-04d4-4167-90f1-1d166deb1319 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:02.559811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d451d-04d4-4167-90f1-1d166deb1319 None admin] RBAC: Adding query filter params (interface=public, service_id=558e725bd95d468287128433d718bd13, region_id=RegionOne) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:02.559811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d451d-04d4-4167-90f1-1d166deb1319 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:02.560678 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d451d-04d4-4167-90f1-1d166deb1319 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:02.567738 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 469/946] 10.222.0.49 () {56 vars in 1251 bytes} [Mon Jul 4 03:59:02 2022] GET /identity/v3/endpoints?service_id=558e725bd95d468287128433d718bd13&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:02.573210 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d451d-04d4-4167-90f1-1d166deb1319 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:02.609121 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993d689-5f91-46dc-9b38-3386ac2f3ed1 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:02.649409 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97428342-8aed-48f4-81d2-099d10e6d5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:02.650080 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97428342-8aed-48f4-81d2-099d10e6d5a6 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:02.650400 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97428342-8aed-48f4-81d2-099d10e6d5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:02.650679 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97428342-8aed-48f4-81d2-099d10e6d5a6 None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:02.651481 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97428342-8aed-48f4-81d2-099d10e6d5a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:02.651891 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97428342-8aed-48f4-81d2-099d10e6d5a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:02.653241 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97428342-8aed-48f4-81d2-099d10e6d5a6 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:02.667286 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 478/947] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Jul 4 03:59:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:59:02.673050 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97428342-8aed-48f4-81d2-099d10e6d5a6 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:02.690649 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d451d-04d4-4167-90f1-1d166deb1319 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:02.728240 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31b68f-a534-476d-81f9-41c4cf435e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:02.729290 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31b68f-a534-476d-81f9-41c4cf435e00 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:02.729579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31b68f-a534-476d-81f9-41c4cf435e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:02.729858 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31b68f-a534-476d-81f9-41c4cf435e00 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:02.730585 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec31b68f-a534-476d-81f9-41c4cf435e00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:02.732561 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec31b68f-a534-476d-81f9-41c4cf435e00 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:02.742522 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 470/948] 10.222.0.49 () {56 vars in 1087 bytes} [Mon Jul 4 03:59:02 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 03:59:02.762504 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:02.792696 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97428342-8aed-48f4-81d2-099d10e6d5a6 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:02.832251 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a9396-29c3-4e3e-a2ac-47407c8ec230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:02.833236 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a9396-29c3-4e3e-a2ac-47407c8ec230 None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:02.833518 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a9396-29c3-4e3e-a2ac-47407c8ec230 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:02.833882 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a9396-29c3-4e3e-a2ac-47407c8ec230 None admin] PATH_INFO: `/v3/projects/424a145a22434ef7a14b6108e6118ccb/users/03e7f908f0a7499792e59e31d497edb7/roles/bc829c0c3f7b402c930a7f1d58b27331` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:02.836266 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a9396-29c3-4e3e-a2ac-47407c8ec230 None admin] RBAC: Authorizing `identity:create_grant(project_id=424a145a22434ef7a14b6108e6118ccb, user_id=03e7f908f0a7499792e59e31d497edb7, role_id=bc829c0c3f7b402c930a7f1d58b27331)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:02.837733 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a9396-29c3-4e3e-a2ac-47407c8ec230 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:02.854973 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 479/949] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Jul 4 03:59:02 2022] PUT /identity/v3/projects/424a145a22434ef7a14b6108e6118ccb/users/03e7f908f0a7499792e59e31d497edb7/roles/bc829c0c3f7b402c930a7f1d58b27331 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 03:59:03.674720 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3a6ff-48c8-44a2-aaf5-086dbf467014 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:03.675374 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3a6ff-48c8-44a2-aaf5-086dbf467014 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:03.675374 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3a6ff-48c8-44a2-aaf5-086dbf467014 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:03.677004 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 471/950] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:59:03.682352 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c0e0b-4ade-431c-8463-2a940fd30bdb None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:03.682846 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c0e0b-4ade-431c-8463-2a940fd30bdb None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:03.683015 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c0e0b-4ade-431c-8463-2a940fd30bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:03.699941 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-858c0e0b-4ade-431c-8463-2a940fd30bdb None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:59:03.701120 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-858c0e0b-4ade-431c-8463-2a940fd30bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:59:03.769257 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 480/951] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:59:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 03:59:03.792782 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3a6ff-48c8-44a2-aaf5-086dbf467014 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:03.803960 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:03.899591 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3a6ff-48c8-44a2-aaf5-086dbf467014 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:03.936963 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99ab76-0bd5-4b95-b257-21be16a04747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:03.937697 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99ab76-0bd5-4b95-b257-21be16a04747 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:03.937986 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99ab76-0bd5-4b95-b257-21be16a04747 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:03.938295 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99ab76-0bd5-4b95-b257-21be16a04747 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:03.939071 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99ab76-0bd5-4b95-b257-21be16a04747 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:03.941071 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99ab76-0bd5-4b95-b257-21be16a04747 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:03.954744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-1f99ab76-0bd5-4b95-b257-21be16a04747 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 03:59:03.954744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:03.954744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 03:59:03.954744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 03:59:03.954744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 03:59:03.954744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 03:59:03.954744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 03:59:03.954744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:59:03.954744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 03:59:03.954744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:03.954744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 03:59:03.954744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:03.954744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:03.954744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:03.954744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:03.954744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:03.954744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:03.955854 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:03.955854 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:03.955854 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:03.955854 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:03.955854 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:03.955854 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:03.955854 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 03:59:03.955854 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 03:59:03.955854 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 03:59:03.955854 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 03:59:03.955854 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:03.955854 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:03.955854 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:03.955854 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:03.955854 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:03.955854 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:03.957328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:03.957328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:03.957328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:03.957328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:03.957328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:03.957328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:03.957328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:03.957328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:03.957328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:03.957328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:03.957328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 03:59:03.957328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:59:03.957328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 03:59:03.957328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:03.957328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 472/952] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:59:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:59:03.962024 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c0e0b-4ade-431c-8463-2a940fd30bdb None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:04.034048 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:04.074229 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c0e0b-4ade-431c-8463-2a940fd30bdb None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:04.109157 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21105e04-99e2-45ed-9627-7d61460e316b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:04.109837 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21105e04-99e2-45ed-9627-7d61460e316b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:04.110133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21105e04-99e2-45ed-9627-7d61460e316b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:04.110448 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21105e04-99e2-45ed-9627-7d61460e316b None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:04.111436 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21105e04-99e2-45ed-9627-7d61460e316b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:04.111752 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21105e04-99e2-45ed-9627-7d61460e316b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:04.113144 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21105e04-99e2-45ed-9627-7d61460e316b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:04.118332 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 481/953] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Jul 4 03:59:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:04.127246 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99ab76-0bd5-4b95-b257-21be16a04747 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:04.197092 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:04.228658 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99ab76-0bd5-4b95-b257-21be16a04747 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:04.268348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc69055-73f8-425d-a09b-5311e8d902b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:04.269348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc69055-73f8-425d-a09b-5311e8d902b8 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:04.269792 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc69055-73f8-425d-a09b-5311e8d902b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:04.270270 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc69055-73f8-425d-a09b-5311e8d902b8 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:04.271143 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc69055-73f8-425d-a09b-5311e8d902b8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:04.271636 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc69055-73f8-425d-a09b-5311e8d902b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:04.273200 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc69055-73f8-425d-a09b-5311e8d902b8 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:04.278592 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 473/954] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Jul 4 03:59:04 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:04.615541 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e26407-e7f2-4bce-9491-97009f64993d None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:04.615744 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e26407-e7f2-4bce-9491-97009f64993d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:04.616025 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e26407-e7f2-4bce-9491-97009f64993d None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:04.617830 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 482/955] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:59:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:59:04.623891 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc6305-d767-4cae-a017-6b73dd73b15b None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:04.624323 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc6305-d767-4cae-a017-6b73dd73b15b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:04.624743 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc6305-d767-4cae-a017-6b73dd73b15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:04.643158 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-1afc6305-d767-4cae-a017-6b73dd73b15b None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:59:04.644691 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1afc6305-d767-4cae-a017-6b73dd73b15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:59:04.713847 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 474/956] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:59:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 03:59:04.738752 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e26407-e7f2-4bce-9491-97009f64993d None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:04.843973 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e26407-e7f2-4bce-9491-97009f64993d None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:04.863043 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa49b17-a85a-48a9-8b7d-522c758499f1 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:04.863665 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa49b17-a85a-48a9-8b7d-522c758499f1 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:04.864155 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa49b17-a85a-48a9-8b7d-522c758499f1 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:04.869542 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 475/957] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:59:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 03:59:04.871243 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf6ed3-47b5-40bc-b6b9-b8753bb45465 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:04.871762 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf6ed3-47b5-40bc-b6b9-b8753bb45465 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:04.872245 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf6ed3-47b5-40bc-b6b9-b8753bb45465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:04.872794 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:04.882670 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f93033-07a3-4a8a-95f2-c66d31158b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:04.883349 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f93033-07a3-4a8a-95f2-c66d31158b7b None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:04.883639 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f93033-07a3-4a8a-95f2-c66d31158b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:04.883919 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f93033-07a3-4a8a-95f2-c66d31158b7b None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:04.884646 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f93033-07a3-4a8a-95f2-c66d31158b7b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:04.886449 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f93033-07a3-4a8a-95f2-c66d31158b7b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:04.888264 dv-cinder-742162-5-smb devstack@keystone.service[80362]: WARNING keystone.server.flask.common [None req-82f93033-07a3-4a8a-95f2-c66d31158b7b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 04 03:59:04.893486 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-58bf6ed3-47b5-40bc-b6b9-b8753bb45465 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:59:04.894962 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-58bf6ed3-47b5-40bc-b6b9-b8753bb45465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:59:04.903318 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.sql.core [None req-82f93033-07a3-4a8a-95f2-c66d31158b7b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 04 03:59:04.903318 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 04 03:59:04.903318 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [parameters: {'user_id': '391447ae6af5456f8401c4406946c663', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 04 03:59:04.903318 dv-cinder-742162-5-smb devstack@keystone.service[80362]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80362) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 04 03:59:04.924333 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-82f93033-07a3-4a8a-95f2-c66d31158b7b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 04 03:59:04.924333 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:04.924333 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 04 03:59:04.924333 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 04 03:59:04.924333 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 04 03:59:04.924333 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 04 03:59:04.924333 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 04 03:59:04.924333 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application result = self._query(query) Jul 04 03:59:04.924333 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 04 03:59:04.924333 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application conn.query(q) Jul 04 03:59:04.924333 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 04 03:59:04.924333 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 04 03:59:04.924333 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 04 03:59:04.924333 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application result.read() Jul 04 03:59:04.924333 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 04 03:59:04.925378 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 04 03:59:04.925378 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 04 03:59:04.925378 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 04 03:59:04.925378 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 04 03:59:04.925378 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 04 03:59:04.925378 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 04 03:59:04.925378 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 04 03:59:04.925378 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 04 03:59:04.925378 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:59:04.925378 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 04 03:59:04.925378 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:59:04.925378 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:04.925378 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 04 03:59:04.925378 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 04 03:59:04.925378 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 04 03:59:04.925378 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 04 03:59:04.925378 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 04 03:59:04.925378 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application next(self.gen) Jul 04 03:59:04.926925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 04 03:59:04.926925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application yield resource Jul 04 03:59:04.926925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 04 03:59:04.926925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application next(self.gen) Jul 04 03:59:04.926925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 04 03:59:04.926925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self.session.rollback() Jul 04 03:59:04.926925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 04 03:59:04.926925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self.force_reraise() Jul 04 03:59:04.926925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 04 03:59:04.926925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise self.value Jul 04 03:59:04.926925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 04 03:59:04.926925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 04 03:59:04.926925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 04 03:59:04.926925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application session.commit() Jul 04 03:59:04.926925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 04 03:59:04.926925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 04 03:59:04.926925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 04 03:59:04.928114 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._prepare_impl() Jul 04 03:59:04.928114 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 04 03:59:04.928114 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self.session.flush() Jul 04 03:59:04.928114 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 04 03:59:04.928114 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._flush(objects) Jul 04 03:59:04.928114 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 04 03:59:04.928114 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 04 03:59:04.928114 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 04 03:59:04.928114 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application compat.raise_( Jul 04 03:59:04.928114 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 04 03:59:04.928114 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception Jul 04 03:59:04.928114 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 04 03:59:04.928114 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application flush_context.execute() Jul 04 03:59:04.928114 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 04 03:59:04.928114 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rec.execute(self) Jul 04 03:59:04.928114 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 04 03:59:04.928114 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 04 03:59:04.929971 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 04 03:59:04.929971 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 04 03:59:04.929971 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 04 03:59:04.929971 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 04 03:59:04.929971 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 04 03:59:04.929971 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 04 03:59:04.929971 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 04 03:59:04.929971 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 04 03:59:04.929971 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 04 03:59:04.929971 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 04 03:59:04.929971 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 04 03:59:04.929971 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 04 03:59:04.929971 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 04 03:59:04.929971 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 04 03:59:04.929971 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 04 03:59:04.929971 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception Jul 04 03:59:04.932087 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 04 03:59:04.932087 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 04 03:59:04.932087 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 04 03:59:04.932087 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 04 03:59:04.932087 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 04 03:59:04.932087 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application result = self._query(query) Jul 04 03:59:04.932087 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 04 03:59:04.932087 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application conn.query(q) Jul 04 03:59:04.932087 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 04 03:59:04.932087 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 04 03:59:04.932087 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 04 03:59:04.932087 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application result.read() Jul 04 03:59:04.932087 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 04 03:59:04.932087 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 04 03:59:04.932087 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 04 03:59:04.932087 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 04 03:59:04.934079 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 04 03:59:04.934079 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 04 03:59:04.934079 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 04 03:59:04.934079 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 04 03:59:04.934079 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 04 03:59:04.934079 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 04 03:59:04.934079 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [parameters: {'user_id': '391447ae6af5456f8401c4406946c663', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 04 03:59:04.934079 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 04 03:59:04.934079 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:59:04.934079 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 03:59:04.934079 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:59:04.934079 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:04.934079 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:04.934079 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:04.934079 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:04.936277 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:04.936277 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:04.936277 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:04.936277 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:04.936277 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:04.936277 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:04.936277 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:04.936277 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 04 03:59:04.936277 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 04 03:59:04.936277 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:04.936277 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:04.936277 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 03:59:04.936277 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:59:04.936277 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 03:59:04.936277 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:59:04.936277 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 04 03:59:04.936277 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 04 03:59:04.939122 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 04 03:59:04.939122 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 04 03:59:04.939122 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 04 03:59:04.939122 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 04 03:59:04.939122 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 04 03:59:04.939122 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:59:04.939122 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 483/958] 10.222.0.49 () {60 vars in 1131 bytes} [Mon Jul 4 03:59:04 2022] POST /identity/v3/users => generated 160 bytes in 188 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:59:04.939122 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a0c0a-03c2-4f56-9750-4025962f9f88 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:04.939122 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a0c0a-03c2-4f56-9750-4025962f9f88 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:04.939122 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a0c0a-03c2-4f56-9750-4025962f9f88 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:04.940644 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 484/959] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:59:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:59:04.940644 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a0c0a-03c2-4f56-9750-4025962f9f88 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:04.977242 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:04.990295 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 476/960] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:59:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 03:59:04.991883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3316b-ea08-4195-9cf7-dc290617d249 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:04.992539 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3316b-ea08-4195-9cf7-dc290617d249 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:04.992826 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3316b-ea08-4195-9cf7-dc290617d249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:05.011227 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-80b3316b-ea08-4195-9cf7-dc290617d249 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:59:05.012422 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-80b3316b-ea08-4195-9cf7-dc290617d249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:59:05.056716 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a0c0a-03c2-4f56-9750-4025962f9f88 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:05.083688 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 477/961] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:59:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 03:59:05.084900 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3316b-ea08-4195-9cf7-dc290617d249 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:05.100613 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3c7a4-c286-4048-979a-b0138d91d578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:05.102133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3c7a4-c286-4048-979a-b0138d91d578 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:05.102651 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3c7a4-c286-4048-979a-b0138d91d578 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:05.103556 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3c7a4-c286-4048-979a-b0138d91d578 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:05.112622 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3c7a4-c286-4048-979a-b0138d91d578 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:05.114238 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3c7a4-c286-4048-979a-b0138d91d578 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:05.128905 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-03a3c7a4-c286-4048-979a-b0138d91d578 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 04 03:59:05.128905 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:05.128905 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:05.128905 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:05.128905 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:05.128905 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:05.128905 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:05.128905 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:05.128905 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:05.128905 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:05.128905 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:05.128905 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:05.128905 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 03:59:05.128905 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 03:59:05.128905 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 03:59:05.128905 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 03:59:05.129901 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:05.129901 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:05.129901 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 03:59:05.129901 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:59:05.129901 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 03:59:05.129901 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:59:05.129901 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:05.129901 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:05.129901 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:05.129901 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:05.129901 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:05.129901 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:05.129901 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:05.129901 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:05.129901 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:05.129901 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:05.129901 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:05.129901 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:05.135222 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:05.135222 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:05.135222 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 03:59:05.135222 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 03:59:05.135222 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 03:59:05.135222 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 03:59:05.135222 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 03:59:05.135222 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 03:59:05.135222 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 04 03:59:05.135222 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:59:05.135222 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 485/962] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:59:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:59:05.135222 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3c7a4-c286-4048-979a-b0138d91d578 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:05.184426 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:05.205652 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3316b-ea08-4195-9cf7-dc290617d249 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:05.232328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:05.240841 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3c7a4-c286-4048-979a-b0138d91d578 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:05.242630 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4861f-8296-4817-9aa8-cfcee508b2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:05.243570 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4861f-8296-4817-9aa8-cfcee508b2e0 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:05.243948 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4861f-8296-4817-9aa8-cfcee508b2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:05.244313 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4861f-8296-4817-9aa8-cfcee508b2e0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:05.245062 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e4861f-8296-4817-9aa8-cfcee508b2e0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:05.246615 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e4861f-8296-4817-9aa8-cfcee508b2e0 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:05.258864 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-71e4861f-8296-4817-9aa8-cfcee508b2e0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 03:59:05.258864 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:05.258864 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 03:59:05.258864 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 03:59:05.258864 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 03:59:05.258864 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 03:59:05.258864 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 03:59:05.258864 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:59:05.258864 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 03:59:05.258864 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:05.258864 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 03:59:05.258864 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:05.258864 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:05.258864 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:05.258864 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:05.258864 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:05.258864 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:05.260194 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:05.260194 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:05.260194 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:05.260194 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:05.260194 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:05.260194 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:05.260194 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 03:59:05.260194 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 03:59:05.260194 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 03:59:05.260194 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 03:59:05.260194 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:05.260194 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:05.260194 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:05.260194 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:05.260194 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:05.260194 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:05.261636 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:05.261636 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:05.261636 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:05.261636 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:05.261636 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:05.261636 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:05.261636 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:05.261636 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:05.261636 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:05.261636 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:05.261636 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 03:59:05.261636 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:59:05.261636 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 03:59:05.261636 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:05.263411 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 478/963] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Jul 4 03:59:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:59:05.263793 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4861f-8296-4817-9aa8-cfcee508b2e0 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:05.282284 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f926d77-c5b6-488a-86a7-44ce491e1e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:05.283102 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f926d77-c5b6-488a-86a7-44ce491e1e62 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:05.283391 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f926d77-c5b6-488a-86a7-44ce491e1e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:05.283674 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f926d77-c5b6-488a-86a7-44ce491e1e62 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:05.294634 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f926d77-c5b6-488a-86a7-44ce491e1e62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:59:05.302857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-1f926d77-c5b6-488a-86a7-44ce491e1e62 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 03:59:05.302857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:05.302857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:05.302857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:05.302857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:05.302857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:05.302857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:05.302857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:05.302857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:05.302857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:05.302857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:05.302857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:05.302857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:59:05.302857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:59:05.302857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:59:05.302857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:59:05.303857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:59:05.303857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:59:05.303857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:59:05.303857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:59:05.303857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:05.303857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:05.303857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:05.303857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:05.303857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:05.303857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:05.303857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:05.303857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:05.303857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:05.303857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:05.303857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:05.303857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:05.304759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:05.304759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:05.304759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:05.304759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:05.304759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:59:05.304759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:59:05.304759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:59:05.304759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:59:05.304759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:59:05.304759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:59:05.304759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 03:59:05.304759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:59:05.304759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 486/964] 10.222.0.49 () {56 vars in 1120 bytes} [Mon Jul 4 03:59:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:59:05.305520 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f926d77-c5b6-488a-86a7-44ce491e1e62 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:05.374696 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4861f-8296-4817-9aa8-cfcee508b2e0 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:05.412558 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f926d77-c5b6-488a-86a7-44ce491e1e62 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:05.413173 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f51398-eb63-4f06-8c85-c15319d3e8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:05.413860 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f51398-eb63-4f06-8c85-c15319d3e8bb None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:05.414163 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f51398-eb63-4f06-8c85-c15319d3e8bb None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:05.414467 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f51398-eb63-4f06-8c85-c15319d3e8bb None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:05.415280 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f51398-eb63-4f06-8c85-c15319d3e8bb None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:05.416170 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f51398-eb63-4f06-8c85-c15319d3e8bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:05.417087 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f51398-eb63-4f06-8c85-c15319d3e8bb None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:05.424401 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:05.449779 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d5d8e-bcee-437d-af71-b0a70abf16de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:05.450484 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d5d8e-bcee-437d-af71-b0a70abf16de None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:05.450777 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d5d8e-bcee-437d-af71-b0a70abf16de None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:05.451061 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d5d8e-bcee-437d-af71-b0a70abf16de None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:05.451778 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d5d8e-bcee-437d-af71-b0a70abf16de None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:05.452100 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d5d8e-bcee-437d-af71-b0a70abf16de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:05.453238 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 479/965] 10.222.0.49 () {56 vars in 1101 bytes} [Mon Jul 4 03:59:05 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:05.454089 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f51398-eb63-4f06-8c85-c15319d3e8bb None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:05.462762 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d5d8e-bcee-437d-af71-b0a70abf16de None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:05.472165 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 487/966] 10.222.0.49 () {56 vars in 1122 bytes} [Mon Jul 4 03:59:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:05.478285 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d5d8e-bcee-437d-af71-b0a70abf16de None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:05.524795 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:05.590380 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f51398-eb63-4f06-8c85-c15319d3e8bb None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:05.612412 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d5d8e-bcee-437d-af71-b0a70abf16de None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:05.629169 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdbf44-0a54-434c-b028-4a25c0bdc0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:05.630183 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdbf44-0a54-434c-b028-4a25c0bdc0c6 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:05.630784 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdbf44-0a54-434c-b028-4a25c0bdc0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:05.631293 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdbf44-0a54-434c-b028-4a25c0bdc0c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:05.632063 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bdbf44-0a54-434c-b028-4a25c0bdc0c6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:05.632379 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bdbf44-0a54-434c-b028-4a25c0bdc0c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:05.633794 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bdbf44-0a54-434c-b028-4a25c0bdc0c6 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:05.643592 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 480/967] 10.222.0.49 () {56 vars in 1115 bytes} [Mon Jul 4 03:59:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:05.649590 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdbf44-0a54-434c-b028-4a25c0bdc0c6 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:05.651845 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7d336-1714-4c22-bcfe-0349b1acfa20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:05.652708 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7d336-1714-4c22-bcfe-0349b1acfa20 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:05.653053 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7d336-1714-4c22-bcfe-0349b1acfa20 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:05.653495 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7d336-1714-4c22-bcfe-0349b1acfa20 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:05.654447 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c7d336-1714-4c22-bcfe-0349b1acfa20 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:05.654845 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c7d336-1714-4c22-bcfe-0349b1acfa20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:05.656304 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c7d336-1714-4c22-bcfe-0349b1acfa20 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:05.664738 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 488/968] 10.222.0.49 () {56 vars in 1122 bytes} [Mon Jul 4 03:59:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:05.670626 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7d336-1714-4c22-bcfe-0349b1acfa20 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:05.719536 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:05.779075 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdbf44-0a54-434c-b028-4a25c0bdc0c6 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:05.785339 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7d336-1714-4c22-bcfe-0349b1acfa20 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:05.791439 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:05.818147 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ccdfa-a0dd-4887-a3d7-61a1f2454b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:05.819191 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ccdfa-a0dd-4887-a3d7-61a1f2454b37 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:05.819584 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ccdfa-a0dd-4887-a3d7-61a1f2454b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:05.819955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ccdfa-a0dd-4887-a3d7-61a1f2454b37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:05.821957 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43727c2c-6e1c-4f55-b4c0-51076ba10953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:05.822566 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43727c2c-6e1c-4f55-b4c0-51076ba10953 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:05.822855 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43727c2c-6e1c-4f55-b4c0-51076ba10953 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:05.823152 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43727c2c-6e1c-4f55-b4c0-51076ba10953 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:05.823908 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43727c2c-6e1c-4f55-b4c0-51076ba10953 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:05.825301 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43727c2c-6e1c-4f55-b4c0-51076ba10953 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:05.832111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ccdfa-a0dd-4887-a3d7-61a1f2454b37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:05.833920 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ccdfa-a0dd-4887-a3d7-61a1f2454b37 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:05.844911 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 489/969] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Jul 4 03:59:05 2022] POST /identity/v3/endpoints => generated 349 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 03:59:05.852278 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-806ccdfa-a0dd-4887-a3d7-61a1f2454b37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:59:05.852278 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:05.852278 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:05.852278 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:05.852278 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:05.852278 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:05.852278 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:05.852278 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:05.852278 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:05.852278 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:05.852278 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:05.852278 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:05.852278 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:59:05.852278 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:59:05.852278 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:59:05.853463 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:59:05.853463 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:05.853463 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:05.853463 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:05.853463 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:05.853463 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:05.853463 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:05.853463 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:05.853463 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:05.853463 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:05.853463 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:05.853463 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:05.853463 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:05.853463 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:05.853463 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:05.853463 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:05.853463 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:05.854611 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:59:05.854611 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:59:05.854611 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:59:05.854611 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:05.855327 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 481/970] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:59:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:59:05.861056 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43727c2c-6e1c-4f55-b4c0-51076ba10953 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:05.970840 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:05.987414 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43727c2c-6e1c-4f55-b4c0-51076ba10953 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:06.027526 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80edbd63-274e-43e0-80a2-c904c10242a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:06.028325 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edbd63-274e-43e0-80a2-c904c10242a0 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:06.028680 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edbd63-274e-43e0-80a2-c904c10242a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:06.029002 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80edbd63-274e-43e0-80a2-c904c10242a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:06.029839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80edbd63-274e-43e0-80a2-c904c10242a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:06.030225 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80edbd63-274e-43e0-80a2-c904c10242a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:06.031701 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80edbd63-274e-43e0-80a2-c904c10242a0 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:06.044377 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 490/971] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:06.050302 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ccdfa-a0dd-4887-a3d7-61a1f2454b37 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:06.153729 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ccdfa-a0dd-4887-a3d7-61a1f2454b37 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:06.187778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b00df-0856-42d9-97b8-73efe1146112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:06.188759 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b00df-0856-42d9-97b8-73efe1146112 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:06.189153 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b00df-0856-42d9-97b8-73efe1146112 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:06.189551 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b00df-0856-42d9-97b8-73efe1146112 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:06.197686 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b00df-0856-42d9-97b8-73efe1146112 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:06.199318 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b00df-0856-42d9-97b8-73efe1146112 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:06.214341 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-ec3b00df-0856-42d9-97b8-73efe1146112 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 03:59:06.214341 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:06.214341 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:06.214341 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:06.214341 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:06.214341 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:06.214341 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:06.214341 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:06.214341 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:06.214341 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:06.214341 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:06.214341 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:06.214341 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 03:59:06.214341 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 03:59:06.214341 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 03:59:06.214341 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 03:59:06.215531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:06.215531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:06.215531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 03:59:06.215531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:59:06.215531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 03:59:06.215531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:59:06.215531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:06.215531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:06.215531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:06.215531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:06.215531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:06.215531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:06.215531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:06.215531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:06.215531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:06.215531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:06.215531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:06.215531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:06.216727 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:06.216727 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:06.216727 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 03:59:06.216727 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 03:59:06.216727 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 03:59:06.216727 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 03:59:06.216727 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 03:59:06.216727 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 03:59:06.216727 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 04 03:59:06.216727 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:06.218491 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 482/972] 10.222.0.49 () {56 vars in 1117 bytes} [Mon Jul 4 03:59:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:59:06.224431 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80edbd63-274e-43e0-80a2-c904c10242a0 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:06.309810 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca518094-b377-4e5e-8cd0-bf690e94f6bc None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:06.310293 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca518094-b377-4e5e-8cd0-bf690e94f6bc None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:06.310689 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca518094-b377-4e5e-8cd0-bf690e94f6bc None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:06.312453 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 483/973] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:59:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:59:06.317064 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74cba47-57e8-4b7c-a6a9-c860dab2e9f1 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:06.317453 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74cba47-57e8-4b7c-a6a9-c860dab2e9f1 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:06.317849 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74cba47-57e8-4b7c-a6a9-c860dab2e9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:06.331405 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80edbd63-274e-43e0-80a2-c904c10242a0 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:06.340709 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-f74cba47-57e8-4b7c-a6a9-c860dab2e9f1 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:59:06.342524 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f74cba47-57e8-4b7c-a6a9-c860dab2e9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:59:06.366029 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:06.370767 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11092772-b8e6-4416-85df-b871d16ec5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:06.371447 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11092772-b8e6-4416-85df-b871d16ec5e6 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:06.371727 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11092772-b8e6-4416-85df-b871d16ec5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:06.371996 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11092772-b8e6-4416-85df-b871d16ec5e6 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:06.372850 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11092772-b8e6-4416-85df-b871d16ec5e6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:06.373157 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11092772-b8e6-4416-85df-b871d16ec5e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:06.374657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11092772-b8e6-4416-85df-b871d16ec5e6 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:06.393636 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 491/974] 10.222.0.49 () {56 vars in 1149 bytes} [Mon Jul 4 03:59:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:59:06.399693 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11092772-b8e6-4416-85df-b871d16ec5e6 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:06.411126 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:06.434186 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 484/975] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:59:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 03:59:06.450854 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74cba47-57e8-4b7c-a6a9-c860dab2e9f1 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:06.504583 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11092772-b8e6-4416-85df-b871d16ec5e6 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:06.541459 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef30764-cbcf-4418-8719-329f29509865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:06.542113 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef30764-cbcf-4418-8719-329f29509865 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:06.542427 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef30764-cbcf-4418-8719-329f29509865 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:06.542700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef30764-cbcf-4418-8719-329f29509865 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:06.556399 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74cba47-57e8-4b7c-a6a9-c860dab2e9f1 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:06.594668 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a05a0d-c49c-4b8e-b6ca-c1f6c1d0d480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:06.595358 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a05a0d-c49c-4b8e-b6ca-c1f6c1d0d480 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:06.595674 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a05a0d-c49c-4b8e-b6ca-c1f6c1d0d480 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:06.595949 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a05a0d-c49c-4b8e-b6ca-c1f6c1d0d480 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:06.596663 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a05a0d-c49c-4b8e-b6ca-c1f6c1d0d480 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:06.598069 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a05a0d-c49c-4b8e-b6ca-c1f6c1d0d480 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:06.610986 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef30764-cbcf-4418-8719-329f29509865 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:06.612442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef30764-cbcf-4418-8719-329f29509865 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:06.613265 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 485/976] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Jul 4 03:59:06 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 03:59:06.624877 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:06.736004 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 492/977] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:59:06 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 04 03:59:06.741916 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a05a0d-c49c-4b8e-b6ca-c1f6c1d0d480 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:06.758622 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:06.857797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a05a0d-c49c-4b8e-b6ca-c1f6c1d0d480 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:06.892455 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5d595-2d95-4ea6-b6a8-2ef406647d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:06.893264 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5d595-2d95-4ea6-b6a8-2ef406647d60 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:06.893524 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5d595-2d95-4ea6-b6a8-2ef406647d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:06.893817 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5d595-2d95-4ea6-b6a8-2ef406647d60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:06.904925 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b5d595-2d95-4ea6-b6a8-2ef406647d60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:06.906432 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b5d595-2d95-4ea6-b6a8-2ef406647d60 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:06.923574 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-27b5d595-2d95-4ea6-b6a8-2ef406647d60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:59:06.923574 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:06.923574 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:06.923574 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:06.923574 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:06.923574 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:06.923574 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:06.923574 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:06.923574 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:06.923574 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:06.923574 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:06.923574 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:06.923574 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:59:06.923574 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:59:06.923574 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:59:06.924510 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:59:06.924510 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:06.924510 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:06.924510 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:06.924510 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:06.924510 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:06.924510 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:06.924510 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:06.924510 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:06.924510 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:06.924510 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:06.924510 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:06.924510 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:06.924510 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:06.924510 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:06.924510 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:06.924510 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:06.930394 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:59:06.930394 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:59:06.930394 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:59:06.930394 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:06.930394 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 486/978] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:59:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:59:06.932337 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef30764-cbcf-4418-8719-329f29509865 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:07.041704 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef30764-cbcf-4418-8719-329f29509865 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:07.051377 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:07.078948 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568f699-3816-483a-b940-1d0b1cbac442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:07.079623 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568f699-3816-483a-b940-1d0b1cbac442 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:07.079910 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568f699-3816-483a-b940-1d0b1cbac442 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:07.080190 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568f699-3816-483a-b940-1d0b1cbac442 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:07.080921 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568f699-3816-483a-b940-1d0b1cbac442 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:07.081233 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568f699-3816-483a-b940-1d0b1cbac442 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:07.082665 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568f699-3816-483a-b940-1d0b1cbac442 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:07.095614 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 493/979] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:07.100578 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5d595-2d95-4ea6-b6a8-2ef406647d60 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:07.166288 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:07.209289 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5d595-2d95-4ea6-b6a8-2ef406647d60 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:07.245011 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234227a-b4d6-4b0b-a89f-5c9671574dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:07.245831 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234227a-b4d6-4b0b-a89f-5c9671574dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:07.246120 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234227a-b4d6-4b0b-a89f-5c9671574dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:07.246432 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234227a-b4d6-4b0b-a89f-5c9671574dd9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:07.253915 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234227a-b4d6-4b0b-a89f-5c9671574dd9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:07.256086 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234227a-b4d6-4b0b-a89f-5c9671574dd9 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:07.272811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-1234227a-b4d6-4b0b-a89f-5c9671574dd9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:59:07.272811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:07.272811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:07.272811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:07.272811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:07.272811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:07.272811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:07.272811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:07.272811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:07.272811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:07.272811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:07.272811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:07.272811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 03:59:07.272811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 03:59:07.272811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 03:59:07.273759 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 03:59:07.273759 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:07.273759 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:07.273759 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:07.273759 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:07.273759 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:07.273759 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:07.273759 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:07.273759 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:07.273759 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:07.273759 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:07.273759 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:07.273759 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:07.273759 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:07.273759 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:07.273759 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:07.273759 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:07.274712 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 03:59:07.274712 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 03:59:07.274712 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 03:59:07.274712 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 03:59:07.274712 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 03:59:07.274712 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 03:59:07.274712 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:59:07.274712 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:07.274712 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 487/980] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:59:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:59:07.281235 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568f699-3816-483a-b940-1d0b1cbac442 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:07.386583 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568f699-3816-483a-b940-1d0b1cbac442 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:07.420441 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5dcad-0d0e-4ff3-83df-15f88b9bba04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:07.421241 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5dcad-0d0e-4ff3-83df-15f88b9bba04 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:07.421536 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5dcad-0d0e-4ff3-83df-15f88b9bba04 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:07.421818 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5dcad-0d0e-4ff3-83df-15f88b9bba04 None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:07.422662 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5dcad-0d0e-4ff3-83df-15f88b9bba04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:07.422984 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5dcad-0d0e-4ff3-83df-15f88b9bba04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:07.424443 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5dcad-0d0e-4ff3-83df-15f88b9bba04 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:07.437012 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 494/981] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Jul 4 03:59:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:59:07.442975 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234227a-b4d6-4b0b-a89f-5c9671574dd9 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:07.548983 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234227a-b4d6-4b0b-a89f-5c9671574dd9 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:07.569724 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:07.585509 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b441021-fe47-442c-9fa4-8d9f62b70afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:07.586280 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b441021-fe47-442c-9fa4-8d9f62b70afa None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:07.586587 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b441021-fe47-442c-9fa4-8d9f62b70afa None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:07.586863 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b441021-fe47-442c-9fa4-8d9f62b70afa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:07.587721 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b441021-fe47-442c-9fa4-8d9f62b70afa None admin] RBAC: Adding query filter params (role.id=bc829c0c3f7b402c930a7f1d58b27331, scope.project.id=424a145a22434ef7a14b6108e6118ccb, user.id=03e7f908f0a7499792e59e31d497edb7) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:07.588039 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b441021-fe47-442c-9fa4-8d9f62b70afa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:07.589512 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b441021-fe47-442c-9fa4-8d9f62b70afa None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:07.596002 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 488/982] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:59:07 2022] GET /identity/v3/role_assignments?user.id=03e7f908f0a7499792e59e31d497edb7&scope.project.id=424a145a22434ef7a14b6108e6118ccb&role.id=bc829c0c3f7b402c930a7f1d58b27331 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:07.915051 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbcc99-4cdf-4095-8f81-02cda0b4c03b None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:07.915430 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbcc99-4cdf-4095-8f81-02cda0b4c03b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:07.915633 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbcc99-4cdf-4095-8f81-02cda0b4c03b None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:07.917214 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 495/983] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:59:07.922764 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac57494-5f04-46da-aee7-846d868273c6 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:07.923227 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac57494-5f04-46da-aee7-846d868273c6 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:07.923303 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac57494-5f04-46da-aee7-846d868273c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:07.940857 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-8ac57494-5f04-46da-aee7-846d868273c6 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:59:07.942054 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-8ac57494-5f04-46da-aee7-846d868273c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:59:08.019767 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 489/984] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:59:07 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 03:59:08.042641 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbcc99-4cdf-4095-8f81-02cda0b4c03b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:08.073655 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:08.150325 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbcc99-4cdf-4095-8f81-02cda0b4c03b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:08.184089 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634ea33-dd1c-4046-913a-f711e30f2090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:08.184808 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634ea33-dd1c-4046-913a-f711e30f2090 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:08.185090 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634ea33-dd1c-4046-913a-f711e30f2090 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:08.185362 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634ea33-dd1c-4046-913a-f711e30f2090 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:08.186013 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9634ea33-dd1c-4046-913a-f711e30f2090 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:08.187431 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9634ea33-dd1c-4046-913a-f711e30f2090 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:08.199485 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-9634ea33-dd1c-4046-913a-f711e30f2090 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 03:59:08.199485 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:08.199485 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 03:59:08.199485 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 03:59:08.199485 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 03:59:08.199485 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 03:59:08.199485 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 03:59:08.199485 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:59:08.199485 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 03:59:08.199485 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:59:08.199485 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 03:59:08.199485 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:59:08.199485 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:08.199485 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:08.199485 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:08.199485 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:08.199485 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:08.200476 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:08.200476 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:08.200476 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:08.200476 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:08.200476 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:08.200476 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:08.200476 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 03:59:08.200476 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 03:59:08.200476 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 03:59:08.200476 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 03:59:08.200476 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:08.200476 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:08.200476 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:08.200476 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:08.200476 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:08.200476 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:08.201313 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:08.201313 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:08.201313 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:08.201313 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:08.201313 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:08.201313 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:08.201313 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:08.201313 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:08.201313 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:08.201313 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:08.201313 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 03:59:08.201313 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:59:08.201313 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 03:59:08.201313 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:59:08.201313 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 496/985] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Jul 4 03:59:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:59:08.208595 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac57494-5f04-46da-aee7-846d868273c6 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:08.311796 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac57494-5f04-46da-aee7-846d868273c6 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:08.327317 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:08.348623 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891aa231-dec5-473a-9294-ba550c383c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:08.349353 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891aa231-dec5-473a-9294-ba550c383c90 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:08.349637 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891aa231-dec5-473a-9294-ba550c383c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:08.349914 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891aa231-dec5-473a-9294-ba550c383c90 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:08.350662 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891aa231-dec5-473a-9294-ba550c383c90 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:08.350977 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891aa231-dec5-473a-9294-ba550c383c90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:08.352381 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891aa231-dec5-473a-9294-ba550c383c90 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:08.357585 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 490/986] 10.222.0.49 () {56 vars in 1122 bytes} [Mon Jul 4 03:59:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:08.363205 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634ea33-dd1c-4046-913a-f711e30f2090 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:08.458882 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:08.469132 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634ea33-dd1c-4046-913a-f711e30f2090 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:08.502145 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442f0cc-dae4-4a55-a699-ce32a7e02fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:08.502835 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442f0cc-dae4-4a55-a699-ce32a7e02fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:08.503117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442f0cc-dae4-4a55-a699-ce32a7e02fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:08.503399 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442f0cc-dae4-4a55-a699-ce32a7e02fc9 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:08.504106 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442f0cc-dae4-4a55-a699-ce32a7e02fc9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:08.504415 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442f0cc-dae4-4a55-a699-ce32a7e02fc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:08.505841 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4442f0cc-dae4-4a55-a699-ce32a7e02fc9 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:08.512179 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 497/987] 10.222.0.49 () {56 vars in 1122 bytes} [Mon Jul 4 03:59:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:08.518173 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891aa231-dec5-473a-9294-ba550c383c90 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:08.621077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891aa231-dec5-473a-9294-ba550c383c90 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:08.655615 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af452f-aa95-47ba-8ab9-6bd4303fe882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:08.656289 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af452f-aa95-47ba-8ab9-6bd4303fe882 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:08.656570 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af452f-aa95-47ba-8ab9-6bd4303fe882 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:08.656709 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881be1b-db50-474b-b45b-9ae73ccd204b None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:08.656844 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af452f-aa95-47ba-8ab9-6bd4303fe882 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:08.656984 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881be1b-db50-474b-b45b-9ae73ccd204b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:08.657302 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881be1b-db50-474b-b45b-9ae73ccd204b None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:08.657646 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af452f-aa95-47ba-8ab9-6bd4303fe882 None admin] RBAC: Adding query filter params (interface=admin, service_id=558e725bd95d468287128433d718bd13, region_id=RegionOne) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:08.657966 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af452f-aa95-47ba-8ab9-6bd4303fe882 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:08.658832 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 498/988] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:59:08.660530 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af452f-aa95-47ba-8ab9-6bd4303fe882 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:08.665423 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 491/989] 10.222.0.49 () {56 vars in 1249 bytes} [Mon Jul 4 03:59:08 2022] GET /identity/v3/endpoints?service_id=558e725bd95d468287128433d718bd13&interface=admin®ion_id=RegionOne => generated 193 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:08.665733 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59ae9b-16a3-4bd6-a63d-7e963012dd30 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:08.666092 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59ae9b-16a3-4bd6-a63d-7e963012dd30 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:08.666483 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59ae9b-16a3-4bd6-a63d-7e963012dd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:08.672178 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af452f-aa95-47ba-8ab9-6bd4303fe882 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:08.686781 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-bf59ae9b-16a3-4bd6-a63d-7e963012dd30 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:59:08.688509 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-bf59ae9b-16a3-4bd6-a63d-7e963012dd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:59:08.722458 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:08.764566 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 499/990] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:59:08 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 03:59:08.782171 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af452f-aa95-47ba-8ab9-6bd4303fe882 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:08.787252 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59ae9b-16a3-4bd6-a63d-7e963012dd30 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:08.820105 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98df6b-5e85-44b8-88ad-bc2a72f0cccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:08.820791 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98df6b-5e85-44b8-88ad-bc2a72f0cccf None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:08.821069 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98df6b-5e85-44b8-88ad-bc2a72f0cccf None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:08.821354 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98df6b-5e85-44b8-88ad-bc2a72f0cccf None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:08.822687 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da98df6b-5e85-44b8-88ad-bc2a72f0cccf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:08.823494 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da98df6b-5e85-44b8-88ad-bc2a72f0cccf None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:08.830113 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 492/991] 10.222.0.49 () {56 vars in 1087 bytes} [Mon Jul 4 03:59:08 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 03:59:08.877024 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:08.895699 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59ae9b-16a3-4bd6-a63d-7e963012dd30 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:08.933555 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa65a5-b9bf-4365-9b6e-0eb9c50bb59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:08.934407 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa65a5-b9bf-4365-9b6e-0eb9c50bb59b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:08.934693 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa65a5-b9bf-4365-9b6e-0eb9c50bb59b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:08.934974 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa65a5-b9bf-4365-9b6e-0eb9c50bb59b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:08.935638 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa65a5-b9bf-4365-9b6e-0eb9c50bb59b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:08.937090 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa65a5-b9bf-4365-9b6e-0eb9c50bb59b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:08.949992 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-7cfa65a5-b9bf-4365-9b6e-0eb9c50bb59b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 03:59:08.949992 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:08.949992 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 03:59:08.949992 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 03:59:08.949992 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 03:59:08.949992 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 03:59:08.949992 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 03:59:08.949992 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:59:08.949992 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 03:59:08.949992 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:59:08.949992 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 03:59:08.949992 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:59:08.949992 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:08.949992 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:08.949992 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:08.949992 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:08.949992 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:08.951242 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:08.951242 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:08.951242 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:08.951242 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:08.951242 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:08.951242 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:08.951242 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 03:59:08.951242 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 03:59:08.951242 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 03:59:08.951242 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 03:59:08.951242 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:08.951242 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:08.951242 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:08.951242 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:08.951242 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:08.951242 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:08.952196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:08.952196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:08.952196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:08.952196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:08.952196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:08.952196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:08.952196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:08.952196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:08.952196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:08.952196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:08.952196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 03:59:08.952196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:59:08.952196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 03:59:08.952196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:59:08.952196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 500/992] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:59:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:59:08.957973 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98df6b-5e85-44b8-88ad-bc2a72f0cccf None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:09.067716 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98df6b-5e85-44b8-88ad-bc2a72f0cccf None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:09.076449 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:09.105478 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e3b27-6393-4769-aa2d-94621b281136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:09.106183 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e3b27-6393-4769-aa2d-94621b281136 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:09.106597 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e3b27-6393-4769-aa2d-94621b281136 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:09.106882 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e3b27-6393-4769-aa2d-94621b281136 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:09.107589 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e3b27-6393-4769-aa2d-94621b281136 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:09.107904 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e3b27-6393-4769-aa2d-94621b281136 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:09.109302 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e3b27-6393-4769-aa2d-94621b281136 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:09.118222 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 493/993] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Jul 4 03:59:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:09.120625 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa65a5-b9bf-4365-9b6e-0eb9c50bb59b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:09.227171 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa65a5-b9bf-4365-9b6e-0eb9c50bb59b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:09.261862 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837185d-d62a-4680-a507-fa50ab4389d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:09.262553 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837185d-d62a-4680-a507-fa50ab4389d0 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:09.262838 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837185d-d62a-4680-a507-fa50ab4389d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:09.263113 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837185d-d62a-4680-a507-fa50ab4389d0 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:09.263793 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d837185d-d62a-4680-a507-fa50ab4389d0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:09.264101 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d837185d-d62a-4680-a507-fa50ab4389d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:09.265534 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d837185d-d62a-4680-a507-fa50ab4389d0 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:09.276828 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 501/994] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Jul 4 03:59:09 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:09.278491 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e3b27-6393-4769-aa2d-94621b281136 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:09.389676 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e3b27-6393-4769-aa2d-94621b281136 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:09.425740 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292171e1-6f3e-48f8-ad59-abffdea91d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:09.426442 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292171e1-6f3e-48f8-ad59-abffdea91d26 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:09.426733 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292171e1-6f3e-48f8-ad59-abffdea91d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:09.427029 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292171e1-6f3e-48f8-ad59-abffdea91d26 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:09.427834 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292171e1-6f3e-48f8-ad59-abffdea91d26 None admin] RBAC: Adding query filter params (interface=public, service_id=a70b584069944294a8196e9048dc1c43, region_id=RegionOne) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:09.428171 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292171e1-6f3e-48f8-ad59-abffdea91d26 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:09.429588 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292171e1-6f3e-48f8-ad59-abffdea91d26 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:09.434982 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 494/995] 10.222.0.49 () {56 vars in 1251 bytes} [Mon Jul 4 03:59:09 2022] GET /identity/v3/endpoints?service_id=a70b584069944294a8196e9048dc1c43&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:59:09.440618 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837185d-d62a-4680-a507-fa50ab4389d0 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:09.457228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:09.545161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837185d-d62a-4680-a507-fa50ab4389d0 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:09.579204 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204c77f-1061-4509-a4cf-33af95861466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:09.579879 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204c77f-1061-4509-a4cf-33af95861466 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:09.580168 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204c77f-1061-4509-a4cf-33af95861466 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:09.580450 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204c77f-1061-4509-a4cf-33af95861466 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:09.581145 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204c77f-1061-4509-a4cf-33af95861466 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:09.582573 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204c77f-1061-4509-a4cf-33af95861466 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:09.589160 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 502/996] 10.222.0.49 () {56 vars in 1087 bytes} [Mon Jul 4 03:59:09 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 03:59:09.639233 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2471d6-39c1-427e-9ded-a06f708ea3b4 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:09.639581 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2471d6-39c1-427e-9ded-a06f708ea3b4 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:09.639873 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2471d6-39c1-427e-9ded-a06f708ea3b4 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:09.641448 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 495/997] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:59:09.647482 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25df9e-2ecb-4b12-b61f-71733093b9a0 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:09.647817 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25df9e-2ecb-4b12-b61f-71733093b9a0 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:09.648028 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25df9e-2ecb-4b12-b61f-71733093b9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:09.666568 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-9c25df9e-2ecb-4b12-b61f-71733093b9a0 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:59:09.667808 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9c25df9e-2ecb-4b12-b61f-71733093b9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:59:09.743921 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 503/998] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:59:09 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 03:59:09.766338 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2471d6-39c1-427e-9ded-a06f708ea3b4 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:09.802131 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:09.872306 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2471d6-39c1-427e-9ded-a06f708ea3b4 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:09.911053 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d006cad-3b13-4ba6-8a80-72ce8d7b4d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:09.911902 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d006cad-3b13-4ba6-8a80-72ce8d7b4d3c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:09.912184 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d006cad-3b13-4ba6-8a80-72ce8d7b4d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:09.912460 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d006cad-3b13-4ba6-8a80-72ce8d7b4d3c None admin] PATH_INFO: `/v3/services/image` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:09.913127 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d006cad-3b13-4ba6-8a80-72ce8d7b4d3c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:09.914557 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d006cad-3b13-4ba6-8a80-72ce8d7b4d3c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:09.926417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-3d006cad-3b13-4ba6-8a80-72ce8d7b4d3c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 03:59:09.926417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:09.926417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 03:59:09.926417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 03:59:09.926417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 03:59:09.926417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 03:59:09.926417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 03:59:09.926417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:59:09.926417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 03:59:09.926417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:09.926417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 03:59:09.926417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:09.926417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:09.926417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:09.926417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:09.926417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:09.926417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:09.927584 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:09.927584 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:09.927584 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:09.927584 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:09.927584 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:09.927584 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:09.927584 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 03:59:09.927584 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 03:59:09.927584 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 03:59:09.927584 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 03:59:09.927584 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:09.927584 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:09.927584 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:09.927584 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:09.927584 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:09.927584 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:09.928519 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:09.928519 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:09.928519 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:09.928519 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:09.928519 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:09.928519 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:09.928519 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:09.928519 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:09.928519 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:09.928519 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:09.928519 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 03:59:09.928519 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:59:09.928519 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 03:59:09.928519 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:09.928519 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 496/999] 10.222.0.49 () {56 vars in 1105 bytes} [Mon Jul 4 03:59:09 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:59:09.935993 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25df9e-2ecb-4b12-b61f-71733093b9a0 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:09.946938 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:10.047879 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25df9e-2ecb-4b12-b61f-71733093b9a0 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:10.082352 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453d9a1-fff9-412f-8143-acffa87ad798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:10.083019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453d9a1-fff9-412f-8143-acffa87ad798 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:10.083348 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453d9a1-fff9-412f-8143-acffa87ad798 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:10.083742 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453d9a1-fff9-412f-8143-acffa87ad798 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:10.084449 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453d9a1-fff9-412f-8143-acffa87ad798 None admin] RBAC: Adding query filter params (name=image) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:10.084759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453d9a1-fff9-412f-8143-acffa87ad798 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:10.086182 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453d9a1-fff9-412f-8143-acffa87ad798 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:10.095933 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 504/1000] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:59:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:10.096869 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d006cad-3b13-4ba6-8a80-72ce8d7b4d3c None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:10.196290 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:10.200072 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d006cad-3b13-4ba6-8a80-72ce8d7b4d3c None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:10.235646 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25212cff-bb48-42ec-847d-8d26a8750452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:10.236321 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25212cff-bb48-42ec-847d-8d26a8750452 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:10.236604 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25212cff-bb48-42ec-847d-8d26a8750452 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:10.236875 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25212cff-bb48-42ec-847d-8d26a8750452 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:10.237578 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25212cff-bb48-42ec-847d-8d26a8750452 None admin] RBAC: Adding query filter params (type=image) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:10.237882 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25212cff-bb48-42ec-847d-8d26a8750452 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:10.239306 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25212cff-bb48-42ec-847d-8d26a8750452 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:10.246544 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 497/1001] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:59:10 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:10.853281 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15802c83-fd1f-44ab-9194-2e42aef790e2 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:10.853835 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15802c83-fd1f-44ab-9194-2e42aef790e2 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:10.853835 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15802c83-fd1f-44ab-9194-2e42aef790e2 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:10.855248 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 505/1002] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:59:10.860730 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916f355-1a86-4f24-ba48-a9928cfa8576 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:10.861028 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916f355-1a86-4f24-ba48-a9928cfa8576 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:10.861313 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916f355-1a86-4f24-ba48-a9928cfa8576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:10.878416 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-a916f355-1a86-4f24-ba48-a9928cfa8576 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:59:10.879608 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a916f355-1a86-4f24-ba48-a9928cfa8576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:59:10.949933 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 498/1003] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:59:10 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 03:59:10.973258 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15802c83-fd1f-44ab-9194-2e42aef790e2 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:11.047613 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:11.079739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15802c83-fd1f-44ab-9194-2e42aef790e2 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:11.113589 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0ba88-bf68-4552-96ea-aa135124d978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:11.114379 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0ba88-bf68-4552-96ea-aa135124d978 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:11.114662 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0ba88-bf68-4552-96ea-aa135124d978 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:11.114965 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0ba88-bf68-4552-96ea-aa135124d978 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:11.115623 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0ba88-bf68-4552-96ea-aa135124d978 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:11.117019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0ba88-bf68-4552-96ea-aa135124d978 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:11.129163 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-b5c0ba88-bf68-4552-96ea-aa135124d978 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 03:59:11.129163 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:11.129163 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 03:59:11.129163 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 03:59:11.129163 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 03:59:11.129163 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 03:59:11.129163 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 03:59:11.129163 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:59:11.129163 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 03:59:11.129163 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:59:11.129163 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 03:59:11.129163 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:59:11.129163 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:11.129163 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:11.129163 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:11.129163 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:11.129163 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:11.130126 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:11.130126 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:11.130126 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:11.130126 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:11.130126 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:11.130126 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:11.130126 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 03:59:11.130126 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 03:59:11.130126 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 03:59:11.130126 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 03:59:11.130126 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:11.130126 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:11.130126 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:11.130126 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:11.130126 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:11.130126 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:11.131101 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:11.131101 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:11.131101 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:11.131101 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:11.131101 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:11.131101 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:11.131101 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:11.131101 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:11.131101 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:11.131101 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:11.131101 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 03:59:11.131101 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:59:11.131101 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 04 03:59:11.131101 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:59:11.134480 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 506/1004] 10.222.0.49 () {56 vars in 1126 bytes} [Mon Jul 4 03:59:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:59:11.136753 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916f355-1a86-4f24-ba48-a9928cfa8576 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:11.227861 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:11.238455 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916f355-1a86-4f24-ba48-a9928cfa8576 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:11.273104 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1177cc-7aa5-4336-a7b9-5a17eec960f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:11.273789 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1177cc-7aa5-4336-a7b9-5a17eec960f5 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:11.274076 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1177cc-7aa5-4336-a7b9-5a17eec960f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:11.274390 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1177cc-7aa5-4336-a7b9-5a17eec960f5 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:11.275106 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1177cc-7aa5-4336-a7b9-5a17eec960f5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:11.275411 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1177cc-7aa5-4336-a7b9-5a17eec960f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:11.276818 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1177cc-7aa5-4336-a7b9-5a17eec960f5 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:11.282175 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 499/1005] 10.222.0.49 () {56 vars in 1122 bytes} [Mon Jul 4 03:59:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:11.288001 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0ba88-bf68-4552-96ea-aa135124d978 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:11.394243 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0ba88-bf68-4552-96ea-aa135124d978 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:11.428679 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e8407-df3e-4ece-a5ea-52125350dbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:11.429387 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e8407-df3e-4ece-a5ea-52125350dbc9 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:11.429633 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e8407-df3e-4ece-a5ea-52125350dbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:11.429943 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e8407-df3e-4ece-a5ea-52125350dbc9 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:11.430683 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e8407-df3e-4ece-a5ea-52125350dbc9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:11.430985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e8407-df3e-4ece-a5ea-52125350dbc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:11.432364 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e8407-df3e-4ece-a5ea-52125350dbc9 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:11.434399 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:11.438787 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 507/1006] 10.222.0.49 () {56 vars in 1122 bytes} [Mon Jul 4 03:59:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:11.444538 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1177cc-7aa5-4336-a7b9-5a17eec960f5 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:11.547201 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1177cc-7aa5-4336-a7b9-5a17eec960f5 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:11.582372 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270bc30-88ac-4275-9a20-816bf65568ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:11.583034 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270bc30-88ac-4275-9a20-816bf65568ef None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:11.583327 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270bc30-88ac-4275-9a20-816bf65568ef None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:11.583653 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270bc30-88ac-4275-9a20-816bf65568ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:11.584402 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d270bc30-88ac-4275-9a20-816bf65568ef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:11.585853 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d270bc30-88ac-4275-9a20-816bf65568ef None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:11.610178 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 500/1007] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Jul 4 03:59:11 2022] POST /identity/v3/endpoints => generated 325 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 03:59:11.611726 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9d1da-7ad1-4a78-8f0e-bf7da4c25a52 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:11.612023 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9d1da-7ad1-4a78-8f0e-bf7da4c25a52 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:11.612305 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9d1da-7ad1-4a78-8f0e-bf7da4c25a52 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:11.613766 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 508/1008] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:59:11.619947 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61586251-1d6a-45ae-a1fb-e6cd76d91300 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:11.620309 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61586251-1d6a-45ae-a1fb-e6cd76d91300 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:11.620519 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61586251-1d6a-45ae-a1fb-e6cd76d91300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:11.638903 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-61586251-1d6a-45ae-a1fb-e6cd76d91300 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:59:11.640133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-61586251-1d6a-45ae-a1fb-e6cd76d91300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:59:11.653008 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:11.725403 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 501/1009] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:59:11 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 03:59:11.748764 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9d1da-7ad1-4a78-8f0e-bf7da4c25a52 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:11.859772 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9d1da-7ad1-4a78-8f0e-bf7da4c25a52 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:11.896388 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf101818-7274-46e4-ad45-a5994d440a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:11.897190 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf101818-7274-46e4-ad45-a5994d440a48 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:11.897429 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf101818-7274-46e4-ad45-a5994d440a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:11.897739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf101818-7274-46e4-ad45-a5994d440a48 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:11.898428 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf101818-7274-46e4-ad45-a5994d440a48 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:11.899842 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf101818-7274-46e4-ad45-a5994d440a48 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:11.911718 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-cf101818-7274-46e4-ad45-a5994d440a48 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 03:59:11.911718 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:11.911718 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 03:59:11.911718 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 03:59:11.911718 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 03:59:11.911718 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 03:59:11.911718 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 03:59:11.911718 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:59:11.911718 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 03:59:11.911718 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:59:11.911718 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 03:59:11.911718 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:59:11.911718 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:11.911718 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:11.911718 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:11.911718 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:11.911718 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:11.912796 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:11.912796 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:11.912796 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:11.912796 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:11.912796 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:11.912796 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:11.912796 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 03:59:11.912796 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 03:59:11.912796 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 03:59:11.912796 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 03:59:11.912796 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:11.912796 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:11.912796 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:11.912796 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:11.912796 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:11.912796 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:11.913721 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:11.913721 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:11.913721 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:11.913721 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:11.913721 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:11.913721 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:11.913721 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:11.913721 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:11.913721 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:11.913721 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:11.913721 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 03:59:11.913721 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:59:11.913721 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 04 03:59:11.913721 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:59:11.913721 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 509/1010] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:59:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:59:11.920617 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61586251-1d6a-45ae-a1fb-e6cd76d91300 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:12.025738 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61586251-1d6a-45ae-a1fb-e6cd76d91300 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:12.062666 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b8863-63fa-4c66-8054-4b49d7af50d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:12.063343 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b8863-63fa-4c66-8054-4b49d7af50d0 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:12.063634 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b8863-63fa-4c66-8054-4b49d7af50d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:12.063899 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b8863-63fa-4c66-8054-4b49d7af50d0 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:12.064614 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b8863-63fa-4c66-8054-4b49d7af50d0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:12.064930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b8863-63fa-4c66-8054-4b49d7af50d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:12.066329 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b8863-63fa-4c66-8054-4b49d7af50d0 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:12.071637 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 502/1011] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Jul 4 03:59:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:59:12.077205 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf101818-7274-46e4-ad45-a5994d440a48 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:12.142752 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:12.182856 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf101818-7274-46e4-ad45-a5994d440a48 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:12.218645 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee39db-9952-4811-ba94-6387b13fde83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:12.219383 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee39db-9952-4811-ba94-6387b13fde83 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:12.219596 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee39db-9952-4811-ba94-6387b13fde83 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:12.219875 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee39db-9952-4811-ba94-6387b13fde83 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:12.220588 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee39db-9952-4811-ba94-6387b13fde83 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:12.220897 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee39db-9952-4811-ba94-6387b13fde83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:12.222317 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee39db-9952-4811-ba94-6387b13fde83 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:12.227740 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 510/1012] 10.222.0.49 () {56 vars in 1112 bytes} [Mon Jul 4 03:59:12 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:12.233397 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b8863-63fa-4c66-8054-4b49d7af50d0 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:12.242631 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:12.255933 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c93686-2ee4-48be-90dd-8acdf47f1c05 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:12.256233 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c93686-2ee4-48be-90dd-8acdf47f1c05 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:12.256538 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c93686-2ee4-48be-90dd-8acdf47f1c05 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:12.258195 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 511/1013] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 03:59:12.263341 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390ec0d-5c08-43ef-9bfa-3c6b058726c2 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:12.263641 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390ec0d-5c08-43ef-9bfa-3c6b058726c2 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:12.264265 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390ec0d-5c08-43ef-9bfa-3c6b058726c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:12.281927 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-b390ec0d-5c08-43ef-9bfa-3c6b058726c2 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:59:12.283128 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b390ec0d-5c08-43ef-9bfa-3c6b058726c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:59:12.345251 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b8863-63fa-4c66-8054-4b49d7af50d0 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:12.353803 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 512/1014] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:59:12 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 03:59:12.376848 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390ec0d-5c08-43ef-9bfa-3c6b058726c2 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:12.381889 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c484720-22ac-44b8-93f3-5a8af74d812a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:12.382598 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c484720-22ac-44b8-93f3-5a8af74d812a None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:12.382889 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c484720-22ac-44b8-93f3-5a8af74d812a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:12.383171 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c484720-22ac-44b8-93f3-5a8af74d812a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:12.383941 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c484720-22ac-44b8-93f3-5a8af74d812a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:12.385716 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c484720-22ac-44b8-93f3-5a8af74d812a None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:12.406933 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 503/1015] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Jul 4 03:59:12 2022] POST /identity/v3/endpoints => generated 334 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 03:59:12.454521 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:12.503527 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390ec0d-5c08-43ef-9bfa-3c6b058726c2 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:12.549089 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f2fe6-5f4b-4e48-a196-4503384910f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:12.549763 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f2fe6-5f4b-4e48-a196-4503384910f2 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:12.550045 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f2fe6-5f4b-4e48-a196-4503384910f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:12.550350 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f2fe6-5f4b-4e48-a196-4503384910f2 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:12.551083 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f2fe6-5f4b-4e48-a196-4503384910f2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:12.552543 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f2fe6-5f4b-4e48-a196-4503384910f2 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:12.573758 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 513/1016] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Jul 4 03:59:12 2022] POST /identity/v3/services => generated 242 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 03:59:13.663858 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc4c36-bc06-4601-ba45-81fc82c44465 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:13.664458 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc4c36-bc06-4601-ba45-81fc82c44465 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:13.664458 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc4c36-bc06-4601-ba45-81fc82c44465 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:13.665989 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 504/1017] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:59:13.671245 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75395aa-0181-4008-9a3d-19ec3c0a85be None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:13.671714 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75395aa-0181-4008-9a3d-19ec3c0a85be None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:13.671820 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75395aa-0181-4008-9a3d-19ec3c0a85be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:13.689991 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-d75395aa-0181-4008-9a3d-19ec3c0a85be None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:59:13.691279 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d75395aa-0181-4008-9a3d-19ec3c0a85be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:59:13.768925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 514/1018] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:59:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 03:59:13.792309 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc4c36-bc06-4601-ba45-81fc82c44465 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:13.860087 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:13.900034 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc4c36-bc06-4601-ba45-81fc82c44465 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:13.933936 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773908f-1591-4da7-bb06-b10b7eaa8116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:13.934717 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773908f-1591-4da7-bb06-b10b7eaa8116 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:13.935006 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773908f-1591-4da7-bb06-b10b7eaa8116 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:13.935319 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773908f-1591-4da7-bb06-b10b7eaa8116 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:13.936482 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b773908f-1591-4da7-bb06-b10b7eaa8116 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:13.937980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b773908f-1591-4da7-bb06-b10b7eaa8116 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:13.939841 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 505/1019] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:59:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:13.945614 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75395aa-0181-4008-9a3d-19ec3c0a85be None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:13.994894 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:14.055013 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75395aa-0181-4008-9a3d-19ec3c0a85be None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:14.100214 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd998850-0c9a-4b8d-a2bf-39a50da8a666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:14.100214 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd998850-0c9a-4b8d-a2bf-39a50da8a666 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:14.100214 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd998850-0c9a-4b8d-a2bf-39a50da8a666 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:14.100214 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd998850-0c9a-4b8d-a2bf-39a50da8a666 None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:14.102880 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd998850-0c9a-4b8d-a2bf-39a50da8a666 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:14.102880 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd998850-0c9a-4b8d-a2bf-39a50da8a666 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:14.131442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 515/1020] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Jul 4 03:59:13 2022] POST /identity/v3/projects => generated 311 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 03:59:14.528216 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0629d-6cf9-4bb4-902b-15ec1d556abe None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:14.528493 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0629d-6cf9-4bb4-902b-15ec1d556abe None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:14.528767 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0629d-6cf9-4bb4-902b-15ec1d556abe None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:14.530373 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 506/1021] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:59:14.535371 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d1f32-f97c-4d32-b99e-c76ee154fc68 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:14.535634 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d1f32-f97c-4d32-b99e-c76ee154fc68 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:14.535956 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d1f32-f97c-4d32-b99e-c76ee154fc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:14.553172 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-d76d1f32-f97c-4d32-b99e-c76ee154fc68 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:59:14.554385 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d76d1f32-f97c-4d32-b99e-c76ee154fc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:59:14.625671 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 516/1022] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:59:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 03:59:14.630128 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718977ad-bd5c-4d78-b943-41aaab81f23b None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:14.630516 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718977ad-bd5c-4d78-b943-41aaab81f23b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:14.630808 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718977ad-bd5c-4d78-b943-41aaab81f23b None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:14.632445 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 507/1023] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:59:14.637881 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb1fe5-920f-4236-89cb-f41a88b08a5e None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:14.638202 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb1fe5-920f-4236-89cb-f41a88b08a5e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:14.638496 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb1fe5-920f-4236-89cb-f41a88b08a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:14.649322 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718977ad-bd5c-4d78-b943-41aaab81f23b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:14.655544 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-29bb1fe5-920f-4236-89cb-f41a88b08a5e None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:59:14.656733 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-29bb1fe5-920f-4236-89cb-f41a88b08a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:59:14.674520 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:14.730349 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 517/1024] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:59:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 03:59:14.753005 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb1fe5-920f-4236-89cb-f41a88b08a5e None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:14.759963 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718977ad-bd5c-4d78-b943-41aaab81f23b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:14.790101 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:14.797434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe16d3c-35c8-4c84-b23a-3cefd1aa3a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:14.798299 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe16d3c-35c8-4c84-b23a-3cefd1aa3a7c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:14.798587 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe16d3c-35c8-4c84-b23a-3cefd1aa3a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:14.798866 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe16d3c-35c8-4c84-b23a-3cefd1aa3a7c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:14.809162 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe16d3c-35c8-4c84-b23a-3cefd1aa3a7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:59:14.817308 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-bfe16d3c-35c8-4c84-b23a-3cefd1aa3a7c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 03:59:14.817308 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:14.817308 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:14.817308 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:14.817308 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:14.817308 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:14.817308 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:14.817308 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:14.817308 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:14.817308 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:14.817308 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:14.817308 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:14.817308 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:59:14.817308 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:59:14.817308 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:59:14.817308 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:59:14.818504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:59:14.818504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:59:14.818504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:59:14.818504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:59:14.818504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:14.818504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:14.818504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:14.818504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:14.818504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:14.818504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:14.818504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:14.818504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:14.818504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:14.818504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:14.818504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:14.818504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:14.819992 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:14.819992 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:14.819992 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:14.819992 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:14.819992 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:59:14.819992 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:59:14.819992 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:59:14.819992 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:59:14.819992 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:59:14.819992 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:59:14.819992 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 03:59:14.819992 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:14.819992 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 508/1025] 10.222.0.49 () {56 vars in 1120 bytes} [Mon Jul 4 03:59:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:59:14.824456 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe16d3c-35c8-4c84-b23a-3cefd1aa3a7c None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:14.862904 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb1fe5-920f-4236-89cb-f41a88b08a5e None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:14.903934 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f8649f-f904-4cf5-9b8f-4fa0ed898c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:14.904937 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8649f-f904-4cf5-9b8f-4fa0ed898c92 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:14.905222 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8649f-f904-4cf5-9b8f-4fa0ed898c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:14.905502 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8649f-f904-4cf5-9b8f-4fa0ed898c92 None admin] PATH_INFO: `/v3/services/image` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:14.906266 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f8649f-f904-4cf5-9b8f-4fa0ed898c92 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:14.907709 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f8649f-f904-4cf5-9b8f-4fa0ed898c92 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:14.920496 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-94f8649f-f904-4cf5-9b8f-4fa0ed898c92 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 03:59:14.920496 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:14.920496 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 03:59:14.920496 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 03:59:14.920496 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 03:59:14.920496 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 03:59:14.920496 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 03:59:14.920496 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:59:14.920496 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 03:59:14.920496 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:59:14.920496 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 03:59:14.920496 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:59:14.920496 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:14.920496 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:14.920496 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:14.920496 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:14.920496 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:14.921657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:14.921657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:14.921657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:14.921657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:14.921657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:14.921657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:14.921657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 03:59:14.921657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 03:59:14.921657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 03:59:14.921657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 03:59:14.921657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:14.921657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:14.921657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:14.921657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:14.921657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:14.921657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:14.922719 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:14.922719 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:14.922719 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:14.922719 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:14.922719 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:14.922719 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:14.922719 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:14.922719 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:14.922719 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:14.922719 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:14.922719 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 03:59:14.922719 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:59:14.922719 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 03:59:14.922719 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:59:14.922719 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 518/1026] 10.222.0.49 () {56 vars in 1105 bytes} [Mon Jul 4 03:59:14 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:59:14.927677 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f8649f-f904-4cf5-9b8f-4fa0ed898c92 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:14.933601 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe16d3c-35c8-4c84-b23a-3cefd1aa3a7c None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:14.947279 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:14.976060 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550809c-7fd1-4529-9600-ad6fbd34043f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:14.976933 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550809c-7fd1-4529-9600-ad6fbd34043f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:14.977106 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550809c-7fd1-4529-9600-ad6fbd34043f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:14.977375 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550809c-7fd1-4529-9600-ad6fbd34043f None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:14.978141 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b550809c-7fd1-4529-9600-ad6fbd34043f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:14.978480 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b550809c-7fd1-4529-9600-ad6fbd34043f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:14.979879 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b550809c-7fd1-4529-9600-ad6fbd34043f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:14.989319 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 509/1027] 10.222.0.49 () {56 vars in 1115 bytes} [Mon Jul 4 03:59:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:59:14.994929 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550809c-7fd1-4529-9600-ad6fbd34043f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:15.035176 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f8649f-f904-4cf5-9b8f-4fa0ed898c92 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:15.049821 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:15.074314 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512bb78-0e19-4047-8586-ad1f293ef7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:15.075213 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512bb78-0e19-4047-8586-ad1f293ef7bc None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:15.075761 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512bb78-0e19-4047-8586-ad1f293ef7bc None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:15.076051 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512bb78-0e19-4047-8586-ad1f293ef7bc None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:15.076765 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512bb78-0e19-4047-8586-ad1f293ef7bc None admin] RBAC: Adding query filter params (name=image) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:15.077310 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512bb78-0e19-4047-8586-ad1f293ef7bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:15.078606 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512bb78-0e19-4047-8586-ad1f293ef7bc None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:15.088794 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 519/1028] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:59:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:59:15.089619 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512bb78-0e19-4047-8586-ad1f293ef7bc None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:15.099163 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550809c-7fd1-4529-9600-ad6fbd34043f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:15.132433 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3ed70-e91e-4add-b4bb-e3a68ec5170f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:15.133245 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3ed70-e91e-4add-b4bb-e3a68ec5170f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:15.133530 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3ed70-e91e-4add-b4bb-e3a68ec5170f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:15.133811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3ed70-e91e-4add-b4bb-e3a68ec5170f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:15.144920 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af3ed70-e91e-4add-b4bb-e3a68ec5170f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:15.146503 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af3ed70-e91e-4add-b4bb-e3a68ec5170f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:15.163531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-6af3ed70-e91e-4add-b4bb-e3a68ec5170f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:59:15.163531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:15.163531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:15.163531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:15.163531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:15.163531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:15.163531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:15.163531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:15.163531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:15.163531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:15.163531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:15.163531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:15.163531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:59:15.163531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:59:15.163531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:59:15.164479 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:59:15.164479 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:15.164479 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:15.164479 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:15.164479 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:15.164479 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:15.164479 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:15.164479 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:15.164479 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:15.164479 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:15.164479 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:15.164479 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:15.164479 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:15.164479 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:15.164479 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:15.164479 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:15.164479 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:15.165384 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:59:15.165384 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:59:15.165384 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:59:15.165384 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:15.165384 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 510/1029] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:59:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:59:15.170442 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3ed70-e91e-4add-b4bb-e3a68ec5170f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:15.178776 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:15.199945 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512bb78-0e19-4047-8586-ad1f293ef7bc None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:15.235767 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bacb20-e414-42fd-a61f-372d1dabee4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:15.236443 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bacb20-e414-42fd-a61f-372d1dabee4f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:15.236728 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bacb20-e414-42fd-a61f-372d1dabee4f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:15.236995 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bacb20-e414-42fd-a61f-372d1dabee4f None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:15.237700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bacb20-e414-42fd-a61f-372d1dabee4f None admin] RBAC: Adding query filter params (type=image) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:15.238008 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bacb20-e414-42fd-a61f-372d1dabee4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:15.239471 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bacb20-e414-42fd-a61f-372d1dabee4f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:15.249609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 520/1030] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:59:15 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:59:15.250839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bacb20-e414-42fd-a61f-372d1dabee4f None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:15.279570 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3ed70-e91e-4add-b4bb-e3a68ec5170f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:15.282657 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:15.314268 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7dc9ad-2ede-4f69-a214-9ea19c354247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:15.314869 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7dc9ad-2ede-4f69-a214-9ea19c354247 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:15.315156 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7dc9ad-2ede-4f69-a214-9ea19c354247 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:15.315434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7dc9ad-2ede-4f69-a214-9ea19c354247 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:15.316164 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7dc9ad-2ede-4f69-a214-9ea19c354247 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:15.316470 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7dc9ad-2ede-4f69-a214-9ea19c354247 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:15.317919 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7dc9ad-2ede-4f69-a214-9ea19c354247 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:15.330693 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 511/1031] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:59:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:59:15.336410 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7dc9ad-2ede-4f69-a214-9ea19c354247 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:15.365264 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bacb20-e414-42fd-a61f-372d1dabee4f None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:15.400879 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a48ca-e72c-4c49-b38b-b68e9f2f86d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:15.401651 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a48ca-e72c-4c49-b38b-b68e9f2f86d7 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:15.401921 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a48ca-e72c-4c49-b38b-b68e9f2f86d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:15.402337 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a48ca-e72c-4c49-b38b-b68e9f2f86d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:15.403160 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a48ca-e72c-4c49-b38b-b68e9f2f86d7 None admin] RBAC: Adding query filter params (interface=public, service_id=f4548c34aa7449098b45f3fafd105153, region_id=RegionOne) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:15.403480 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a48ca-e72c-4c49-b38b-b68e9f2f86d7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:15.404878 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a48ca-e72c-4c49-b38b-b68e9f2f86d7 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:15.415339 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 521/1032] 10.222.0.49 () {56 vars in 1251 bytes} [Mon Jul 4 03:59:15 2022] GET /identity/v3/endpoints?service_id=f4548c34aa7449098b45f3fafd105153&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:15.416207 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a48ca-e72c-4c49-b38b-b68e9f2f86d7 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:15.426863 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:15.440241 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7dc9ad-2ede-4f69-a214-9ea19c354247 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:15.477469 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847fd959-0d15-4cea-96d7-d3a8b8e6b037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:15.478382 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fd959-0d15-4cea-96d7-d3a8b8e6b037 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:15.478673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fd959-0d15-4cea-96d7-d3a8b8e6b037 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:15.478950 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fd959-0d15-4cea-96d7-d3a8b8e6b037 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:15.485903 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847fd959-0d15-4cea-96d7-d3a8b8e6b037 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:15.487430 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847fd959-0d15-4cea-96d7-d3a8b8e6b037 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:15.501599 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-847fd959-0d15-4cea-96d7-d3a8b8e6b037 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 03:59:15.501599 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:15.501599 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:15.501599 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:15.501599 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:15.501599 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:15.501599 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:15.501599 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:15.501599 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:15.501599 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:15.501599 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:15.501599 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:15.501599 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 03:59:15.501599 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 03:59:15.501599 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 03:59:15.501599 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 03:59:15.502811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:15.502811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:15.502811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 03:59:15.502811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:59:15.502811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 03:59:15.502811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:59:15.502811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:15.502811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:15.502811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:15.502811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:15.502811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:15.502811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:15.502811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:15.502811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:15.502811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:15.502811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:15.502811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:15.502811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:15.503781 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:15.503781 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:15.503781 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 03:59:15.503781 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 03:59:15.503781 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 03:59:15.503781 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 03:59:15.503781 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 03:59:15.503781 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 03:59:15.503781 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 03:59:15.503781 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:15.503781 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 512/1033] 10.222.0.49 () {56 vars in 1093 bytes} [Mon Jul 4 03:59:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:59:15.509426 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847fd959-0d15-4cea-96d7-d3a8b8e6b037 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:15.523069 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a48ca-e72c-4c49-b38b-b68e9f2f86d7 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:15.534891 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:15.561519 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ec455-ae8e-405b-9b7c-09f3c28e540a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:15.562497 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ec455-ae8e-405b-9b7c-09f3c28e540a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:15.562790 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ec455-ae8e-405b-9b7c-09f3c28e540a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:15.563073 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ec455-ae8e-405b-9b7c-09f3c28e540a None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:15.563764 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ec455-ae8e-405b-9b7c-09f3c28e540a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:15.565651 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ec455-ae8e-405b-9b7c-09f3c28e540a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:15.582188 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 522/1034] 10.222.0.49 () {56 vars in 1087 bytes} [Mon Jul 4 03:59:15 2022] GET /identity/v3/services => generated 1957 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 03:59:15.629133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847fd959-0d15-4cea-96d7-d3a8b8e6b037 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:15.668704 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425e06a-7a8c-4790-8391-2559f654a776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:15.669403 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425e06a-7a8c-4790-8391-2559f654a776 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:15.669691 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425e06a-7a8c-4790-8391-2559f654a776 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:15.669972 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425e06a-7a8c-4790-8391-2559f654a776 None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:15.670869 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425e06a-7a8c-4790-8391-2559f654a776 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:15.671189 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425e06a-7a8c-4790-8391-2559f654a776 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:15.672679 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425e06a-7a8c-4790-8391-2559f654a776 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:15.692718 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 513/1035] 10.222.0.49 () {56 vars in 1133 bytes} [Mon Jul 4 03:59:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:59:15.698878 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ec455-ae8e-405b-9b7c-09f3c28e540a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:15.777770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:15.809899 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ec455-ae8e-405b-9b7c-09f3c28e540a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:15.846086 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79dd77-f32f-4924-824f-7904fdedd31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:15.846688 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79dd77-f32f-4924-824f-7904fdedd31a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:15.846974 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79dd77-f32f-4924-824f-7904fdedd31a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:15.847255 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79dd77-f32f-4924-824f-7904fdedd31a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:15.916117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b79dd77-f32f-4924-824f-7904fdedd31a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:15.917576 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b79dd77-f32f-4924-824f-7904fdedd31a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:15.993629 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:16.026300 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 523/1036] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:59:15 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 03:59:16.031846 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425e06a-7a8c-4790-8391-2559f654a776 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:16.116211 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:16.136109 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425e06a-7a8c-4790-8391-2559f654a776 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:16.171341 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353b671-6f49-423a-a5ab-b6a857ddcafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:16.172160 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353b671-6f49-423a-a5ab-b6a857ddcafd None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:16.172444 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353b671-6f49-423a-a5ab-b6a857ddcafd None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:16.172703 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353b671-6f49-423a-a5ab-b6a857ddcafd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:16.183199 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8353b671-6f49-423a-a5ab-b6a857ddcafd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:16.184679 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8353b671-6f49-423a-a5ab-b6a857ddcafd None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:16.192465 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a5db8-0c7d-493f-bd25-e52630f03088 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:16.193072 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a5db8-0c7d-493f-bd25-e52630f03088 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:16.193363 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a5db8-0c7d-493f-bd25-e52630f03088 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:16.194804 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 524/1037] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:59:16.200333 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f62ef-e3ed-4922-a709-7ad41fe3f199 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:16.200627 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f62ef-e3ed-4922-a709-7ad41fe3f199 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:16.200912 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f62ef-e3ed-4922-a709-7ad41fe3f199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:16.206349 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-8353b671-6f49-423a-a5ab-b6a857ddcafd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:59:16.206349 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:16.206349 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:16.206349 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:16.206349 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:16.206349 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:16.206349 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:16.206349 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:16.206349 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:16.206349 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:16.206349 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:16.206349 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:16.206349 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:59:16.206349 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:59:16.206349 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:59:16.207481 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:59:16.207481 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:16.207481 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:16.207481 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:16.207481 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:16.207481 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:16.207481 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:16.207481 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:16.207481 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:16.207481 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:16.207481 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:16.207481 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:16.207481 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:16.207481 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:16.207481 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:16.207481 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:16.207481 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:16.208597 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:59:16.208597 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:59:16.208597 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:59:16.208597 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:16.210181 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 514/1038] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:59:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:59:16.216422 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353b671-6f49-423a-a5ab-b6a857ddcafd None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:16.220880 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-529f62ef-e3ed-4922-a709-7ad41fe3f199 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:59:16.222076 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-529f62ef-e3ed-4922-a709-7ad41fe3f199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:59:16.291514 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 525/1039] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:59:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 03:59:16.315674 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f62ef-e3ed-4922-a709-7ad41fe3f199 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:16.325469 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353b671-6f49-423a-a5ab-b6a857ddcafd None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:16.360974 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a45731-5aa6-4420-8569-9740f506a9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:16.361643 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a45731-5aa6-4420-8569-9740f506a9b3 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:16.361927 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a45731-5aa6-4420-8569-9740f506a9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:16.362229 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a45731-5aa6-4420-8569-9740f506a9b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:16.362956 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a45731-5aa6-4420-8569-9740f506a9b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:16.363262 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a45731-5aa6-4420-8569-9740f506a9b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:16.364696 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a45731-5aa6-4420-8569-9740f506a9b3 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:16.366130 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:16.378231 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 515/1040] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:59:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:59:16.383690 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a45731-5aa6-4420-8569-9740f506a9b3 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:16.420949 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f62ef-e3ed-4922-a709-7ad41fe3f199 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:16.423343 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:16.465347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe002a8d-7470-40dd-8318-471138d138c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:16.466484 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe002a8d-7470-40dd-8318-471138d138c0 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:16.466778 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe002a8d-7470-40dd-8318-471138d138c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:16.467247 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe002a8d-7470-40dd-8318-471138d138c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:16.468390 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe002a8d-7470-40dd-8318-471138d138c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:16.469979 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe002a8d-7470-40dd-8318-471138d138c0 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:16.472216 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 526/1041] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:59:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:59:16.479018 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe002a8d-7470-40dd-8318-471138d138c0 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:16.489251 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a45731-5aa6-4420-8569-9740f506a9b3 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:16.526639 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5947f54b-4b63-4814-b554-77bcdfee0375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:16.527498 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947f54b-4b63-4814-b554-77bcdfee0375 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:16.527788 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947f54b-4b63-4814-b554-77bcdfee0375 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:16.528062 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947f54b-4b63-4814-b554-77bcdfee0375 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:16.535135 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5947f54b-4b63-4814-b554-77bcdfee0375 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:16.536651 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5947f54b-4b63-4814-b554-77bcdfee0375 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:16.551066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-5947f54b-4b63-4814-b554-77bcdfee0375 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:59:16.551066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:16.551066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:16.551066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:16.551066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:16.551066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:16.551066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:16.551066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:16.551066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:16.551066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:16.551066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:16.551066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:16.551066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 03:59:16.551066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 03:59:16.551066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 03:59:16.552314 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 03:59:16.552314 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:16.552314 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:16.552314 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:16.552314 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:16.552314 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:16.552314 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:16.552314 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:16.552314 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:16.552314 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:16.552314 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:16.552314 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:16.552314 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:16.552314 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:16.552314 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:16.552314 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:16.552314 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:16.553265 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 03:59:16.553265 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 03:59:16.553265 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 03:59:16.553265 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 03:59:16.553265 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 03:59:16.553265 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 03:59:16.553265 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:59:16.553265 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:16.553265 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 516/1042] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:59:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:59:16.559073 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5947f54b-4b63-4814-b554-77bcdfee0375 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:16.586199 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe002a8d-7470-40dd-8318-471138d138c0 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:16.619816 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:16.620854 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2850f9b-7845-49fe-80fa-1a7c60065dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:16.621547 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2850f9b-7845-49fe-80fa-1a7c60065dcb None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:16.621841 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2850f9b-7845-49fe-80fa-1a7c60065dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:16.622118 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2850f9b-7845-49fe-80fa-1a7c60065dcb None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:16.622939 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2850f9b-7845-49fe-80fa-1a7c60065dcb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:16.624339 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2850f9b-7845-49fe-80fa-1a7c60065dcb None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:16.649185 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 527/1043] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Jul 4 03:59:16 2022] POST /identity/v3/users => generated 285 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 03:59:16.670987 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5947f54b-4b63-4814-b554-77bcdfee0375 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:16.712821 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb72759-4630-42fd-80f5-2410a88f1d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:16.713527 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb72759-4630-42fd-80f5-2410a88f1d87 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:16.713813 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb72759-4630-42fd-80f5-2410a88f1d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:16.714075 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb72759-4630-42fd-80f5-2410a88f1d87 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:16.714977 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb72759-4630-42fd-80f5-2410a88f1d87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:16.715300 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb72759-4630-42fd-80f5-2410a88f1d87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:16.716778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb72759-4630-42fd-80f5-2410a88f1d87 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:16.730878 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 517/1044] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Jul 4 03:59:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:16.737035 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2850f9b-7845-49fe-80fa-1a7c60065dcb None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:16.767479 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:16.847904 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2850f9b-7845-49fe-80fa-1a7c60065dcb None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:16.882260 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06475eb3-8996-4973-b52c-6e1540aeda95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:16.882989 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06475eb3-8996-4973-b52c-6e1540aeda95 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:16.883273 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06475eb3-8996-4973-b52c-6e1540aeda95 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:16.883594 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06475eb3-8996-4973-b52c-6e1540aeda95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:16.884439 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06475eb3-8996-4973-b52c-6e1540aeda95 None admin] RBAC: Adding query filter params (role.id=bc829c0c3f7b402c930a7f1d58b27331, scope.project.id=424a145a22434ef7a14b6108e6118ccb, user.id=8334e75253f843a980b01c6f0cda6015) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:16.884761 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06475eb3-8996-4973-b52c-6e1540aeda95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:16.886615 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06475eb3-8996-4973-b52c-6e1540aeda95 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:16.892691 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 528/1045] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:59:16 2022] GET /identity/v3/role_assignments?user.id=8334e75253f843a980b01c6f0cda6015&scope.project.id=424a145a22434ef7a14b6108e6118ccb&role.id=bc829c0c3f7b402c930a7f1d58b27331 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:17.617915 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241f350-8b5d-497a-ac97-632e250e3d56 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:17.618507 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241f350-8b5d-497a-ac97-632e250e3d56 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:17.618507 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241f350-8b5d-497a-ac97-632e250e3d56 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:17.620057 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 518/1046] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:59:17.625240 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cb654-34f6-484e-845b-c8e55f12c463 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:17.625517 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cb654-34f6-484e-845b-c8e55f12c463 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:17.625823 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cb654-34f6-484e-845b-c8e55f12c463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:17.643224 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-aa2cb654-34f6-484e-845b-c8e55f12c463 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:59:17.644408 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-aa2cb654-34f6-484e-845b-c8e55f12c463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:59:17.713741 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 529/1047] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:59:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 03:59:17.736965 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241f350-8b5d-497a-ac97-632e250e3d56 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:17.848140 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241f350-8b5d-497a-ac97-632e250e3d56 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:17.862583 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:17.883524 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611f8fa-810c-4f29-b813-843914d0d763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:17.884279 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611f8fa-810c-4f29-b813-843914d0d763 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:17.884559 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611f8fa-810c-4f29-b813-843914d0d763 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:17.884836 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611f8fa-810c-4f29-b813-843914d0d763 None admin] PATH_INFO: `/v3/services/image` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:17.885840 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611f8fa-810c-4f29-b813-843914d0d763 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:17.887276 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611f8fa-810c-4f29-b813-843914d0d763 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:17.898978 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-c611f8fa-810c-4f29-b813-843914d0d763 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 03:59:17.898978 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:17.898978 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 03:59:17.898978 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 03:59:17.898978 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 03:59:17.898978 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 03:59:17.898978 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 03:59:17.898978 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:59:17.898978 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 03:59:17.898978 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:17.898978 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 03:59:17.898978 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:17.898978 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:17.898978 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:17.898978 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:17.898978 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:17.898978 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:17.899968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:17.899968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:17.899968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:17.899968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:17.899968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:17.899968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:17.899968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 03:59:17.899968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 03:59:17.899968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 03:59:17.899968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 03:59:17.899968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:17.899968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:17.899968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:17.899968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:17.899968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:17.899968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:17.905998 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:17.905998 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:17.905998 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:17.905998 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:17.905998 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:17.905998 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:17.905998 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:17.905998 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:17.905998 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:17.905998 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:17.905998 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 03:59:17.905998 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 03:59:17.905998 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 04 03:59:17.905998 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:17.905998 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 519/1048] 10.222.0.49 () {56 vars in 1105 bytes} [Mon Jul 4 03:59:17 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:59:17.907295 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2cb654-34f6-484e-845b-c8e55f12c463 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:17.929836 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:18.019282 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2cb654-34f6-484e-845b-c8e55f12c463 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:18.054180 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b7ac0-6bfe-4c80-9dab-578f5b5a1e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:18.054866 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b7ac0-6bfe-4c80-9dab-578f5b5a1e61 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:18.055149 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b7ac0-6bfe-4c80-9dab-578f5b5a1e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:18.055426 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b7ac0-6bfe-4c80-9dab-578f5b5a1e61 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:18.056136 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b7ac0-6bfe-4c80-9dab-578f5b5a1e61 None admin] RBAC: Adding query filter params (name=image) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:18.056442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b7ac0-6bfe-4c80-9dab-578f5b5a1e61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:18.057841 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b7ac0-6bfe-4c80-9dab-578f5b5a1e61 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:18.063159 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 530/1049] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:59:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:18.068721 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611f8fa-810c-4f29-b813-843914d0d763 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:18.183631 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611f8fa-810c-4f29-b813-843914d0d763 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:18.218165 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54bec67-7c2b-4924-8a35-c5afb7867730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:18.218850 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bec67-7c2b-4924-8a35-c5afb7867730 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:18.219113 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bec67-7c2b-4924-8a35-c5afb7867730 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:18.219412 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bec67-7c2b-4924-8a35-c5afb7867730 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:18.220106 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54bec67-7c2b-4924-8a35-c5afb7867730 None admin] RBAC: Adding query filter params (type=image) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:18.220416 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54bec67-7c2b-4924-8a35-c5afb7867730 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:18.221814 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54bec67-7c2b-4924-8a35-c5afb7867730 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:18.227069 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 520/1050] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:59:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:18.232729 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b7ac0-6bfe-4c80-9dab-578f5b5a1e61 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:18.323397 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:18.341520 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b7ac0-6bfe-4c80-9dab-578f5b5a1e61 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:18.377016 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95398928-0cc8-402f-8015-2d002fe48730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:18.377684 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95398928-0cc8-402f-8015-2d002fe48730 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:18.377970 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95398928-0cc8-402f-8015-2d002fe48730 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:18.378287 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95398928-0cc8-402f-8015-2d002fe48730 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:18.379037 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95398928-0cc8-402f-8015-2d002fe48730 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:18.380562 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95398928-0cc8-402f-8015-2d002fe48730 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:18.406195 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 531/1051] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Jul 4 03:59:18 2022] POST /identity/v3/endpoints => generated 327 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 03:59:18.731118 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1d20c-5bc6-4b0c-85a1-abbdc67b69c0 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:18.731689 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1d20c-5bc6-4b0c-85a1-abbdc67b69c0 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:18.731689 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1d20c-5bc6-4b0c-85a1-abbdc67b69c0 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:18.733239 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 521/1052] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:59:18.738494 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee1340-255e-47b0-83bf-d5fb876c57ca None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:18.738763 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee1340-255e-47b0-83bf-d5fb876c57ca None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:18.739075 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee1340-255e-47b0-83bf-d5fb876c57ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:18.756629 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-c9ee1340-255e-47b0-83bf-d5fb876c57ca None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:59:18.757821 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c9ee1340-255e-47b0-83bf-d5fb876c57ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:59:18.834436 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 532/1053] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:59:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 03:59:18.857933 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1d20c-5bc6-4b0c-85a1-abbdc67b69c0 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:18.907989 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:18.908466 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f9ef0-b6b1-4bff-b51c-cf6a3c21b012 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:18.908942 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f9ef0-b6b1-4bff-b51c-cf6a3c21b012 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:18.909049 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f9ef0-b6b1-4bff-b51c-cf6a3c21b012 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:18.910643 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 533/1054] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:59:18.915747 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874cc0c-05fd-42ac-96bd-cf18d4d64824 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:18.916040 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874cc0c-05fd-42ac-96bd-cf18d4d64824 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:18.916324 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874cc0c-05fd-42ac-96bd-cf18d4d64824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:18.934261 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-a874cc0c-05fd-42ac-96bd-cf18d4d64824 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:59:18.935477 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a874cc0c-05fd-42ac-96bd-cf18d4d64824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:59:18.984809 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1d20c-5bc6-4b0c-85a1-abbdc67b69c0 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:19.003091 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:19.013227 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 534/1055] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:59:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 03:59:19.021378 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94d7e7-3c3b-4e12-8b7b-7ec9286d24c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:19.022226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94d7e7-3c3b-4e12-8b7b-7ec9286d24c0 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:19.022515 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94d7e7-3c3b-4e12-8b7b-7ec9286d24c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:19.022796 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94d7e7-3c3b-4e12-8b7b-7ec9286d24c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:19.033719 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d94d7e7-3c3b-4e12-8b7b-7ec9286d24c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:59:19.035744 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874cc0c-05fd-42ac-96bd-cf18d4d64824 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:19.041336 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-6d94d7e7-3c3b-4e12-8b7b-7ec9286d24c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:59:19.041336 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:19.041336 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:19.041336 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:19.041336 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:19.041336 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:19.041336 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:19.041336 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:19.041336 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:19.041336 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:19.041336 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:19.041336 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:19.041336 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:59:19.041336 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:59:19.041336 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:59:19.041336 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:59:19.042365 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:59:19.042365 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:59:19.042365 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:59:19.042365 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:59:19.042365 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:19.042365 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:19.042365 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:19.042365 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:19.042365 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:19.042365 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:19.042365 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:19.042365 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:19.042365 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:19.042365 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:19.042365 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:19.042365 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:19.043232 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:19.043232 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:19.043232 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:19.043232 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:19.043232 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:59:19.043232 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:59:19.043232 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:59:19.043232 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:59:19.043232 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:59:19.043232 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:59:19.043232 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:59:19.043232 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:19.047695 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 522/1056] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Jul 4 03:59:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:59:19.048555 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94d7e7-3c3b-4e12-8b7b-7ec9286d24c0 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:19.142049 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874cc0c-05fd-42ac-96bd-cf18d4d64824 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:19.152886 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94d7e7-3c3b-4e12-8b7b-7ec9286d24c0 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:19.154593 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:19.178792 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a8e1a-ed55-4687-8c8b-b0179435072c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:19.179705 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a8e1a-ed55-4687-8c8b-b0179435072c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:19.180000 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a8e1a-ed55-4687-8c8b-b0179435072c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:19.180296 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a8e1a-ed55-4687-8c8b-b0179435072c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:19.190819 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91de775-17e9-41b8-8278-e662aa78ab47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:19.190955 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a8e1a-ed55-4687-8c8b-b0179435072c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:59:19.191546 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91de775-17e9-41b8-8278-e662aa78ab47 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:19.191838 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91de775-17e9-41b8-8278-e662aa78ab47 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:19.192119 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91de775-17e9-41b8-8278-e662aa78ab47 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:19.192937 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91de775-17e9-41b8-8278-e662aa78ab47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:19.193248 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91de775-17e9-41b8-8278-e662aa78ab47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:19.194692 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91de775-17e9-41b8-8278-e662aa78ab47 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:19.198967 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-e23a8e1a-ed55-4687-8c8b-b0179435072c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 03:59:19.198967 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:19.198967 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:19.198967 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:19.198967 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:19.198967 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:19.198967 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:19.198967 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:19.198967 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:19.198967 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:19.198967 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:19.198967 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:19.198967 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:59:19.198967 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:59:19.198967 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:59:19.198967 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:59:19.199909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:59:19.199909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:59:19.199909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:59:19.199909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:59:19.199909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:19.199909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:19.199909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:19.199909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:19.199909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:19.199909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:19.199909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:19.199909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:19.199909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:19.199909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:19.199909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:19.199909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:19.200764 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:19.200764 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:19.200764 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:19.200764 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:19.200764 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:59:19.200764 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:59:19.200764 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:59:19.200764 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:59:19.200764 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:59:19.200764 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:59:19.200764 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 03:59:19.200764 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:59:19.200764 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 535/1057] 10.222.0.49 () {56 vars in 1120 bytes} [Mon Jul 4 03:59:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:59:19.209801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 523/1058] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:59:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:19.209945 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a8e1a-ed55-4687-8c8b-b0179435072c None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:19.210675 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91de775-17e9-41b8-8278-e662aa78ab47 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:19.266024 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:19.312762 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a8e1a-ed55-4687-8c8b-b0179435072c None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:19.313799 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91de775-17e9-41b8-8278-e662aa78ab47 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:19.347665 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44680d78-d284-4509-b4e3-04203338b90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:19.348032 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e92ab7-01d6-4fa7-9de7-6cb8763d29ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:19.348396 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44680d78-d284-4509-b4e3-04203338b90f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:19.348842 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44680d78-d284-4509-b4e3-04203338b90f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:19.349047 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e92ab7-01d6-4fa7-9de7-6cb8763d29ed None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:19.349145 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44680d78-d284-4509-b4e3-04203338b90f None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:19.349329 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e92ab7-01d6-4fa7-9de7-6cb8763d29ed None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:19.349588 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e92ab7-01d6-4fa7-9de7-6cb8763d29ed None admin] PATH_INFO: `/v3/users/4d3029236cbd4e938ad4ef89b40ffd4b` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:19.349868 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44680d78-d284-4509-b4e3-04203338b90f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:19.351388 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44680d78-d284-4509-b4e3-04203338b90f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:19.351641 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44680d78-d284-4509-b4e3-04203338b90f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:19.360043 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 536/1059] 10.222.0.49 () {56 vars in 1115 bytes} [Mon Jul 4 03:59:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:59:19.365872 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44680d78-d284-4509-b4e3-04203338b90f None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:19.366015 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e92ab7-01d6-4fa7-9de7-6cb8763d29ed None admin] RBAC: Authorizing `identity:get_user(user_id=4d3029236cbd4e938ad4ef89b40ffd4b)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:19.367423 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e92ab7-01d6-4fa7-9de7-6cb8763d29ed None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:19.373684 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 524/1060] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:59:19 2022] GET /identity/v3/users/4d3029236cbd4e938ad4ef89b40ffd4b => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:59:19.374656 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e92ab7-01d6-4fa7-9de7-6cb8763d29ed None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:19.399505 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:19.478900 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e92ab7-01d6-4fa7-9de7-6cb8763d29ed None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:19.480488 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44680d78-d284-4509-b4e3-04203338b90f None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:19.500173 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:19.521880 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4239d3cb-0dd4-4cab-a71b-02f4b8083261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:19.522512 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239d3cb-0dd4-4cab-a71b-02f4b8083261 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:19.522798 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239d3cb-0dd4-4cab-a71b-02f4b8083261 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:19.523075 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239d3cb-0dd4-4cab-a71b-02f4b8083261 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:19.523686 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76706d89-4ff2-4f02-b35f-c889b4e117d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:19.524512 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76706d89-4ff2-4f02-b35f-c889b4e117d5 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:19.524798 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76706d89-4ff2-4f02-b35f-c889b4e117d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:19.525076 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76706d89-4ff2-4f02-b35f-c889b4e117d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:19.537134 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76706d89-4ff2-4f02-b35f-c889b4e117d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:19.538668 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76706d89-4ff2-4f02-b35f-c889b4e117d5 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:19.556095 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-76706d89-4ff2-4f02-b35f-c889b4e117d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:59:19.556095 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:19.556095 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:19.556095 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:19.556095 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:19.556095 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:19.556095 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:19.556095 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:19.556095 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:19.556095 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:19.556095 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:19.556095 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:19.556095 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:59:19.556095 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:59:19.556095 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:59:19.557336 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:59:19.557336 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:19.557336 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:19.557336 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:19.557336 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:19.557336 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:19.557336 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:19.557336 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:19.557336 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:19.557336 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:19.557336 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:19.557336 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:19.557336 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:19.557336 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:19.557336 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:19.557336 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:19.557336 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:19.558274 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:59:19.558274 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:59:19.558274 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:59:19.558274 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:59:19.558274 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 537/1061] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:59:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:59:19.565454 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76706d89-4ff2-4f02-b35f-c889b4e117d5 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:19.605302 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4239d3cb-0dd4-4cab-a71b-02f4b8083261 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:19.606927 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4239d3cb-0dd4-4cab-a71b-02f4b8083261 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:19.633831 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:19.668472 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76706d89-4ff2-4f02-b35f-c889b4e117d5 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:19.702766 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692235d-7128-44a8-91d7-0aa84ccfa2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:19.703433 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692235d-7128-44a8-91d7-0aa84ccfa2bc None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:19.703714 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692235d-7128-44a8-91d7-0aa84ccfa2bc None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:19.703998 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692235d-7128-44a8-91d7-0aa84ccfa2bc None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:19.704728 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692235d-7128-44a8-91d7-0aa84ccfa2bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:19.705038 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692235d-7128-44a8-91d7-0aa84ccfa2bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:19.706442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692235d-7128-44a8-91d7-0aa84ccfa2bc None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:19.722317 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 525/1062] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:59:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 03:59:19.722500 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 538/1063] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:59:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:59:19.724072 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4239d3cb-0dd4-4cab-a71b-02f4b8083261 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:19.724335 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692235d-7128-44a8-91d7-0aa84ccfa2bc None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:19.754986 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:19.829017 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4239d3cb-0dd4-4cab-a71b-02f4b8083261 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:19.838382 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692235d-7128-44a8-91d7-0aa84ccfa2bc None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:19.856328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:19.872812 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1be9c-add6-4f13-93fa-5285c3877c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:19.873796 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1be9c-add6-4f13-93fa-5285c3877c9b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:19.874197 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1be9c-add6-4f13-93fa-5285c3877c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:19.874498 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1be9c-add6-4f13-93fa-5285c3877c9b None admin] PATH_INFO: `/v3/projects/12601778c80e4432bedcf7454888a8bb` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:19.875709 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1be9c-add6-4f13-93fa-5285c3877c9b None admin] RBAC: Authorizing `identity:get_project(project_id=12601778c80e4432bedcf7454888a8bb)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:19.877389 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1be9c-add6-4f13-93fa-5285c3877c9b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:19.882300 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de306b-063b-499a-a45d-94d6e99a50cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:19.883104 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de306b-063b-499a-a45d-94d6e99a50cf None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:19.883385 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de306b-063b-499a-a45d-94d6e99a50cf None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:19.883658 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de306b-063b-499a-a45d-94d6e99a50cf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:19.884360 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 526/1064] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:59:19 2022] GET /identity/v3/projects/12601778c80e4432bedcf7454888a8bb => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:59:19.885540 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1be9c-add6-4f13-93fa-5285c3877c9b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:19.893137 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de306b-063b-499a-a45d-94d6e99a50cf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:19.895468 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de306b-063b-499a-a45d-94d6e99a50cf None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:19.911527 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-92de306b-063b-499a-a45d-94d6e99a50cf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 03:59:19.911527 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:19.911527 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:19.911527 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:19.911527 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:19.911527 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:19.911527 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:19.911527 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:19.911527 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:19.911527 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:19.911527 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:19.911527 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:19.911527 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 03:59:19.911527 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 03:59:19.911527 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 03:59:19.911527 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 03:59:19.912948 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:19.912948 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:19.912948 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 03:59:19.912948 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:59:19.912948 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 03:59:19.912948 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:59:19.912948 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:19.912948 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:19.912948 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:19.912948 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:19.912948 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:19.912948 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:19.912948 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:19.912948 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:19.912948 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:19.912948 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:19.912948 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:19.912948 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:19.913909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:19.913909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:19.913909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 03:59:19.913909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 03:59:19.913909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 03:59:19.913909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 03:59:19.913909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 03:59:19.913909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 03:59:19.913909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 03:59:19.913909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:59:19.913909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 539/1065] 10.222.0.49 () {56 vars in 1093 bytes} [Mon Jul 4 03:59:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:59:19.918419 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de306b-063b-499a-a45d-94d6e99a50cf None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:19.993235 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1be9c-add6-4f13-93fa-5285c3877c9b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:20.021788 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:20.030895 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df85369-7960-4454-9038-d453c3af7276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:20.031562 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df85369-7960-4454-9038-d453c3af7276 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:20.031837 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df85369-7960-4454-9038-d453c3af7276 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:20.032114 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df85369-7960-4454-9038-d453c3af7276 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:20.032946 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df85369-7960-4454-9038-d453c3af7276 None admin] RBAC: Adding query filter params (role.id=2eee98054d42475bb7e22a8487ab235e, scope.project.id=12601778c80e4432bedcf7454888a8bb, user.id=4d3029236cbd4e938ad4ef89b40ffd4b) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:20.033258 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df85369-7960-4454-9038-d453c3af7276 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:20.034465 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de306b-063b-499a-a45d-94d6e99a50cf None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:20.034746 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df85369-7960-4454-9038-d453c3af7276 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:20.040448 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 527/1066] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:59:19 2022] GET /identity/v3/role_assignments?user.id=4d3029236cbd4e938ad4ef89b40ffd4b&scope.project.id=12601778c80e4432bedcf7454888a8bb&role.id=2eee98054d42475bb7e22a8487ab235e => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:20.074068 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b2ae5-6b31-45d0-9d6e-330851bf7f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:20.075063 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b2ae5-6b31-45d0-9d6e-330851bf7f07 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:20.075502 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b2ae5-6b31-45d0-9d6e-330851bf7f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:20.075928 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b2ae5-6b31-45d0-9d6e-330851bf7f07 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:20.076952 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b2ae5-6b31-45d0-9d6e-330851bf7f07 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:20.077446 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b2ae5-6b31-45d0-9d6e-330851bf7f07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:20.079197 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b2ae5-6b31-45d0-9d6e-330851bf7f07 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:20.100259 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 540/1067] 10.222.0.49 () {56 vars in 1133 bytes} [Mon Jul 4 03:59:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:59:20.105877 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df85369-7960-4454-9038-d453c3af7276 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:20.172641 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:20.222557 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df85369-7960-4454-9038-d453c3af7276 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:20.264251 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24532b-cbde-456c-b9bb-b7295e5fe991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:20.265456 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24532b-cbde-456c-b9bb-b7295e5fe991 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:20.265941 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24532b-cbde-456c-b9bb-b7295e5fe991 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:20.266464 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24532b-cbde-456c-b9bb-b7295e5fe991 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:20.278507 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24532b-cbde-456c-b9bb-b7295e5fe991 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:20.280290 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24532b-cbde-456c-b9bb-b7295e5fe991 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:20.299283 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-fd24532b-cbde-456c-b9bb-b7295e5fe991 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:59:20.299283 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:20.299283 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:20.299283 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:20.299283 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:20.299283 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:20.299283 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:20.299283 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:20.299283 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:20.299283 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:20.299283 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:20.299283 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:20.299283 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:59:20.299283 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:59:20.299283 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:59:20.300240 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:59:20.300240 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:20.300240 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:20.300240 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:20.300240 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:20.300240 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:20.300240 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:20.300240 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:20.300240 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:20.300240 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:20.300240 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:20.300240 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:20.300240 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:20.300240 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:20.300240 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:20.300240 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:20.300240 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:20.301181 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:59:20.301181 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:59:20.301181 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:59:20.301181 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:20.303563 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 528/1068] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:59:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:59:20.309160 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b2ae5-6b31-45d0-9d6e-330851bf7f07 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:20.414929 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b2ae5-6b31-45d0-9d6e-330851bf7f07 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:20.449973 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc29db-1500-4975-9988-b28ead623e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:20.450865 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc29db-1500-4975-9988-b28ead623e0d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:20.451157 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc29db-1500-4975-9988-b28ead623e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:20.451433 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc29db-1500-4975-9988-b28ead623e0d None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:20.452165 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc29db-1500-4975-9988-b28ead623e0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:20.452475 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc29db-1500-4975-9988-b28ead623e0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:20.453976 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc29db-1500-4975-9988-b28ead623e0d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:20.459646 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cfeda-7537-4524-b577-2ca417427a3c None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:20.459937 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cfeda-7537-4524-b577-2ca417427a3c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:20.460216 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cfeda-7537-4524-b577-2ca417427a3c None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:20.461745 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 529/1069] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 03:59:20.470191 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 541/1070] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:59:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:20.470369 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36835c57-745e-441c-b10f-58d043855e33 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:20.470369 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36835c57-745e-441c-b10f-58d043855e33 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:20.470369 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36835c57-745e-441c-b10f-58d043855e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:20.472268 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc29db-1500-4975-9988-b28ead623e0d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:20.485902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:20.486546 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-36835c57-745e-441c-b10f-58d043855e33 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:59:20.487860 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-36835c57-745e-441c-b10f-58d043855e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:59:20.574487 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 530/1071] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:59:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 03:59:20.591459 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc29db-1500-4975-9988-b28ead623e0d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:20.592225 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36835c57-745e-441c-b10f-58d043855e33 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:20.626368 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3141b5d-edff-4bb4-99a0-07caaebeb7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:20.627167 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3141b5d-edff-4bb4-99a0-07caaebeb7cc None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:20.627451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3141b5d-edff-4bb4-99a0-07caaebeb7cc None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:20.627722 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3141b5d-edff-4bb4-99a0-07caaebeb7cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:20.629918 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:20.635386 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3141b5d-edff-4bb4-99a0-07caaebeb7cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:20.636959 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3141b5d-edff-4bb4-99a0-07caaebeb7cc None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:20.651817 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-d3141b5d-edff-4bb4-99a0-07caaebeb7cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:59:20.651817 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:20.651817 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:20.651817 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:20.651817 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:20.651817 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:20.651817 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:20.651817 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:20.651817 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:20.651817 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:20.651817 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:20.651817 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:20.651817 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 03:59:20.651817 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 03:59:20.651817 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 03:59:20.652759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 03:59:20.652759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:20.652759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:20.652759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:20.652759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:20.652759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:20.652759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:20.652759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:20.652759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:20.652759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:20.652759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:20.652759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:20.652759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:20.652759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:20.652759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:20.652759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:20.652759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:20.654530 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 03:59:20.654530 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 03:59:20.654530 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 03:59:20.654530 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 03:59:20.654530 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 03:59:20.654530 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 03:59:20.654530 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:59:20.654530 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:59:20.654530 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 542/1072] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:59:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:59:20.659089 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3141b5d-edff-4bb4-99a0-07caaebeb7cc None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:20.707166 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36835c57-745e-441c-b10f-58d043855e33 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:20.731958 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:20.743480 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addaef7e-1e6b-49ef-9a81-d73bd747cf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:20.744157 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addaef7e-1e6b-49ef-9a81-d73bd747cf0b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:20.744448 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addaef7e-1e6b-49ef-9a81-d73bd747cf0b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:20.744730 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addaef7e-1e6b-49ef-9a81-d73bd747cf0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:20.770755 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3141b5d-edff-4bb4-99a0-07caaebeb7cc None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:20.809113 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049b6ec-97cf-489f-8977-100a51ea4b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:20.809783 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049b6ec-97cf-489f-8977-100a51ea4b60 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:20.810388 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049b6ec-97cf-489f-8977-100a51ea4b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:20.810696 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049b6ec-97cf-489f-8977-100a51ea4b60 None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:20.811505 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0049b6ec-97cf-489f-8977-100a51ea4b60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:20.811827 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0049b6ec-97cf-489f-8977-100a51ea4b60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:20.813288 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0049b6ec-97cf-489f-8977-100a51ea4b60 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:20.817741 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addaef7e-1e6b-49ef-9a81-d73bd747cf0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:20.819526 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addaef7e-1e6b-49ef-9a81-d73bd747cf0b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:20.825373 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 543/1073] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Jul 4 03:59:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:59:20.831271 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049b6ec-97cf-489f-8977-100a51ea4b60 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:20.857319 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:20.924401 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 531/1074] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:59:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 04 03:59:20.930335 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addaef7e-1e6b-49ef-9a81-d73bd747cf0b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:20.945951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049b6ec-97cf-489f-8977-100a51ea4b60 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:20.976719 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:20.985226 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9e43d-1c53-46ca-9777-651ea600dfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:20.986124 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9e43d-1c53-46ca-9777-651ea600dfa9 None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:20.986443 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9e43d-1c53-46ca-9777-651ea600dfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:20.986725 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9e43d-1c53-46ca-9777-651ea600dfa9 None admin] PATH_INFO: `/v3/projects/424a145a22434ef7a14b6108e6118ccb/users/8334e75253f843a980b01c6f0cda6015/roles/bc829c0c3f7b402c930a7f1d58b27331` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:20.989022 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef9e43d-1c53-46ca-9777-651ea600dfa9 None admin] RBAC: Authorizing `identity:create_grant(project_id=424a145a22434ef7a14b6108e6118ccb, user_id=8334e75253f843a980b01c6f0cda6015, role_id=bc829c0c3f7b402c930a7f1d58b27331)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:20.990589 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef9e43d-1c53-46ca-9777-651ea600dfa9 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:21.005671 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 544/1075] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Jul 4 03:59:20 2022] PUT /identity/v3/projects/424a145a22434ef7a14b6108e6118ccb/users/8334e75253f843a980b01c6f0cda6015/roles/bc829c0c3f7b402c930a7f1d58b27331 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 03:59:21.052103 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addaef7e-1e6b-49ef-9a81-d73bd747cf0b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:21.093150 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace8cdd-a3c3-499d-aabb-0d403cbbfb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:21.094309 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace8cdd-a3c3-499d-aabb-0d403cbbfb73 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:21.094740 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace8cdd-a3c3-499d-aabb-0d403cbbfb73 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:21.095175 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace8cdd-a3c3-499d-aabb-0d403cbbfb73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:21.099102 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:21.109331 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace8cdd-a3c3-499d-aabb-0d403cbbfb73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:21.111333 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace8cdd-a3c3-499d-aabb-0d403cbbfb73 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:21.131434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-dace8cdd-a3c3-499d-aabb-0d403cbbfb73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:59:21.131434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:21.131434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:21.131434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:21.131434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:21.131434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:21.131434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:21.131434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:21.131434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:21.131434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:21.131434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:21.131434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:21.131434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:59:21.131434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:59:21.131434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:59:21.132652 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:59:21.132652 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:21.132652 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:21.132652 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:21.132652 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:21.132652 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:21.132652 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:21.132652 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:21.132652 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:21.132652 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:21.132652 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:21.132652 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:21.132652 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:21.132652 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:21.132652 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:21.132652 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:21.132652 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:21.133780 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:59:21.133780 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:59:21.133780 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:59:21.133780 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:21.135890 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 532/1076] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:59:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:59:21.142216 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9e43d-1c53-46ca-9777-651ea600dfa9 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:21.253360 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9e43d-1c53-46ca-9777-651ea600dfa9 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:21.287975 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6483575-f149-4e55-b86a-c6af3b27d61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:21.288646 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6483575-f149-4e55-b86a-c6af3b27d61f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:21.288897 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6483575-f149-4e55-b86a-c6af3b27d61f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:21.289216 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6483575-f149-4e55-b86a-c6af3b27d61f None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:21.289951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6483575-f149-4e55-b86a-c6af3b27d61f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:21.290292 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6483575-f149-4e55-b86a-c6af3b27d61f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:21.291698 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6483575-f149-4e55-b86a-c6af3b27d61f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:21.304110 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 545/1077] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:59:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:22.087865 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd81b0a-5f04-446d-a26d-09e58556cb14 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:22.088406 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd81b0a-5f04-446d-a26d-09e58556cb14 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:22.088406 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd81b0a-5f04-446d-a26d-09e58556cb14 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:22.089777 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 533/1078] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:59:22.095288 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db605570-9df9-4bac-b118-012295741281 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:22.095708 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db605570-9df9-4bac-b118-012295741281 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:22.095896 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db605570-9df9-4bac-b118-012295741281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:22.113527 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-db605570-9df9-4bac-b118-012295741281 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:59:22.114801 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-db605570-9df9-4bac-b118-012295741281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:59:22.161824 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:22.186048 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 546/1079] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:59:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 03:59:22.208685 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd81b0a-5f04-446d-a26d-09e58556cb14 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:22.316643 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd81b0a-5f04-446d-a26d-09e58556cb14 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:22.352123 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27a98e-f2cc-4b27-99bc-362d9412e998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:22.352916 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27a98e-f2cc-4b27-99bc-362d9412e998 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:22.353201 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27a98e-f2cc-4b27-99bc-362d9412e998 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:22.353449 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27a98e-f2cc-4b27-99bc-362d9412e998 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:22.363621 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27a98e-f2cc-4b27-99bc-362d9412e998 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:59:22.371163 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-7f27a98e-f2cc-4b27-99bc-362d9412e998 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:59:22.371163 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:22.371163 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:22.371163 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:22.371163 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:22.371163 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:22.371163 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:22.371163 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:22.371163 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:22.371163 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:22.371163 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:22.371163 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:22.371163 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:59:22.371163 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:59:22.371163 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:59:22.371163 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:59:22.372330 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:59:22.372330 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:59:22.372330 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:59:22.372330 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:59:22.372330 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:22.372330 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:22.372330 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:22.372330 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:22.372330 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:22.372330 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:22.372330 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:22.372330 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:22.372330 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:22.372330 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:22.372330 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:22.372330 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:22.373244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:22.373244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:22.373244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:22.373244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:22.373244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:59:22.373244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:59:22.373244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:59:22.373244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:59:22.373244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:59:22.373244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:59:22.373244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:59:22.373244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:22.373244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 534/1080] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Jul 4 03:59:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:59:22.378573 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db605570-9df9-4bac-b118-012295741281 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:22.481861 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db605570-9df9-4bac-b118-012295741281 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:22.517939 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726d3cb-a57e-4eb0-a964-e7d3eb8e75fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:22.518643 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726d3cb-a57e-4eb0-a964-e7d3eb8e75fd None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:22.518934 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726d3cb-a57e-4eb0-a964-e7d3eb8e75fd None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:22.519216 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726d3cb-a57e-4eb0-a964-e7d3eb8e75fd None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:22.519975 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0726d3cb-a57e-4eb0-a964-e7d3eb8e75fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:22.520294 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0726d3cb-a57e-4eb0-a964-e7d3eb8e75fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:22.521760 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0726d3cb-a57e-4eb0-a964-e7d3eb8e75fd None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:22.530228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 547/1081] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:59:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:22.536207 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27a98e-f2cc-4b27-99bc-362d9412e998 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:22.601185 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:22.656454 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27a98e-f2cc-4b27-99bc-362d9412e998 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:22.691911 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af85c7-cf57-489c-a690-6f3f4a638b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:22.692794 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af85c7-cf57-489c-a690-6f3f4a638b47 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:22.693080 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af85c7-cf57-489c-a690-6f3f4a638b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:22.693358 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af85c7-cf57-489c-a690-6f3f4a638b47 None admin] PATH_INFO: `/v3/users/4d3029236cbd4e938ad4ef89b40ffd4b` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:22.694627 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38af85c7-cf57-489c-a690-6f3f4a638b47 None admin] RBAC: Authorizing `identity:get_user(user_id=4d3029236cbd4e938ad4ef89b40ffd4b)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:22.696085 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38af85c7-cf57-489c-a690-6f3f4a638b47 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:22.697744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 535/1082] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:59:22 2022] GET /identity/v3/users/4d3029236cbd4e938ad4ef89b40ffd4b => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:22.703746 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726d3cb-a57e-4eb0-a964-e7d3eb8e75fd None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:22.748109 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:22.810506 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726d3cb-a57e-4eb0-a964-e7d3eb8e75fd None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:22.848250 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418636c-cffe-4f69-b140-330f6eb46cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:22.849181 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418636c-cffe-4f69-b140-330f6eb46cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:22.849457 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418636c-cffe-4f69-b140-330f6eb46cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:22.849736 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418636c-cffe-4f69-b140-330f6eb46cb9 None admin] PATH_INFO: `/v3/projects/12601778c80e4432bedcf7454888a8bb` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:22.850966 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418636c-cffe-4f69-b140-330f6eb46cb9 None admin] RBAC: Authorizing `identity:get_project(project_id=12601778c80e4432bedcf7454888a8bb)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:22.852475 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418636c-cffe-4f69-b140-330f6eb46cb9 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:22.854169 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 548/1083] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:59:22 2022] GET /identity/v3/projects/12601778c80e4432bedcf7454888a8bb => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:22.860315 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af85c7-cf57-489c-a690-6f3f4a638b47 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:22.993520 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af85c7-cf57-489c-a690-6f3f4a638b47 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:23.010803 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:23.027465 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1e270-86c3-413c-8dd0-bcb5cf2a2396 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:23.027759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1e270-86c3-413c-8dd0-bcb5cf2a2396 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:23.028040 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1e270-86c3-413c-8dd0-bcb5cf2a2396 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:23.029437 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 549/1084] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:59:23.030346 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89b20a-b970-453f-8b92-12a3937b2083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:23.031249 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89b20a-b970-453f-8b92-12a3937b2083 None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:23.031528 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89b20a-b970-453f-8b92-12a3937b2083 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:23.031802 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89b20a-b970-453f-8b92-12a3937b2083 None admin] PATH_INFO: `/v3/projects/12601778c80e4432bedcf7454888a8bb/users/4d3029236cbd4e938ad4ef89b40ffd4b/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:23.033922 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec89b20a-b970-453f-8b92-12a3937b2083 None admin] RBAC: Authorizing `identity:create_grant(project_id=12601778c80e4432bedcf7454888a8bb, user_id=4d3029236cbd4e938ad4ef89b40ffd4b, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:23.034289 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2880cde-ddd1-4376-9e57-1648d8bbada3 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:23.034584 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2880cde-ddd1-4376-9e57-1648d8bbada3 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:23.034867 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2880cde-ddd1-4376-9e57-1648d8bbada3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:23.035422 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec89b20a-b970-453f-8b92-12a3937b2083 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:23.049617 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 536/1085] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Jul 4 03:59:22 2022] PUT /identity/v3/projects/12601778c80e4432bedcf7454888a8bb/users/4d3029236cbd4e938ad4ef89b40ffd4b/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 03:59:23.052400 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-d2880cde-ddd1-4376-9e57-1648d8bbada3 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:59:23.053596 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d2880cde-ddd1-4376-9e57-1648d8bbada3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:59:23.127826 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 550/1086] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:59:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 03:59:23.152107 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89b20a-b970-453f-8b92-12a3937b2083 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:23.257633 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89b20a-b970-453f-8b92-12a3937b2083 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:23.293389 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b142e88-6a16-4a70-991d-12b034c10580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:23.294234 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b142e88-6a16-4a70-991d-12b034c10580 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:23.294520 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b142e88-6a16-4a70-991d-12b034c10580 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:23.294799 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b142e88-6a16-4a70-991d-12b034c10580 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:23.305488 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b142e88-6a16-4a70-991d-12b034c10580 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:59:23.313572 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-1b142e88-6a16-4a70-991d-12b034c10580 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 03:59:23.313572 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:23.313572 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:23.313572 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:23.313572 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:23.313572 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:23.313572 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:23.313572 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:23.313572 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:23.313572 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:23.313572 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:23.313572 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:23.313572 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:59:23.313572 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:59:23.313572 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:59:23.313572 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:59:23.314692 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:59:23.314692 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:59:23.314692 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:59:23.314692 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:59:23.314692 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:23.314692 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:23.314692 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:23.314692 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:23.314692 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:23.314692 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:23.314692 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:23.314692 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:23.314692 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:23.314692 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:23.314692 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:23.314692 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:23.315549 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:23.315549 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:23.315549 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:23.315549 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:23.315549 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:59:23.315549 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:59:23.315549 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:59:23.315549 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:59:23.315549 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:59:23.315549 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:59:23.315549 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 04 03:59:23.315549 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:23.315549 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 537/1087] 10.222.0.49 () {56 vars in 1120 bytes} [Mon Jul 4 03:59:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:59:23.320984 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2880cde-ddd1-4376-9e57-1648d8bbada3 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:23.362517 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:23.424356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2880cde-ddd1-4376-9e57-1648d8bbada3 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:23.459457 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e619e-18cd-4b2b-9979-6f1d0b8214c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:23.460126 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e619e-18cd-4b2b-9979-6f1d0b8214c2 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:23.460411 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e619e-18cd-4b2b-9979-6f1d0b8214c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:23.460687 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e619e-18cd-4b2b-9979-6f1d0b8214c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:23.461438 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03e619e-18cd-4b2b-9979-6f1d0b8214c2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:23.461747 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03e619e-18cd-4b2b-9979-6f1d0b8214c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:23.463169 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03e619e-18cd-4b2b-9979-6f1d0b8214c2 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:23.471345 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 551/1088] 10.222.0.49 () {56 vars in 1115 bytes} [Mon Jul 4 03:59:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:23.477012 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b142e88-6a16-4a70-991d-12b034c10580 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:23.515129 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:23.583382 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b142e88-6a16-4a70-991d-12b034c10580 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:23.618726 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc9e7e-b902-4e39-a4fc-264c88d5044e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:23.619537 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc9e7e-b902-4e39-a4fc-264c88d5044e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:23.619827 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc9e7e-b902-4e39-a4fc-264c88d5044e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:23.620109 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc9e7e-b902-4e39-a4fc-264c88d5044e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:23.631136 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc9e7e-b902-4e39-a4fc-264c88d5044e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:23.632620 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc9e7e-b902-4e39-a4fc-264c88d5044e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:23.650309 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-3fbc9e7e-b902-4e39-a4fc-264c88d5044e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:59:23.650309 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:23.650309 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:23.650309 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:23.650309 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:23.650309 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:23.650309 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:23.650309 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:23.650309 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:23.650309 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:23.650309 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:23.650309 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:23.650309 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:59:23.650309 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:59:23.650309 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:59:23.651326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:59:23.651326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:23.651326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:23.651326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:23.651326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:23.651326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:23.651326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:23.651326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:23.651326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:23.651326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:23.651326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:23.651326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:23.651326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:23.651326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:23.651326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:23.651326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:23.651326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:23.652239 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:59:23.652239 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:59:23.652239 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:59:23.652239 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:23.652239 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 538/1089] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:59:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:59:23.657889 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e619e-18cd-4b2b-9979-6f1d0b8214c2 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:23.758619 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:23.762541 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e619e-18cd-4b2b-9979-6f1d0b8214c2 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:23.797540 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d9f34-4a02-44c1-b9e7-3ae6a78f9fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:23.798195 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d9f34-4a02-44c1-b9e7-3ae6a78f9fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:23.798510 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d9f34-4a02-44c1-b9e7-3ae6a78f9fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:23.798790 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d9f34-4a02-44c1-b9e7-3ae6a78f9fc0 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:23.799512 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d9f34-4a02-44c1-b9e7-3ae6a78f9fc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:23.799820 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d9f34-4a02-44c1-b9e7-3ae6a78f9fc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:23.801203 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d9f34-4a02-44c1-b9e7-3ae6a78f9fc0 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:23.813580 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 552/1090] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:23.819279 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc9e7e-b902-4e39-a4fc-264c88d5044e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:23.911298 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:23.924244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc9e7e-b902-4e39-a4fc-264c88d5044e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:23.958056 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe52b6-b6ec-4640-a1de-cd495b8cb22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:23.958870 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe52b6-b6ec-4640-a1de-cd495b8cb22f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:23.959153 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe52b6-b6ec-4640-a1de-cd495b8cb22f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:23.959422 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe52b6-b6ec-4640-a1de-cd495b8cb22f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:23.973003 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe52b6-b6ec-4640-a1de-cd495b8cb22f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:23.974565 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe52b6-b6ec-4640-a1de-cd495b8cb22f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:23.988614 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-8fbe52b6-b6ec-4640-a1de-cd495b8cb22f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 04 03:59:23.988614 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:23.988614 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:23.988614 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:23.988614 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:23.988614 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:23.988614 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:23.988614 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:23.988614 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:23.988614 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:23.988614 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:23.988614 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:23.988614 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 03:59:23.988614 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 03:59:23.988614 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 03:59:23.988614 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 03:59:23.989701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:23.989701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:23.989701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 03:59:23.989701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:59:23.989701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 03:59:23.989701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 03:59:23.989701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:23.989701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:23.989701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:23.989701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:23.989701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:23.989701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:23.989701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:23.989701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:23.989701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:23.989701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:23.989701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:23.989701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:23.990700 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:23.990700 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:23.990700 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 03:59:23.990700 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 03:59:23.990700 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 03:59:23.990700 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 03:59:23.990700 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 03:59:23.990700 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 03:59:23.990700 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 04 03:59:23.990700 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:23.990700 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 539/1091] 10.222.0.49 () {56 vars in 1093 bytes} [Mon Jul 4 03:59:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:59:23.995802 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d9f34-4a02-44c1-b9e7-3ae6a78f9fc0 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:24.096950 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d9f34-4a02-44c1-b9e7-3ae6a78f9fc0 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:24.135685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cebb3d-a0a2-4731-b68b-d0146209c178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:24.136383 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cebb3d-a0a2-4731-b68b-d0146209c178 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:24.136630 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cebb3d-a0a2-4731-b68b-d0146209c178 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:24.136891 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cebb3d-a0a2-4731-b68b-d0146209c178 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:24.137742 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cebb3d-a0a2-4731-b68b-d0146209c178 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:24.138054 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cebb3d-a0a2-4731-b68b-d0146209c178 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:24.139552 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cebb3d-a0a2-4731-b68b-d0146209c178 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:24.157715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 553/1092] 10.222.0.49 () {56 vars in 1133 bytes} [Mon Jul 4 03:59:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:24.163543 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe52b6-b6ec-4640-a1de-cd495b8cb22f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:24.263008 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe52b6-b6ec-4640-a1de-cd495b8cb22f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:24.297166 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7227be75-c1cd-4c4c-a020-39ba78066a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:24.297813 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227be75-c1cd-4c4c-a020-39ba78066a40 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:24.298091 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227be75-c1cd-4c4c-a020-39ba78066a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:24.298395 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227be75-c1cd-4c4c-a020-39ba78066a40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:24.316082 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:24.365461 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7227be75-c1cd-4c4c-a020-39ba78066a40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:24.366899 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7227be75-c1cd-4c4c-a020-39ba78066a40 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:24.465259 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 540/1093] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:59:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 03:59:24.471164 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cebb3d-a0a2-4731-b68b-d0146209c178 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:24.491816 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:24.575183 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cebb3d-a0a2-4731-b68b-d0146209c178 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:24.614707 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505795e-b971-41f2-b099-299b0ec490f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:24.615569 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505795e-b971-41f2-b099-299b0ec490f9 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:24.615763 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505795e-b971-41f2-b099-299b0ec490f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:24.616067 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505795e-b971-41f2-b099-299b0ec490f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:24.626730 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505795e-b971-41f2-b099-299b0ec490f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:24.628188 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505795e-b971-41f2-b099-299b0ec490f9 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:24.646212 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-f505795e-b971-41f2-b099-299b0ec490f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:59:24.646212 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:24.646212 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:24.646212 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:24.646212 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:24.646212 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:24.646212 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:24.646212 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:24.646212 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:24.646212 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:24.646212 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:24.646212 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:24.646212 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:59:24.646212 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:59:24.646212 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:59:24.647140 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:59:24.647140 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:24.647140 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:24.647140 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:24.647140 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:24.647140 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:24.647140 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:24.647140 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:24.647140 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:24.647140 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:24.647140 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:24.647140 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:24.647140 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:24.647140 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:24.647140 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:24.647140 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:24.647140 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:24.648054 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 03:59:24.648054 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:59:24.648054 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 03:59:24.648054 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:59:24.648054 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 554/1094] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:59:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:59:24.653323 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7227be75-c1cd-4c4c-a020-39ba78066a40 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:24.706350 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:24.759273 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7227be75-c1cd-4c4c-a020-39ba78066a40 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:24.797620 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6872c-4a2c-4ffd-9ae8-0db1ba04ed69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:24.798540 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6872c-4a2c-4ffd-9ae8-0db1ba04ed69 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:24.798971 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6872c-4a2c-4ffd-9ae8-0db1ba04ed69 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:24.799432 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6872c-4a2c-4ffd-9ae8-0db1ba04ed69 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:24.800757 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6872c-4a2c-4ffd-9ae8-0db1ba04ed69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:24.801247 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6872c-4a2c-4ffd-9ae8-0db1ba04ed69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:24.802910 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6872c-4a2c-4ffd-9ae8-0db1ba04ed69 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:24.814736 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 541/1095] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 03:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:24.820526 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505795e-b971-41f2-b099-299b0ec490f9 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:24.890793 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:24.921845 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505795e-b971-41f2-b099-299b0ec490f9 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:24.956578 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063f3ab-4b45-487f-a337-c0a2de8b435c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:24.957366 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063f3ab-4b45-487f-a337-c0a2de8b435c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:24.957649 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063f3ab-4b45-487f-a337-c0a2de8b435c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:24.957982 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063f3ab-4b45-487f-a337-c0a2de8b435c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:24.968064 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063f3ab-4b45-487f-a337-c0a2de8b435c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:24.969048 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063f3ab-4b45-487f-a337-c0a2de8b435c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:24.982623 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-2063f3ab-4b45-487f-a337-c0a2de8b435c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:59:24.982623 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:24.982623 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:24.982623 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:24.982623 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:24.982623 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:24.982623 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:24.982623 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:24.982623 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:24.982623 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:24.982623 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:24.982623 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:24.982623 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 03:59:24.982623 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 03:59:24.982623 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 03:59:24.983683 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 03:59:24.983683 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:24.983683 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:24.983683 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:24.983683 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:24.983683 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:24.983683 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:24.983683 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:24.983683 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:24.983683 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:24.983683 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:24.983683 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:24.983683 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:24.983683 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:24.983683 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:24.983683 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:24.983683 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:24.984573 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 03:59:24.984573 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 03:59:24.984573 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 03:59:24.984573 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 03:59:24.984573 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 03:59:24.984573 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 03:59:24.984573 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 03:59:24.984573 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:59:24.984573 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 555/1096] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 03:59:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:59:24.989988 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6872c-4a2c-4ffd-9ae8-0db1ba04ed69 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:25.039471 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4945f-0262-4614-a3aa-8b1f26e3cc01 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:25.039769 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4945f-0262-4614-a3aa-8b1f26e3cc01 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:25.040041 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4945f-0262-4614-a3aa-8b1f26e3cc01 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:25.041416 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 556/1097] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 03:59:25.046361 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4a7d9-bbbe-4f9f-acdc-ba96ede7c713 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:25.046655 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4a7d9-bbbe-4f9f-acdc-ba96ede7c713 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:25.046936 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4a7d9-bbbe-4f9f-acdc-ba96ede7c713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:25.063917 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-bfb4a7d9-bbbe-4f9f-acdc-ba96ede7c713 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:59:25.065115 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-bfb4a7d9-bbbe-4f9f-acdc-ba96ede7c713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:59:25.091878 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6872c-4a2c-4ffd-9ae8-0db1ba04ed69 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:25.100843 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:25.131796 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae44bf7-1b1e-4bd3-9a1c-1fba1ce6c0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:25.132467 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae44bf7-1b1e-4bd3-9a1c-1fba1ce6c0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:25.132749 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae44bf7-1b1e-4bd3-9a1c-1fba1ce6c0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:25.133026 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae44bf7-1b1e-4bd3-9a1c-1fba1ce6c0f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:25.133806 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae44bf7-1b1e-4bd3-9a1c-1fba1ce6c0f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:25.134121 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae44bf7-1b1e-4bd3-9a1c-1fba1ce6c0f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:25.135925 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae44bf7-1b1e-4bd3-9a1c-1fba1ce6c0f1 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:25.137232 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 557/1098] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:59:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 03:59:25.148191 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 542/1099] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Jul 4 03:59:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:25.154126 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4a7d9-bbbe-4f9f-acdc-ba96ede7c713 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:25.160838 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae44bf7-1b1e-4bd3-9a1c-1fba1ce6c0f1 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:25.212724 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:25.252991 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4a7d9-bbbe-4f9f-acdc-ba96ede7c713 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:25.259336 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae44bf7-1b1e-4bd3-9a1c-1fba1ce6c0f1 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:25.287855 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06680565-2976-477a-b11e-8fabab13a030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:25.288516 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06680565-2976-477a-b11e-8fabab13a030 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:25.288802 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06680565-2976-477a-b11e-8fabab13a030 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:25.289061 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06680565-2976-477a-b11e-8fabab13a030 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:25.289921 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06680565-2976-477a-b11e-8fabab13a030 None admin] RBAC: Adding query filter params (role.id=bc829c0c3f7b402c930a7f1d58b27331, scope.project.id=424a145a22434ef7a14b6108e6118ccb, user.id=8334e75253f843a980b01c6f0cda6015) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:25.290275 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06680565-2976-477a-b11e-8fabab13a030 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:25.291720 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06680565-2976-477a-b11e-8fabab13a030 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:25.294062 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086832a9-ec7a-4fa9-9906-a5d100be6790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:25.294892 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086832a9-ec7a-4fa9-9906-a5d100be6790 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:25.295180 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086832a9-ec7a-4fa9-9906-a5d100be6790 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:25.295460 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086832a9-ec7a-4fa9-9906-a5d100be6790 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:25.297744 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 558/1100] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:59:25 2022] GET /identity/v3/role_assignments?user.id=8334e75253f843a980b01c6f0cda6015&scope.project.id=424a145a22434ef7a14b6108e6118ccb&role.id=bc829c0c3f7b402c930a7f1d58b27331 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:25.306446 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086832a9-ec7a-4fa9-9906-a5d100be6790 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:59:25.314509 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-086832a9-ec7a-4fa9-9906-a5d100be6790 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:59:25.314509 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:25.314509 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:25.314509 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:25.314509 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:25.314509 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:25.314509 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:25.314509 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:25.314509 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:25.314509 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:25.314509 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:25.314509 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:25.314509 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:59:25.314509 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:59:25.314509 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:59:25.314509 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:59:25.315579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:59:25.315579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:59:25.315579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:59:25.315579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:59:25.315579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:25.315579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:25.315579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:25.315579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:25.315579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:25.315579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:25.315579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:25.315579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:25.315579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:25.315579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:25.315579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:25.315579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:25.316456 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:25.316456 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:25.316456 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:25.316456 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:25.316456 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:59:25.316456 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:59:25.316456 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:59:25.316456 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:59:25.316456 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:59:25.316456 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:59:25.316456 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:59:25.316456 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:25.316456 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 543/1101] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Jul 4 03:59:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 03:59:25.322419 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06680565-2976-477a-b11e-8fabab13a030 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:25.438875 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06680565-2976-477a-b11e-8fabab13a030 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:25.464425 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:25.475879 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3fab8-9c12-4e96-8c1a-8ec90b91aa8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:25.476556 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3fab8-9c12-4e96-8c1a-8ec90b91aa8c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:25.476845 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3fab8-9c12-4e96-8c1a-8ec90b91aa8c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:25.477125 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3fab8-9c12-4e96-8c1a-8ec90b91aa8c None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:25.477884 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af3fab8-9c12-4e96-8c1a-8ec90b91aa8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:25.478255 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af3fab8-9c12-4e96-8c1a-8ec90b91aa8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:25.479649 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af3fab8-9c12-4e96-8c1a-8ec90b91aa8c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:25.488157 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 559/1102] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:59:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:25.494418 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086832a9-ec7a-4fa9-9906-a5d100be6790 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:25.525990 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:25.599898 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086832a9-ec7a-4fa9-9906-a5d100be6790 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:25.635361 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ac8eb-6c2f-4aba-b4f5-d588fb94fe8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:25.636260 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ac8eb-6c2f-4aba-b4f5-d588fb94fe8e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:25.636539 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ac8eb-6c2f-4aba-b4f5-d588fb94fe8e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:25.636814 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ac8eb-6c2f-4aba-b4f5-d588fb94fe8e None admin] PATH_INFO: `/v3/users/4d3029236cbd4e938ad4ef89b40ffd4b` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:25.638121 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ac8eb-6c2f-4aba-b4f5-d588fb94fe8e None admin] RBAC: Authorizing `identity:get_user(user_id=4d3029236cbd4e938ad4ef89b40ffd4b)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:25.639671 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ac8eb-6c2f-4aba-b4f5-d588fb94fe8e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:25.641332 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 544/1103] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:59:25 2022] GET /identity/v3/users/4d3029236cbd4e938ad4ef89b40ffd4b => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:25.647564 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3fab8-9c12-4e96-8c1a-8ec90b91aa8c None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:25.749935 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3fab8-9c12-4e96-8c1a-8ec90b91aa8c None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:25.783180 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37892488-7643-43fa-a027-c5ccf229c61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:25.783829 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37892488-7643-43fa-a027-c5ccf229c61a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:25.784121 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37892488-7643-43fa-a027-c5ccf229c61a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:25.784398 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37892488-7643-43fa-a027-c5ccf229c61a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:25.842862 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:25.856749 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37892488-7643-43fa-a027-c5ccf229c61a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:25.858306 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37892488-7643-43fa-a027-c5ccf229c61a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:25.953780 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 560/1104] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:59:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 03:59:25.959883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ac8eb-6c2f-4aba-b4f5-d588fb94fe8e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:26.056772 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:26.062848 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ac8eb-6c2f-4aba-b4f5-d588fb94fe8e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:26.096408 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db3d4b-89c0-4970-b823-22cd4a8d0403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:26.097283 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db3d4b-89c0-4970-b823-22cd4a8d0403 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:26.097573 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db3d4b-89c0-4970-b823-22cd4a8d0403 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:26.097854 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db3d4b-89c0-4970-b823-22cd4a8d0403 None admin] PATH_INFO: `/v3/projects/12601778c80e4432bedcf7454888a8bb` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:26.099191 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db3d4b-89c0-4970-b823-22cd4a8d0403 None admin] RBAC: Authorizing `identity:get_project(project_id=12601778c80e4432bedcf7454888a8bb)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:26.100645 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db3d4b-89c0-4970-b823-22cd4a8d0403 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:26.102401 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 545/1105] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:59:25 2022] GET /identity/v3/projects/12601778c80e4432bedcf7454888a8bb => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:26.108632 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37892488-7643-43fa-a027-c5ccf229c61a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:26.192250 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:26.207944 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37892488-7643-43fa-a027-c5ccf229c61a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:26.242391 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4cb1d9-1806-4cbc-bfb3-d86607804b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:26.243037 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cb1d9-1806-4cbc-bfb3-d86607804b16 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:26.243314 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cb1d9-1806-4cbc-bfb3-d86607804b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:26.243593 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cb1d9-1806-4cbc-bfb3-d86607804b16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:26.244476 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4cb1d9-1806-4cbc-bfb3-d86607804b16 None admin] RBAC: Adding query filter params (role.id=2eee98054d42475bb7e22a8487ab235e, scope.project.id=12601778c80e4432bedcf7454888a8bb, user.id=4d3029236cbd4e938ad4ef89b40ffd4b) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:26.244844 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4cb1d9-1806-4cbc-bfb3-d86607804b16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:26.246419 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4cb1d9-1806-4cbc-bfb3-d86607804b16 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:26.255062 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 561/1106] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:59:26 2022] GET /identity/v3/role_assignments?user.id=4d3029236cbd4e938ad4ef89b40ffd4b&scope.project.id=12601778c80e4432bedcf7454888a8bb&role.id=2eee98054d42475bb7e22a8487ab235e => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:28.276021 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f78646-4648-430a-8653-c06e1927f7bf None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:28.276828 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f78646-4648-430a-8653-c06e1927f7bf None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:28.276828 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f78646-4648-430a-8653-c06e1927f7bf None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:28.279093 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 546/1107] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:59:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:59:28.285504 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85fb83-9ac7-4cd5-9244-06aaed2ec522 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:28.286269 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85fb83-9ac7-4cd5-9244-06aaed2ec522 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:28.286356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85fb83-9ac7-4cd5-9244-06aaed2ec522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:28.305263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-3b85fb83-9ac7-4cd5-9244-06aaed2ec522 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:59:28.306570 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3b85fb83-9ac7-4cd5-9244-06aaed2ec522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:59:28.377708 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 562/1108] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:59:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 03:59:28.402553 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f78646-4648-430a-8653-c06e1927f7bf None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:28.518953 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f78646-4648-430a-8653-c06e1927f7bf None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:28.556000 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138601ac-aa82-4ac3-b839-5c98ccf77fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:28.556805 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138601ac-aa82-4ac3-b839-5c98ccf77fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:28.557114 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138601ac-aa82-4ac3-b839-5c98ccf77fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:28.557573 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138601ac-aa82-4ac3-b839-5c98ccf77fb1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:28.559308 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138601ac-aa82-4ac3-b839-5c98ccf77fb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:28.560780 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138601ac-aa82-4ac3-b839-5c98ccf77fb1 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:28.562443 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 547/1109] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:59:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 03:59:28.568433 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85fb83-9ac7-4cd5-9244-06aaed2ec522 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:28.651561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:28.679860 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85fb83-9ac7-4cd5-9244-06aaed2ec522 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:28.713646 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6117d-61a1-4ea9-a90b-027aa9651947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:28.714343 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6117d-61a1-4ea9-a90b-027aa9651947 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:28.714631 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6117d-61a1-4ea9-a90b-027aa9651947 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:28.714916 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6117d-61a1-4ea9-a90b-027aa9651947 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:28.715633 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da6117d-61a1-4ea9-a90b-027aa9651947 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:28.717077 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da6117d-61a1-4ea9-a90b-027aa9651947 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:28.743590 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 563/1110] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Jul 4 03:59:28 2022] POST /identity/v3/users => generated 286 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 03:59:30.828477 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431bcd27-2a3a-4f94-8299-9c106a5aa0e0 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:30.829328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431bcd27-2a3a-4f94-8299-9c106a5aa0e0 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:30.829328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431bcd27-2a3a-4f94-8299-9c106a5aa0e0 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:30.831611 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 548/1111] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:59:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:59:30.837840 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca2ab6-629b-42f5-af0e-38288b72c496 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:30.838561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca2ab6-629b-42f5-af0e-38288b72c496 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:30.838894 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca2ab6-629b-42f5-af0e-38288b72c496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:30.865779 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-c0ca2ab6-629b-42f5-af0e-38288b72c496 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:59:30.867001 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c0ca2ab6-629b-42f5-af0e-38288b72c496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:59:30.939170 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 564/1112] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:59:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 03:59:30.970603 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431bcd27-2a3a-4f94-8299-9c106a5aa0e0 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:31.003868 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:31.075161 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431bcd27-2a3a-4f94-8299-9c106a5aa0e0 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:31.110648 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94025b43-70c2-439c-961a-d73cd13cae12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:31.111434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94025b43-70c2-439c-961a-d73cd13cae12 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:31.111721 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94025b43-70c2-439c-961a-d73cd13cae12 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:31.111999 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94025b43-70c2-439c-961a-d73cd13cae12 None admin] PATH_INFO: `/v3/roles/a34eb11c5d95402e94c1bc45e635e387` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:31.113675 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94025b43-70c2-439c-961a-d73cd13cae12 None admin] RBAC: Authorizing `identity:get_role(role_id=a34eb11c5d95402e94c1bc45e635e387)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:31.115141 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94025b43-70c2-439c-961a-d73cd13cae12 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:31.116525 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 549/1113] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:59:30 2022] GET /identity/v3/roles/a34eb11c5d95402e94c1bc45e635e387 => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:31.122670 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca2ab6-629b-42f5-af0e-38288b72c496 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:31.187051 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:31.224171 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca2ab6-629b-42f5-af0e-38288b72c496 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:31.259248 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfff22e-1659-4fed-bcf9-793e3c50a50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:31.260511 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfff22e-1659-4fed-bcf9-793e3c50a50d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:31.260799 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfff22e-1659-4fed-bcf9-793e3c50a50d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:31.261076 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfff22e-1659-4fed-bcf9-793e3c50a50d None admin] PATH_INFO: `/v3/users/13303789d11b4020b1c60d95d2dd7a9d` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:31.276483 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfff22e-1659-4fed-bcf9-793e3c50a50d None admin] RBAC: Authorizing `identity:get_user(user_id=13303789d11b4020b1c60d95d2dd7a9d)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:31.278681 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfff22e-1659-4fed-bcf9-793e3c50a50d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:31.280335 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 565/1114] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:59:31 2022] GET /identity/v3/users/13303789d11b4020b1c60d95d2dd7a9d => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:31.286482 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94025b43-70c2-439c-961a-d73cd13cae12 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:31.385888 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:31.390044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94025b43-70c2-439c-961a-d73cd13cae12 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:31.431997 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ba511-813a-46e0-ac0f-f625db603566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:31.432656 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ba511-813a-46e0-ac0f-f625db603566 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:31.432942 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ba511-813a-46e0-ac0f-f625db603566 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:31.433222 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ba511-813a-46e0-ac0f-f625db603566 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:31.503624 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ba511-813a-46e0-ac0f-f625db603566 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:31.505159 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ba511-813a-46e0-ac0f-f625db603566 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:31.607764 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:31.611531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 550/1115] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:59:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 03:59:31.617849 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfff22e-1659-4fed-bcf9-793e3c50a50d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:31.719929 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfff22e-1659-4fed-bcf9-793e3c50a50d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:31.743993 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:31.764066 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25540c2c-4b73-4fb2-9310-5a88a5453fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:31.765354 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25540c2c-4b73-4fb2-9310-5a88a5453fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:31.765767 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25540c2c-4b73-4fb2-9310-5a88a5453fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:31.766214 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25540c2c-4b73-4fb2-9310-5a88a5453fa8 None admin] PATH_INFO: `/v3/projects/12601778c80e4432bedcf7454888a8bb` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:31.768185 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25540c2c-4b73-4fb2-9310-5a88a5453fa8 None admin] RBAC: Authorizing `identity:get_project(project_id=12601778c80e4432bedcf7454888a8bb)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:31.770475 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25540c2c-4b73-4fb2-9310-5a88a5453fa8 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:31.772178 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 566/1116] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:59:31 2022] GET /identity/v3/projects/12601778c80e4432bedcf7454888a8bb => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:31.781694 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ba511-813a-46e0-ac0f-f625db603566 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:31.894778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ba511-813a-46e0-ac0f-f625db603566 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:31.930971 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea69e3-3e8d-4059-a9e2-cb2b5787dddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:31.931630 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea69e3-3e8d-4059-a9e2-cb2b5787dddd None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:31.931929 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea69e3-3e8d-4059-a9e2-cb2b5787dddd None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:31.932207 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea69e3-3e8d-4059-a9e2-cb2b5787dddd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:31.933047 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ea69e3-3e8d-4059-a9e2-cb2b5787dddd None admin] RBAC: Adding query filter params (role.id=a34eb11c5d95402e94c1bc45e635e387, scope.project.id=12601778c80e4432bedcf7454888a8bb, user.id=13303789d11b4020b1c60d95d2dd7a9d) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:31.933369 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ea69e3-3e8d-4059-a9e2-cb2b5787dddd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:31.934873 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ea69e3-3e8d-4059-a9e2-cb2b5787dddd None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:31.940512 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 551/1117] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:59:31 2022] GET /identity/v3/role_assignments?user.id=13303789d11b4020b1c60d95d2dd7a9d&scope.project.id=12601778c80e4432bedcf7454888a8bb&role.id=a34eb11c5d95402e94c1bc45e635e387 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:33.922265 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569b3b5-b21a-41c3-aa1f-ad13d60872c5 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:33.922929 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569b3b5-b21a-41c3-aa1f-ad13d60872c5 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:33.922929 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569b3b5-b21a-41c3-aa1f-ad13d60872c5 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:33.924903 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 567/1118] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:59:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:59:33.931696 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f6c9e-a4b9-4fa2-8c92-46365d359cc0 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:33.932128 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f6c9e-a4b9-4fa2-8c92-46365d359cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:33.932254 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f6c9e-a4b9-4fa2-8c92-46365d359cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:33.959333 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-4c3f6c9e-a4b9-4fa2-8c92-46365d359cc0 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:59:33.960535 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4c3f6c9e-a4b9-4fa2-8c92-46365d359cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:59:34.032825 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:34.044011 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 552/1119] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:59:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 03:59:34.069627 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569b3b5-b21a-41c3-aa1f-ad13d60872c5 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:34.178957 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569b3b5-b21a-41c3-aa1f-ad13d60872c5 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:34.214628 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeee4d1-e466-41a9-afc1-f5c44ea440fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:34.215482 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeee4d1-e466-41a9-afc1-f5c44ea440fa None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:34.215766 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeee4d1-e466-41a9-afc1-f5c44ea440fa None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:34.216050 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeee4d1-e466-41a9-afc1-f5c44ea440fa None admin] PATH_INFO: `/v3/roles/a34eb11c5d95402e94c1bc45e635e387` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:34.217664 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeee4d1-e466-41a9-afc1-f5c44ea440fa None admin] RBAC: Authorizing `identity:get_role(role_id=a34eb11c5d95402e94c1bc45e635e387)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:34.219076 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeee4d1-e466-41a9-afc1-f5c44ea440fa None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:34.220429 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 568/1120] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:59:34 2022] GET /identity/v3/roles/a34eb11c5d95402e94c1bc45e635e387 => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:34.229468 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f6c9e-a4b9-4fa2-8c92-46365d359cc0 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:34.341142 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f6c9e-a4b9-4fa2-8c92-46365d359cc0 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:34.378415 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66ab78-747e-4e43-9271-10a7a54d53f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:34.379345 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66ab78-747e-4e43-9271-10a7a54d53f1 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:34.379631 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66ab78-747e-4e43-9271-10a7a54d53f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:34.379909 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66ab78-747e-4e43-9271-10a7a54d53f1 None admin] PATH_INFO: `/v3/users/13303789d11b4020b1c60d95d2dd7a9d` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:34.381125 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce66ab78-747e-4e43-9271-10a7a54d53f1 None admin] RBAC: Authorizing `identity:get_user(user_id=13303789d11b4020b1c60d95d2dd7a9d)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:34.382632 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce66ab78-747e-4e43-9271-10a7a54d53f1 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:34.384278 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 553/1121] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:59:34 2022] GET /identity/v3/users/13303789d11b4020b1c60d95d2dd7a9d => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:34.393463 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeee4d1-e466-41a9-afc1-f5c44ea440fa None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:34.457266 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:34.498574 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeee4d1-e466-41a9-afc1-f5c44ea440fa None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:34.534679 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2962cade-e47f-4088-8e96-fd4d9f4e8912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:34.535546 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962cade-e47f-4088-8e96-fd4d9f4e8912 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:34.535826 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962cade-e47f-4088-8e96-fd4d9f4e8912 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:34.536095 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962cade-e47f-4088-8e96-fd4d9f4e8912 None admin] PATH_INFO: `/v3/projects/12601778c80e4432bedcf7454888a8bb` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:34.537312 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2962cade-e47f-4088-8e96-fd4d9f4e8912 None admin] RBAC: Authorizing `identity:get_project(project_id=12601778c80e4432bedcf7454888a8bb)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:34.538790 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2962cade-e47f-4088-8e96-fd4d9f4e8912 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:34.540480 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 569/1122] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:59:34 2022] GET /identity/v3/projects/12601778c80e4432bedcf7454888a8bb => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:34.547260 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66ab78-747e-4e43-9271-10a7a54d53f1 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:34.615919 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:34.667927 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66ab78-747e-4e43-9271-10a7a54d53f1 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:34.703292 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc10e4-06fb-437e-9a89-acb5b718fbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:34.704175 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc10e4-06fb-437e-9a89-acb5b718fbfc None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:34.704457 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc10e4-06fb-437e-9a89-acb5b718fbfc None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:34.704733 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc10e4-06fb-437e-9a89-acb5b718fbfc None admin] PATH_INFO: `/v3/projects/12601778c80e4432bedcf7454888a8bb/users/13303789d11b4020b1c60d95d2dd7a9d/roles/a34eb11c5d95402e94c1bc45e635e387` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:34.707490 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc10e4-06fb-437e-9a89-acb5b718fbfc None admin] RBAC: Authorizing `identity:create_grant(project_id=12601778c80e4432bedcf7454888a8bb, user_id=13303789d11b4020b1c60d95d2dd7a9d, role_id=a34eb11c5d95402e94c1bc45e635e387)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:34.708903 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc10e4-06fb-437e-9a89-acb5b718fbfc None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:34.725984 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 554/1123] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Jul 4 03:59:34 2022] PUT /identity/v3/projects/12601778c80e4432bedcf7454888a8bb/users/13303789d11b4020b1c60d95d2dd7a9d/roles/a34eb11c5d95402e94c1bc45e635e387 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 03:59:36.706602 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379784f-dbab-4c01-a8ef-6f80aaa3fb33 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:36.707493 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379784f-dbab-4c01-a8ef-6f80aaa3fb33 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:36.707493 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379784f-dbab-4c01-a8ef-6f80aaa3fb33 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:36.709723 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 570/1124] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:59:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:59:36.715193 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff138a-1189-48ea-99cc-ea093ceb9a30 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:36.715650 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff138a-1189-48ea-99cc-ea093ceb9a30 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:36.715750 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff138a-1189-48ea-99cc-ea093ceb9a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:36.733586 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-9fff138a-1189-48ea-99cc-ea093ceb9a30 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:59:36.734802 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9fff138a-1189-48ea-99cc-ea093ceb9a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:59:36.818858 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 555/1125] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:59:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 03:59:36.842768 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379784f-dbab-4c01-a8ef-6f80aaa3fb33 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:36.952854 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379784f-dbab-4c01-a8ef-6f80aaa3fb33 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:36.982256 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:36.993017 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8396b-4ab3-4d00-9a1d-e3d9a8947e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:36.993885 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8396b-4ab3-4d00-9a1d-e3d9a8947e1e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:36.994183 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8396b-4ab3-4d00-9a1d-e3d9a8947e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:36.994489 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8396b-4ab3-4d00-9a1d-e3d9a8947e1e None admin] PATH_INFO: `/v3/roles/a34eb11c5d95402e94c1bc45e635e387` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:36.996026 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8396b-4ab3-4d00-9a1d-e3d9a8947e1e None admin] RBAC: Authorizing `identity:get_role(role_id=a34eb11c5d95402e94c1bc45e635e387)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:36.997432 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8396b-4ab3-4d00-9a1d-e3d9a8947e1e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:36.998863 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 571/1126] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:59:36 2022] GET /identity/v3/roles/a34eb11c5d95402e94c1bc45e635e387 => generated 223 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:37.004965 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff138a-1189-48ea-99cc-ea093ceb9a30 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:37.072101 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:37.125656 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff138a-1189-48ea-99cc-ea093ceb9a30 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:37.161787 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c89df-aa39-4c5a-8042-ff049fd1519e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:37.162721 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c89df-aa39-4c5a-8042-ff049fd1519e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:37.163005 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c89df-aa39-4c5a-8042-ff049fd1519e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:37.163287 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c89df-aa39-4c5a-8042-ff049fd1519e None admin] PATH_INFO: `/v3/users/13303789d11b4020b1c60d95d2dd7a9d` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:37.164545 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c89df-aa39-4c5a-8042-ff049fd1519e None admin] RBAC: Authorizing `identity:get_user(user_id=13303789d11b4020b1c60d95d2dd7a9d)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:37.166025 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c89df-aa39-4c5a-8042-ff049fd1519e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:37.167725 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 556/1127] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:59:37 2022] GET /identity/v3/users/13303789d11b4020b1c60d95d2dd7a9d => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:37.174372 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8396b-4ab3-4d00-9a1d-e3d9a8947e1e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:37.285283 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8396b-4ab3-4d00-9a1d-e3d9a8947e1e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:37.323462 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957acb12-a642-42f8-83ed-1512100205ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:37.324099 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957acb12-a642-42f8-83ed-1512100205ce None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:37.324381 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957acb12-a642-42f8-83ed-1512100205ce None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:37.324622 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957acb12-a642-42f8-83ed-1512100205ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:37.386702 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:37.397909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957acb12-a642-42f8-83ed-1512100205ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:37.400260 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957acb12-a642-42f8-83ed-1512100205ce None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:37.508972 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 572/1128] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:59:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 03:59:37.518189 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c89df-aa39-4c5a-8042-ff049fd1519e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:37.619236 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c89df-aa39-4c5a-8042-ff049fd1519e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:37.639697 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:37.654966 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d409116-65e1-4577-bc12-e8353386f77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:37.655816 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d409116-65e1-4577-bc12-e8353386f77f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:37.656092 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d409116-65e1-4577-bc12-e8353386f77f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:37.656365 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d409116-65e1-4577-bc12-e8353386f77f None admin] PATH_INFO: `/v3/projects/12601778c80e4432bedcf7454888a8bb` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:37.657586 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d409116-65e1-4577-bc12-e8353386f77f None admin] RBAC: Authorizing `identity:get_project(project_id=12601778c80e4432bedcf7454888a8bb)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:37.659078 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d409116-65e1-4577-bc12-e8353386f77f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:37.660796 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 557/1129] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:59:37 2022] GET /identity/v3/projects/12601778c80e4432bedcf7454888a8bb => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:37.667152 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957acb12-a642-42f8-83ed-1512100205ce None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:37.760017 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:37.769242 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957acb12-a642-42f8-83ed-1512100205ce None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:37.805971 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c651e9-5bb2-45e4-a64b-0199d1b308d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:37.806984 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c651e9-5bb2-45e4-a64b-0199d1b308d1 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:37.807409 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c651e9-5bb2-45e4-a64b-0199d1b308d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:37.807845 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c651e9-5bb2-45e4-a64b-0199d1b308d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:37.809182 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c651e9-5bb2-45e4-a64b-0199d1b308d1 None admin] RBAC: Adding query filter params (role.id=a34eb11c5d95402e94c1bc45e635e387, scope.project.id=12601778c80e4432bedcf7454888a8bb, user.id=13303789d11b4020b1c60d95d2dd7a9d) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:37.809646 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c651e9-5bb2-45e4-a64b-0199d1b308d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:37.811977 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c651e9-5bb2-45e4-a64b-0199d1b308d1 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:37.820879 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 573/1130] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:59:37 2022] GET /identity/v3/role_assignments?user.id=13303789d11b4020b1c60d95d2dd7a9d&scope.project.id=12601778c80e4432bedcf7454888a8bb&role.id=a34eb11c5d95402e94c1bc45e635e387 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:39.818699 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999e561-4a66-45ea-8634-cdad4122f6ee None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:39.819253 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999e561-4a66-45ea-8634-cdad4122f6ee None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:39.819253 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999e561-4a66-45ea-8634-cdad4122f6ee None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:39.821403 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 558/1131] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:59:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:59:39.830090 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a200d0-38a2-4542-a49a-fa270535f3fb None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:39.830522 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a200d0-38a2-4542-a49a-fa270535f3fb None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:39.830782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a200d0-38a2-4542-a49a-fa270535f3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:39.850393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-a0a200d0-38a2-4542-a49a-fa270535f3fb None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:59:39.851615 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a0a200d0-38a2-4542-a49a-fa270535f3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:59:39.943305 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 574/1132] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:59:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 03:59:39.966923 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999e561-4a66-45ea-8634-cdad4122f6ee None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:40.071391 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999e561-4a66-45ea-8634-cdad4122f6ee None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:40.105988 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd98818-9d41-49f6-b5ed-acb7cabea642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:40.106813 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd98818-9d41-49f6-b5ed-acb7cabea642 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:40.107093 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd98818-9d41-49f6-b5ed-acb7cabea642 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:40.107362 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd98818-9d41-49f6-b5ed-acb7cabea642 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:40.108664 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd98818-9d41-49f6-b5ed-acb7cabea642 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:40.110115 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd98818-9d41-49f6-b5ed-acb7cabea642 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:40.111751 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 559/1133] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:59:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:40.117959 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a200d0-38a2-4542-a49a-fa270535f3fb None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:40.213426 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:40.224437 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a200d0-38a2-4542-a49a-fa270535f3fb None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:40.260414 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3247a5-054c-4d56-b801-ce85b49c8240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:40.261069 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3247a5-054c-4d56-b801-ce85b49c8240 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:40.261357 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3247a5-054c-4d56-b801-ce85b49c8240 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:40.261639 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3247a5-054c-4d56-b801-ce85b49c8240 None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:40.262386 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3247a5-054c-4d56-b801-ce85b49c8240 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:40.263833 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3247a5-054c-4d56-b801-ce85b49c8240 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:40.297547 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 575/1134] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Jul 4 03:59:40 2022] POST /identity/v3/projects => generated 311 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 03:59:42.339615 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f99b9-cd0c-4496-a069-a5a0e21ab4f5 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:42.340167 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f99b9-cd0c-4496-a069-a5a0e21ab4f5 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:42.340167 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f99b9-cd0c-4496-a069-a5a0e21ab4f5 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:42.341512 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 560/1135] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:59:42.347964 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22cd30-6c8e-4272-9a39-917420e1ff1a None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:42.348415 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22cd30-6c8e-4272-9a39-917420e1ff1a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:42.348516 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22cd30-6c8e-4272-9a39-917420e1ff1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:42.366610 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-7e22cd30-6c8e-4272-9a39-917420e1ff1a None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:59:42.367810 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7e22cd30-6c8e-4272-9a39-917420e1ff1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:59:42.437578 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 576/1136] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:59:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 03:59:42.462896 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f99b9-cd0c-4496-a069-a5a0e21ab4f5 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:42.531276 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:42.576512 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f99b9-cd0c-4496-a069-a5a0e21ab4f5 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:42.612701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3cd5f-304b-4dcf-ae80-f77f46060d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:42.613454 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3cd5f-304b-4dcf-ae80-f77f46060d18 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:42.613743 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3cd5f-304b-4dcf-ae80-f77f46060d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:42.614032 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3cd5f-304b-4dcf-ae80-f77f46060d18 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:42.615355 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb3cd5f-304b-4dcf-ae80-f77f46060d18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:42.616822 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb3cd5f-304b-4dcf-ae80-f77f46060d18 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:42.618490 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 561/1137] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 03:59:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:42.627564 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e22cd30-6c8e-4272-9a39-917420e1ff1a None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:42.712050 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:42.742270 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e22cd30-6c8e-4272-9a39-917420e1ff1a None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:42.777775 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576206b1-acdd-4eaf-bbe1-cda3bc657bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:42.778582 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576206b1-acdd-4eaf-bbe1-cda3bc657bd5 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:42.778870 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576206b1-acdd-4eaf-bbe1-cda3bc657bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:42.779151 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576206b1-acdd-4eaf-bbe1-cda3bc657bd5 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:42.779858 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576206b1-acdd-4eaf-bbe1-cda3bc657bd5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:42.781312 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576206b1-acdd-4eaf-bbe1-cda3bc657bd5 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:42.803598 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 577/1138] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Jul 4 03:59:42 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 03:59:44.834774 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa5ce7-b860-4984-8978-eb30671761fa None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:44.835358 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa5ce7-b860-4984-8978-eb30671761fa None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:44.835358 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa5ce7-b860-4984-8978-eb30671761fa None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:44.836727 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 562/1139] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:59:44.842996 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca73430-d9d9-494d-8634-fc2311185bad None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:44.843730 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca73430-d9d9-494d-8634-fc2311185bad None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:44.843896 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca73430-d9d9-494d-8634-fc2311185bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:44.864452 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-7ca73430-d9d9-494d-8634-fc2311185bad None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:59:44.865647 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7ca73430-d9d9-494d-8634-fc2311185bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:59:44.942512 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 578/1140] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:59:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 03:59:44.965809 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa5ce7-b860-4984-8978-eb30671761fa None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:45.082239 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa5ce7-b860-4984-8978-eb30671761fa None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:45.106597 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:45.120983 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4febc64-0a05-40e0-8d0d-92b543ff55f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:45.121790 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4febc64-0a05-40e0-8d0d-92b543ff55f6 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:45.122078 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4febc64-0a05-40e0-8d0d-92b543ff55f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:45.122386 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4febc64-0a05-40e0-8d0d-92b543ff55f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:45.133471 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4febc64-0a05-40e0-8d0d-92b543ff55f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:59:45.141457 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-c4febc64-0a05-40e0-8d0d-92b543ff55f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:59:45.141457 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:45.141457 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:45.141457 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:45.141457 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:45.141457 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:45.141457 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:45.141457 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:45.141457 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:45.141457 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:45.141457 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:45.141457 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:45.141457 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:59:45.141457 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:59:45.141457 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:59:45.141457 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:59:45.142754 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:59:45.142754 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:59:45.142754 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:59:45.142754 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:59:45.142754 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:45.142754 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:45.142754 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:45.142754 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:45.142754 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:45.142754 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:45.142754 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:45.142754 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:45.142754 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:45.142754 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:45.142754 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:45.142754 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:45.143883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:45.143883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:45.143883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:45.143883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:45.143883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:59:45.143883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:59:45.143883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:59:45.143883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:59:45.143883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:59:45.143883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:59:45.143883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:59:45.143883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:45.143883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 563/1141] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Jul 4 03:59:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:59:45.149036 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca73430-d9d9-494d-8634-fc2311185bad None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:45.209472 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:45.252500 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca73430-d9d9-494d-8634-fc2311185bad None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:45.288123 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27418985-4e5e-41f2-98d9-430d86ac4ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:45.288781 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27418985-4e5e-41f2-98d9-430d86ac4ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:45.289067 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27418985-4e5e-41f2-98d9-430d86ac4ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:45.289342 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27418985-4e5e-41f2-98d9-430d86ac4ad8 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:45.290098 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27418985-4e5e-41f2-98d9-430d86ac4ad8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:45.290439 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27418985-4e5e-41f2-98d9-430d86ac4ad8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:45.291835 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27418985-4e5e-41f2-98d9-430d86ac4ad8 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:45.300120 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 579/1142] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:59:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:45.309507 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4febc64-0a05-40e0-8d0d-92b543ff55f6 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:45.436232 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4febc64-0a05-40e0-8d0d-92b543ff55f6 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:45.474765 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbfe7be-9829-4906-85b3-6469398b2d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:45.475633 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfe7be-9829-4906-85b3-6469398b2d1a None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:45.475921 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfe7be-9829-4906-85b3-6469398b2d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:45.476205 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfe7be-9829-4906-85b3-6469398b2d1a None admin] PATH_INFO: `/v3/users/e5c6a8ded7154c32b46c05022fe1ddf3` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:45.489981 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbfe7be-9829-4906-85b3-6469398b2d1a None admin] RBAC: Authorizing `identity:get_user(user_id=e5c6a8ded7154c32b46c05022fe1ddf3)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:45.491499 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbfe7be-9829-4906-85b3-6469398b2d1a None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:45.493156 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 564/1143] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:59:45 2022] GET /identity/v3/users/e5c6a8ded7154c32b46c05022fe1ddf3 => generated 286 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:45.499644 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27418985-4e5e-41f2-98d9-430d86ac4ad8 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:45.611677 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27418985-4e5e-41f2-98d9-430d86ac4ad8 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:45.631611 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:45.647098 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b82397-21d9-434e-b225-6d8010d6e682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:45.647743 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b82397-21d9-434e-b225-6d8010d6e682 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:45.648028 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b82397-21d9-434e-b225-6d8010d6e682 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:45.648305 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b82397-21d9-434e-b225-6d8010d6e682 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:45.716604 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b82397-21d9-434e-b225-6d8010d6e682 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:45.718001 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b82397-21d9-434e-b225-6d8010d6e682 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:45.817769 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 580/1144] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:59:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 03:59:45.824170 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbfe7be-9829-4906-85b3-6469398b2d1a None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:45.873381 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:45.941793 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbfe7be-9829-4906-85b3-6469398b2d1a None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:45.983108 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4266741f-77a0-4984-994c-384b295e9d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:45.984419 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266741f-77a0-4984-994c-384b295e9d92 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:45.984847 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266741f-77a0-4984-994c-384b295e9d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:45.985318 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266741f-77a0-4984-994c-384b295e9d92 None admin] PATH_INFO: `/v3/projects/78d1794e503e4a8892d3a12750380291` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:45.987229 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4266741f-77a0-4984-994c-384b295e9d92 None admin] RBAC: Authorizing `identity:get_project(project_id=78d1794e503e4a8892d3a12750380291)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:45.989191 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4266741f-77a0-4984-994c-384b295e9d92 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:45.990961 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 565/1145] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:59:45 2022] GET /identity/v3/projects/78d1794e503e4a8892d3a12750380291 => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:45.997250 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b82397-21d9-434e-b225-6d8010d6e682 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:46.019124 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:46.099320 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b82397-21d9-434e-b225-6d8010d6e682 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:46.135998 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a9a4a-73ea-42cf-81a9-fd36a3305141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:46.136651 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a9a4a-73ea-42cf-81a9-fd36a3305141 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:46.136937 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a9a4a-73ea-42cf-81a9-fd36a3305141 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:46.137217 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a9a4a-73ea-42cf-81a9-fd36a3305141 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:46.138050 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a9a4a-73ea-42cf-81a9-fd36a3305141 None admin] RBAC: Adding query filter params (role.id=2eee98054d42475bb7e22a8487ab235e, scope.project.id=78d1794e503e4a8892d3a12750380291, user.id=e5c6a8ded7154c32b46c05022fe1ddf3) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:46.138398 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a9a4a-73ea-42cf-81a9-fd36a3305141 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:46.139854 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a9a4a-73ea-42cf-81a9-fd36a3305141 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:46.145717 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 581/1146] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:59:45 2022] GET /identity/v3/role_assignments?user.id=e5c6a8ded7154c32b46c05022fe1ddf3&scope.project.id=78d1794e503e4a8892d3a12750380291&role.id=2eee98054d42475bb7e22a8487ab235e => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:48.115642 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593403c8-04e3-4c06-92e0-9aa139689893 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:48.116479 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593403c8-04e3-4c06-92e0-9aa139689893 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:48.116479 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593403c8-04e3-4c06-92e0-9aa139689893 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:48.118873 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 566/1147] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:59:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:59:48.125263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8e111-3602-4a38-ae87-8a7b8c995788 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:48.125992 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8e111-3602-4a38-ae87-8a7b8c995788 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:48.126147 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8e111-3602-4a38-ae87-8a7b8c995788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:48.151309 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-a1a8e111-3602-4a38-ae87-8a7b8c995788 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:59:48.152521 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a1a8e111-3602-4a38-ae87-8a7b8c995788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:59:48.223140 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 582/1148] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:59:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 03:59:48.245899 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593403c8-04e3-4c06-92e0-9aa139689893 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:48.354715 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593403c8-04e3-4c06-92e0-9aa139689893 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:48.366227 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:48.391425 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a7b3b-96b4-4c00-b241-8dd5c1d19a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:48.392219 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a7b3b-96b4-4c00-b241-8dd5c1d19a41 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:48.392511 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a7b3b-96b4-4c00-b241-8dd5c1d19a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:48.392793 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a7b3b-96b4-4c00-b241-8dd5c1d19a41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:48.403530 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a7b3b-96b4-4c00-b241-8dd5c1d19a41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:59:48.411211 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-c78a7b3b-96b4-4c00-b241-8dd5c1d19a41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:59:48.411211 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:48.411211 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:48.411211 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:48.411211 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:48.411211 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:48.411211 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:48.411211 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:48.411211 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:48.411211 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:48.411211 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:48.411211 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:48.411211 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:59:48.411211 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:59:48.411211 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:59:48.411211 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:59:48.412306 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:59:48.412306 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:59:48.412306 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:59:48.412306 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:59:48.412306 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:48.412306 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:48.412306 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:48.412306 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:48.412306 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:48.412306 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:48.412306 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:48.412306 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:48.412306 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:48.412306 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:48.412306 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:48.412306 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:48.413848 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:48.413848 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:48.413848 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:48.413848 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:48.413848 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:59:48.413848 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:59:48.413848 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:59:48.413848 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:59:48.413848 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:59:48.413848 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:59:48.413848 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:59:48.413848 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:48.413848 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 567/1149] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Jul 4 03:59:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:59:48.422079 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8e111-3602-4a38-ae87-8a7b8c995788 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:48.444293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:48.532428 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8e111-3602-4a38-ae87-8a7b8c995788 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:48.577304 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2021c-464c-4168-926e-ae3dd6853c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:48.578000 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2021c-464c-4168-926e-ae3dd6853c4a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:48.578316 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2021c-464c-4168-926e-ae3dd6853c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:48.578596 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2021c-464c-4168-926e-ae3dd6853c4a None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:48.579353 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2021c-464c-4168-926e-ae3dd6853c4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:48.579668 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2021c-464c-4168-926e-ae3dd6853c4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:48.581054 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2021c-464c-4168-926e-ae3dd6853c4a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:48.589499 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 583/1150] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:59:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:48.595464 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a7b3b-96b4-4c00-b241-8dd5c1d19a41 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:48.703491 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a7b3b-96b4-4c00-b241-8dd5c1d19a41 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:48.738953 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d46ee-0003-424c-868e-e11c50febff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:48.739978 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d46ee-0003-424c-868e-e11c50febff4 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:48.740292 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d46ee-0003-424c-868e-e11c50febff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:48.740861 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d46ee-0003-424c-868e-e11c50febff4 None admin] PATH_INFO: `/v3/users/e5c6a8ded7154c32b46c05022fe1ddf3` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:48.742185 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d46ee-0003-424c-868e-e11c50febff4 None admin] RBAC: Authorizing `identity:get_user(user_id=e5c6a8ded7154c32b46c05022fe1ddf3)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:48.743670 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d46ee-0003-424c-868e-e11c50febff4 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:48.745408 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 568/1151] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:59:48 2022] GET /identity/v3/users/e5c6a8ded7154c32b46c05022fe1ddf3 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:48.754689 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2021c-464c-4168-926e-ae3dd6853c4a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:48.849293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:48.874413 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2021c-464c-4168-926e-ae3dd6853c4a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:48.909676 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec645d-f370-49a8-88d4-bf9b4ab9a140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:48.910640 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec645d-f370-49a8-88d4-bf9b4ab9a140 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:48.910930 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec645d-f370-49a8-88d4-bf9b4ab9a140 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:48.911214 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec645d-f370-49a8-88d4-bf9b4ab9a140 None admin] PATH_INFO: `/v3/projects/78d1794e503e4a8892d3a12750380291` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:48.912453 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec645d-f370-49a8-88d4-bf9b4ab9a140 None admin] RBAC: Authorizing `identity:get_project(project_id=78d1794e503e4a8892d3a12750380291)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:48.913910 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec645d-f370-49a8-88d4-bf9b4ab9a140 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:48.915659 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 584/1152] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:59:48 2022] GET /identity/v3/projects/78d1794e503e4a8892d3a12750380291 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:48.922421 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d46ee-0003-424c-868e-e11c50febff4 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:48.969503 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:49.040070 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d46ee-0003-424c-868e-e11c50febff4 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:49.079490 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b30eca-cac5-4714-9756-c61f443d05aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:49.080391 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b30eca-cac5-4714-9756-c61f443d05aa None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:49.080674 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b30eca-cac5-4714-9756-c61f443d05aa None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:49.080954 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b30eca-cac5-4714-9756-c61f443d05aa None admin] PATH_INFO: `/v3/projects/78d1794e503e4a8892d3a12750380291/users/e5c6a8ded7154c32b46c05022fe1ddf3/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:49.083217 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b30eca-cac5-4714-9756-c61f443d05aa None admin] RBAC: Authorizing `identity:create_grant(project_id=78d1794e503e4a8892d3a12750380291, user_id=e5c6a8ded7154c32b46c05022fe1ddf3, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:49.084675 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b30eca-cac5-4714-9756-c61f443d05aa None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:49.101492 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 569/1153] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Jul 4 03:59:48 2022] PUT /identity/v3/projects/78d1794e503e4a8892d3a12750380291/users/e5c6a8ded7154c32b46c05022fe1ddf3/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 03:59:51.109804 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72d10b-76c5-411f-8377-e48d0a645999 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:51.110740 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72d10b-76c5-411f-8377-e48d0a645999 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:51.110740 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72d10b-76c5-411f-8377-e48d0a645999 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:51.113078 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 585/1154] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:59:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:59:51.119790 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae33be-6e2c-4370-a706-1300231b8b17 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:51.120231 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae33be-6e2c-4370-a706-1300231b8b17 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:51.120322 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae33be-6e2c-4370-a706-1300231b8b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:51.142376 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c3ae33be-6e2c-4370-a706-1300231b8b17 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:59:51.144190 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c3ae33be-6e2c-4370-a706-1300231b8b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:59:51.220115 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 570/1155] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:59:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 03:59:51.250942 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72d10b-76c5-411f-8377-e48d0a645999 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:51.363925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72d10b-76c5-411f-8377-e48d0a645999 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:51.403154 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879919d-648f-481c-a282-c930cdef204f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:51.403934 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879919d-648f-481c-a282-c930cdef204f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:51.404219 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879919d-648f-481c-a282-c930cdef204f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:51.404489 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879919d-648f-481c-a282-c930cdef204f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:51.419197 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2879919d-648f-481c-a282-c930cdef204f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 03:59:51.431782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-2879919d-648f-481c-a282-c930cdef204f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:59:51.431782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:51.431782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:51.431782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:51.431782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:51.431782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:51.431782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:51.431782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:51.431782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:51.431782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:51.431782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:51.431782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:51.431782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 03:59:51.431782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 03:59:51.431782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 03:59:51.431782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 03:59:51.432997 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 03:59:51.432997 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 03:59:51.432997 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 03:59:51.432997 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 03:59:51.432997 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:51.432997 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:51.432997 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:51.432997 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:51.432997 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:51.432997 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:51.432997 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:51.432997 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:51.432997 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:51.432997 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:51.432997 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:51.432997 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:51.434233 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:51.434233 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:51.434233 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:51.434233 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:51.434233 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 03:59:51.434233 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 03:59:51.434233 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 03:59:51.434233 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 03:59:51.434233 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 03:59:51.434233 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 03:59:51.434233 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 03:59:51.434233 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 03:59:51.434233 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 586/1156] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Jul 4 03:59:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:59:51.439763 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae33be-6e2c-4370-a706-1300231b8b17 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:51.470563 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:51.556770 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae33be-6e2c-4370-a706-1300231b8b17 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:51.591857 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd175bf2-15fb-42bc-bbb0-8ce037f62d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:51.592517 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd175bf2-15fb-42bc-bbb0-8ce037f62d0f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:51.592805 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd175bf2-15fb-42bc-bbb0-8ce037f62d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:51.593081 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd175bf2-15fb-42bc-bbb0-8ce037f62d0f None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:51.593833 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd175bf2-15fb-42bc-bbb0-8ce037f62d0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:51.594140 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd175bf2-15fb-42bc-bbb0-8ce037f62d0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:51.595576 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd175bf2-15fb-42bc-bbb0-8ce037f62d0f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:51.603926 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 571/1157] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 03:59:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:51.609900 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879919d-648f-481c-a282-c930cdef204f None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:51.614009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:51.714178 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879919d-648f-481c-a282-c930cdef204f None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:51.749337 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b067f-42fe-40d8-a2d6-04f276cf3e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:51.750132 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b067f-42fe-40d8-a2d6-04f276cf3e24 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:51.750560 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b067f-42fe-40d8-a2d6-04f276cf3e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:51.750836 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b067f-42fe-40d8-a2d6-04f276cf3e24 None admin] PATH_INFO: `/v3/users/e5c6a8ded7154c32b46c05022fe1ddf3` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:51.752165 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b067f-42fe-40d8-a2d6-04f276cf3e24 None admin] RBAC: Authorizing `identity:get_user(user_id=e5c6a8ded7154c32b46c05022fe1ddf3)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:51.753661 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b067f-42fe-40d8-a2d6-04f276cf3e24 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:51.755306 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 587/1158] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 03:59:51 2022] GET /identity/v3/users/e5c6a8ded7154c32b46c05022fe1ddf3 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:51.761556 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd175bf2-15fb-42bc-bbb0-8ce037f62d0f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:51.856753 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:51.870105 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd175bf2-15fb-42bc-bbb0-8ce037f62d0f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:51.909370 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4930bd-e924-4695-841f-3af14bbc75ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:51.910014 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4930bd-e924-4695-841f-3af14bbc75ad None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:51.910327 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4930bd-e924-4695-841f-3af14bbc75ad None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:51.910601 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4930bd-e924-4695-841f-3af14bbc75ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:51.993003 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4930bd-e924-4695-841f-3af14bbc75ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:51.994524 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4930bd-e924-4695-841f-3af14bbc75ad None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:52.092816 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:52.104000 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 572/1159] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:59:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 03:59:52.110147 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b067f-42fe-40d8-a2d6-04f276cf3e24 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:52.178040 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:52.207388 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b067f-42fe-40d8-a2d6-04f276cf3e24 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:52.242119 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894fb13-762c-4cf9-8708-e87473080431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:52.243000 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894fb13-762c-4cf9-8708-e87473080431 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:52.243284 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894fb13-762c-4cf9-8708-e87473080431 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:52.243556 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894fb13-762c-4cf9-8708-e87473080431 None admin] PATH_INFO: `/v3/projects/78d1794e503e4a8892d3a12750380291` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:52.244771 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b894fb13-762c-4cf9-8708-e87473080431 None admin] RBAC: Authorizing `identity:get_project(project_id=78d1794e503e4a8892d3a12750380291)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:52.246247 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b894fb13-762c-4cf9-8708-e87473080431 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:52.247939 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 588/1160] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 03:59:52 2022] GET /identity/v3/projects/78d1794e503e4a8892d3a12750380291 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:52.254515 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4930bd-e924-4695-841f-3af14bbc75ad None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:52.360635 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4930bd-e924-4695-841f-3af14bbc75ad None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:52.396533 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90526f6d-d548-42cd-8b40-ae353c723b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:52.397177 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90526f6d-d548-42cd-8b40-ae353c723b48 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:52.397463 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90526f6d-d548-42cd-8b40-ae353c723b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:52.397740 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90526f6d-d548-42cd-8b40-ae353c723b48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:52.398596 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90526f6d-d548-42cd-8b40-ae353c723b48 None admin] RBAC: Adding query filter params (role.id=2eee98054d42475bb7e22a8487ab235e, scope.project.id=78d1794e503e4a8892d3a12750380291, user.id=e5c6a8ded7154c32b46c05022fe1ddf3) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:52.398912 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90526f6d-d548-42cd-8b40-ae353c723b48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:52.400360 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90526f6d-d548-42cd-8b40-ae353c723b48 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:52.406425 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 573/1161] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 03:59:52 2022] GET /identity/v3/role_assignments?user.id=e5c6a8ded7154c32b46c05022fe1ddf3&scope.project.id=78d1794e503e4a8892d3a12750380291&role.id=2eee98054d42475bb7e22a8487ab235e => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:54.418896 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632d301-f7f3-4cd5-b93c-b9dc6ad453d0 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:54.419732 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632d301-f7f3-4cd5-b93c-b9dc6ad453d0 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:54.419732 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632d301-f7f3-4cd5-b93c-b9dc6ad453d0 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:54.421976 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 589/1162] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:59:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:59:54.429903 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5acda94-51bf-4d28-b23e-b42cb99968eb None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:54.430394 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5acda94-51bf-4d28-b23e-b42cb99968eb None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:54.430486 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5acda94-51bf-4d28-b23e-b42cb99968eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:54.453902 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e5acda94-51bf-4d28-b23e-b42cb99968eb None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:59:54.455829 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e5acda94-51bf-4d28-b23e-b42cb99968eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:59:54.514688 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:54.536297 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 574/1163] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:59:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 03:59:54.570544 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632d301-f7f3-4cd5-b93c-b9dc6ad453d0 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:54.680772 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632d301-f7f3-4cd5-b93c-b9dc6ad453d0 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:54.715861 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b3fb9-5766-46af-8fdf-e58de4e87c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:54.716501 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b3fb9-5766-46af-8fdf-e58de4e87c41 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:54.716784 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b3fb9-5766-46af-8fdf-e58de4e87c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:54.717045 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b3fb9-5766-46af-8fdf-e58de4e87c41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:54.727467 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:54.787136 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b3fb9-5766-46af-8fdf-e58de4e87c41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:54.788831 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b3fb9-5766-46af-8fdf-e58de4e87c41 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:54.904959 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 590/1164] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 03:59:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 03:59:54.913837 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5acda94-51bf-4d28-b23e-b42cb99968eb None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:55.022039 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5acda94-51bf-4d28-b23e-b42cb99968eb None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:55.057624 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a740c-9ea3-4623-b28b-dd5acc116c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:55.058456 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a740c-9ea3-4623-b28b-dd5acc116c94 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:55.058751 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a740c-9ea3-4623-b28b-dd5acc116c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:55.059026 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a740c-9ea3-4623-b28b-dd5acc116c94 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:55.066004 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a740c-9ea3-4623-b28b-dd5acc116c94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:55.067520 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a740c-9ea3-4623-b28b-dd5acc116c94 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:55.081968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-695a740c-9ea3-4623-b28b-dd5acc116c94 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 04 03:59:55.081968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:55.081968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 04 03:59:55.081968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 04 03:59:55.081968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 03:59:55.081968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 03:59:55.081968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 03:59:55.081968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 03:59:55.081968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 04 03:59:55.081968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:55.081968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 03:59:55.081968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:55.081968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 03:59:55.081968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 03:59:55.081968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 03:59:55.081968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 03:59:55.081968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 03:59:55.083179 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 03:59:55.083179 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 03:59:55.083179 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 03:59:55.083179 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 03:59:55.083179 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 03:59:55.083179 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 03:59:55.083179 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 03:59:55.083179 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 03:59:55.083179 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 03:59:55.083179 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 03:59:55.083179 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 03:59:55.083179 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 03:59:55.083179 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 03:59:55.083179 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 03:59:55.083179 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 03:59:55.083179 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 03:59:55.084093 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 03:59:55.084093 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 03:59:55.084093 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 03:59:55.084093 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 03:59:55.084093 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 03:59:55.084093 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 03:59:55.084093 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 03:59:55.084093 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 03:59:55.084093 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 03:59:55.084093 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 03:59:55.084093 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 04 03:59:55.084093 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 03:59:55.084093 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 04 03:59:55.084093 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 03:59:55.084093 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 575/1165] 10.222.0.49 () {56 vars in 1117 bytes} [Mon Jul 4 03:59:54 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 03:59:55.091080 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b3fb9-5766-46af-8fdf-e58de4e87c41 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:55.136637 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:55.200897 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b3fb9-5766-46af-8fdf-e58de4e87c41 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:55.245554 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9327cc-f269-4ee6-ac52-76a457f60044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:55.246141 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9327cc-f269-4ee6-ac52-76a457f60044 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:55.246457 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9327cc-f269-4ee6-ac52-76a457f60044 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:55.246734 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9327cc-f269-4ee6-ac52-76a457f60044 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:55.247456 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9327cc-f269-4ee6-ac52-76a457f60044 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 03:59:55.247766 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9327cc-f269-4ee6-ac52-76a457f60044 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:55.249151 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9327cc-f269-4ee6-ac52-76a457f60044 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:55.256565 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 591/1166] 10.222.0.49 () {56 vars in 1115 bytes} [Mon Jul 4 03:59:55 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:57.227152 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16811d-3d49-438b-8b65-a0da03f25b16 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:57.227956 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16811d-3d49-438b-8b65-a0da03f25b16 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:57.227956 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16811d-3d49-438b-8b65-a0da03f25b16 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:57.230202 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 576/1167] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:59:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:59:57.235583 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7cfe5e-f283-431c-8631-8668df1b9098 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:57.236024 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7cfe5e-f283-431c-8631-8668df1b9098 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:57.236117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7cfe5e-f283-431c-8631-8668df1b9098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:57.254377 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-1c7cfe5e-f283-431c-8631-8668df1b9098 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:59:57.255548 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1c7cfe5e-f283-431c-8631-8668df1b9098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:59:57.325883 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 592/1168] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:59:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 03:59:57.349817 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16811d-3d49-438b-8b65-a0da03f25b16 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:57.411808 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:57.483639 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16811d-3d49-438b-8b65-a0da03f25b16 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:57.521376 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b9888-197e-4526-935a-15ea9a04b78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:57.522038 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b9888-197e-4526-935a-15ea9a04b78d None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:57.522358 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b9888-197e-4526-935a-15ea9a04b78d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:57.522610 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b9888-197e-4526-935a-15ea9a04b78d None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:57.523386 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b9888-197e-4526-935a-15ea9a04b78d None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:57.524797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b9888-197e-4526-935a-15ea9a04b78d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:57.542686 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 577/1169] 10.222.0.49 () {60 vars in 1138 bytes} [Mon Jul 4 03:59:57 2022] POST /identity/v3/domains => generated 267 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 03:59:59.547889 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d7856-c6f3-4073-aa91-24159c7f2edf None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:59.548828 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d7856-c6f3-4073-aa91-24159c7f2edf None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:59.548828 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d7856-c6f3-4073-aa91-24159c7f2edf None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:59.550688 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 593/1170] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 03:59:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 03:59:59.556208 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba51ec0-030d-4df0-a215-5d537d49273f None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:59.556634 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba51ec0-030d-4df0-a215-5d537d49273f None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:59.556724 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba51ec0-030d-4df0-a215-5d537d49273f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:59.574283 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-7ba51ec0-030d-4df0-a215-5d537d49273f None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 03:59:59.575501 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-7ba51ec0-030d-4df0-a215-5d537d49273f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 03:59:59.644049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 578/1171] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 03:59:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 03:59:59.667506 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d7856-c6f3-4073-aa91-24159c7f2edf None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:59.707037 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:59.778092 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d7856-c6f3-4073-aa91-24159c7f2edf None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 03:59:59.813511 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae852ba-fbb9-404a-bc52-c20b2038689f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 03:59:59.814339 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae852ba-fbb9-404a-bc52-c20b2038689f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 03:59:59.814624 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae852ba-fbb9-404a-bc52-c20b2038689f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 03:59:59.814904 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae852ba-fbb9-404a-bc52-c20b2038689f None admin] PATH_INFO: `/v3/domains/889e671042d44da7bd49a7e777fc73fa` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 03:59:59.826144 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae852ba-fbb9-404a-bc52-c20b2038689f None admin] RBAC: Authorizing `identity:get_domain(domain_id=889e671042d44da7bd49a7e777fc73fa)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 03:59:59.827654 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae852ba-fbb9-404a-bc52-c20b2038689f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 03:59:59.829295 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 594/1172] 10.222.0.49 () {56 vars in 1183 bytes} [Mon Jul 4 03:59:59 2022] GET /identity/v3/domains/889e671042d44da7bd49a7e777fc73fa => generated 267 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 03:59:59.839045 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba51ec0-030d-4df0-a215-5d537d49273f None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 03:59:59.880060 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 03:59:59.971376 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba51ec0-030d-4df0-a215-5d537d49273f None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:00:00.007497 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13cc24-5064-4e40-a436-30d77a6af4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:00:00.008158 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13cc24-5064-4e40-a436-30d77a6af4d6 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:00:00.008443 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13cc24-5064-4e40-a436-30d77a6af4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:00:00.008716 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13cc24-5064-4e40-a436-30d77a6af4d6 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:00:00.009744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c13cc24-5064-4e40-a436-30d77a6af4d6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:00:00.011235 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c13cc24-5064-4e40-a436-30d77a6af4d6 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:00:00.041013 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 579/1173] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Jul 4 03:59:59 2022] POST /identity/v3/projects => generated 361 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:00:02.078949 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf713f-5f69-4237-9318-12002c6af62b None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:00:02.079519 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf713f-5f69-4237-9318-12002c6af62b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:00:02.079519 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf713f-5f69-4237-9318-12002c6af62b None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:00:02.080912 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 595/1174] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:00:02.087371 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36bc4f-0432-4ab2-8006-ba34295d4576 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:00:02.088090 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36bc4f-0432-4ab2-8006-ba34295d4576 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:00:02.088385 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36bc4f-0432-4ab2-8006-ba34295d4576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:00:02.114815 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-ac36bc4f-0432-4ab2-8006-ba34295d4576 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:00:02.116704 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ac36bc4f-0432-4ab2-8006-ba34295d4576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:00:02.191670 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 580/1175] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:00:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 04:00:02.229298 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf713f-5f69-4237-9318-12002c6af62b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:00:02.331048 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:00:02.343960 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf713f-5f69-4237-9318-12002c6af62b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:00:02.388819 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0f614-3e17-4284-9b2b-1e7e804af97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:00:02.389715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0f614-3e17-4284-9b2b-1e7e804af97f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:00:02.390026 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0f614-3e17-4284-9b2b-1e7e804af97f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:00:02.390414 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0f614-3e17-4284-9b2b-1e7e804af97f None admin] PATH_INFO: `/v3/domains/889e671042d44da7bd49a7e777fc73fa` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:00:02.391717 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b0f614-3e17-4284-9b2b-1e7e804af97f None admin] RBAC: Authorizing `identity:get_domain(domain_id=889e671042d44da7bd49a7e777fc73fa)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:00:02.393159 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b0f614-3e17-4284-9b2b-1e7e804af97f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:00:02.394860 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 596/1176] 10.222.0.49 () {56 vars in 1183 bytes} [Mon Jul 4 04:00:02 2022] GET /identity/v3/domains/889e671042d44da7bd49a7e777fc73fa => generated 267 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:00:02.404059 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36bc4f-0432-4ab2-8006-ba34295d4576 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:00:02.429575 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:00:02.515222 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36bc4f-0432-4ab2-8006-ba34295d4576 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:00:02.552034 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a49598-5f55-4a97-b92f-1f999266c931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:00:02.552697 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a49598-5f55-4a97-b92f-1f999266c931 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:00:02.552984 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a49598-5f55-4a97-b92f-1f999266c931 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:00:02.553267 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a49598-5f55-4a97-b92f-1f999266c931 None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:00:02.553977 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a49598-5f55-4a97-b92f-1f999266c931 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:00:02.555471 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a49598-5f55-4a97-b92f-1f999266c931 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:00:02.583957 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 581/1177] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Jul 4 04:00:02 2022] POST /identity/v3/users => generated 311 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:00:04.648188 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224f9bb-1b29-4bc1-a041-d7c2dfdc870b None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:00:04.649195 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224f9bb-1b29-4bc1-a041-d7c2dfdc870b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:00:04.649195 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224f9bb-1b29-4bc1-a041-d7c2dfdc870b None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:00:04.651390 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 597/1178] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:00:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:00:04.656721 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaef505-b975-4790-92f3-0325394b158a None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:00:04.657168 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaef505-b975-4790-92f3-0325394b158a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:00:04.657274 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaef505-b975-4790-92f3-0325394b158a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:00:04.676155 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-dfaef505-b975-4790-92f3-0325394b158a None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:00:04.677339 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-dfaef505-b975-4790-92f3-0325394b158a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:00:04.759529 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 582/1179] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:00:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 04:00:04.783046 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224f9bb-1b29-4bc1-a041-d7c2dfdc870b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:00:04.901184 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224f9bb-1b29-4bc1-a041-d7c2dfdc870b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:00:04.937163 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e80a4a-79e5-455e-9e5f-6e56514dd5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:00:04.937951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e80a4a-79e5-455e-9e5f-6e56514dd5f1 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:00:04.938269 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e80a4a-79e5-455e-9e5f-6e56514dd5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:00:04.938545 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e80a4a-79e5-455e-9e5f-6e56514dd5f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:00:04.949365 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e80a4a-79e5-455e-9e5f-6e56514dd5f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 04:00:04.957135 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-88e80a4a-79e5-455e-9e5f-6e56514dd5f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 04:00:04.957135 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 04:00:04.957135 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 04:00:04.957135 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 04:00:04.957135 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 04:00:04.957135 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 04:00:04.957135 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 04:00:04.957135 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 04:00:04.957135 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 04:00:04.957135 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 04:00:04.957135 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 04:00:04.957135 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 04:00:04.957135 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 04:00:04.957135 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 04:00:04.957135 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 04:00:04.957135 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 04:00:04.958224 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 04:00:04.958224 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 04:00:04.958224 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 04:00:04.958224 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 04:00:04.958224 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 04:00:04.958224 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 04:00:04.958224 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 04:00:04.958224 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 04:00:04.958224 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 04:00:04.958224 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 04:00:04.958224 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 04:00:04.958224 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 04:00:04.958224 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 04:00:04.958224 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 04:00:04.958224 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 04:00:04.958224 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 04:00:04.959280 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 04:00:04.959280 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 04:00:04.959280 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 04:00:04.959280 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 04:00:04.959280 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 04:00:04.959280 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 04:00:04.959280 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 04:00:04.959280 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 04:00:04.959280 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 04:00:04.959280 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 04:00:04.959280 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 04:00:04.959280 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 04:00:04.959280 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 598/1180] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Jul 4 04:00:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 04:00:04.965311 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaef505-b975-4790-92f3-0325394b158a None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:00:04.967674 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:00:05.073372 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaef505-b975-4790-92f3-0325394b158a None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:00:05.108773 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d158b4b-ee4d-4deb-aff8-69224c8f5563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:00:05.109440 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d158b4b-ee4d-4deb-aff8-69224c8f5563 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:00:05.109731 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d158b4b-ee4d-4deb-aff8-69224c8f5563 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:00:05.110014 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d158b4b-ee4d-4deb-aff8-69224c8f5563 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:00:05.110800 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d158b4b-ee4d-4deb-aff8-69224c8f5563 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:00:05.111113 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d158b4b-ee4d-4deb-aff8-69224c8f5563 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:00:05.112558 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d158b4b-ee4d-4deb-aff8-69224c8f5563 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:00:05.120804 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 583/1181] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 04:00:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 04:00:05.130196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e80a4a-79e5-455e-9e5f-6e56514dd5f1 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:00:05.167124 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:00:05.253141 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e80a4a-79e5-455e-9e5f-6e56514dd5f1 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:00:05.288637 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb4bbb-c2b8-4807-a45f-10fef364bd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:00:05.289492 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb4bbb-c2b8-4807-a45f-10fef364bd50 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:00:05.289777 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb4bbb-c2b8-4807-a45f-10fef364bd50 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:00:05.290066 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb4bbb-c2b8-4807-a45f-10fef364bd50 None admin] PATH_INFO: `/v3/users/e0509995790a4891b33f26c6dc35decb` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:00:05.304042 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb4bbb-c2b8-4807-a45f-10fef364bd50 None admin] RBAC: Authorizing `identity:get_user(user_id=e0509995790a4891b33f26c6dc35decb)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:00:05.305545 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb4bbb-c2b8-4807-a45f-10fef364bd50 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:00:05.307230 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 599/1182] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 04:00:05 2022] GET /identity/v3/users/e0509995790a4891b33f26c6dc35decb => generated 311 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:00:05.315825 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d158b4b-ee4d-4deb-aff8-69224c8f5563 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:00:05.381054 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:00:05.420876 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d158b4b-ee4d-4deb-aff8-69224c8f5563 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:00:05.458852 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d179f-e183-4c07-bd58-64a2329ab819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:00:05.459504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d179f-e183-4c07-bd58-64a2329ab819 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:00:05.459794 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d179f-e183-4c07-bd58-64a2329ab819 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:00:05.460072 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d179f-e183-4c07-bd58-64a2329ab819 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:00:05.529191 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d179f-e183-4c07-bd58-64a2329ab819 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:00:05.530716 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d179f-e183-4c07-bd58-64a2329ab819 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:00:05.595644 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:00:05.636880 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 584/1183] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 04:00:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 04 04:00:05.643964 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb4bbb-c2b8-4807-a45f-10fef364bd50 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:00:05.739778 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:00:05.762233 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb4bbb-c2b8-4807-a45f-10fef364bd50 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:00:05.797332 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791f16f-ea14-4c3d-9b8e-030fa6b30899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:00:05.798200 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791f16f-ea14-4c3d-9b8e-030fa6b30899 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:00:05.798499 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791f16f-ea14-4c3d-9b8e-030fa6b30899 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:00:05.798771 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791f16f-ea14-4c3d-9b8e-030fa6b30899 None admin] PATH_INFO: `/v3/projects/482e6e2ea92448548f7bdc802ea112ca` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:00:05.800000 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791f16f-ea14-4c3d-9b8e-030fa6b30899 None admin] RBAC: Authorizing `identity:get_project(project_id=482e6e2ea92448548f7bdc802ea112ca)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:00:05.801505 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791f16f-ea14-4c3d-9b8e-030fa6b30899 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:00:05.803260 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 600/1184] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 04:00:05 2022] GET /identity/v3/projects/482e6e2ea92448548f7bdc802ea112ca => generated 361 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 04:00:05.810193 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d179f-e183-4c07-bd58-64a2329ab819 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:00:05.923312 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d179f-e183-4c07-bd58-64a2329ab819 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:00:05.968756 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e347205-6d78-472d-8b91-377ad7b10c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:00:05.969720 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e347205-6d78-472d-8b91-377ad7b10c32 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:00:05.970132 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e347205-6d78-472d-8b91-377ad7b10c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:00:05.971126 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e347205-6d78-472d-8b91-377ad7b10c32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:00:05.971586 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e347205-6d78-472d-8b91-377ad7b10c32 None admin] RBAC: Adding query filter params (role.id=2eee98054d42475bb7e22a8487ab235e, scope.project.id=482e6e2ea92448548f7bdc802ea112ca, user.id=e0509995790a4891b33f26c6dc35decb) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:00:05.971907 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e347205-6d78-472d-8b91-377ad7b10c32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:00:05.973378 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e347205-6d78-472d-8b91-377ad7b10c32 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:00:05.979654 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 585/1185] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 04:00:05 2022] GET /identity/v3/role_assignments?user.id=e0509995790a4891b33f26c6dc35decb&scope.project.id=482e6e2ea92448548f7bdc802ea112ca&role.id=2eee98054d42475bb7e22a8487ab235e => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:00:07.973127 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706cea5-82a9-4203-b7b9-886c88e51907 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:00:07.973567 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706cea5-82a9-4203-b7b9-886c88e51907 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:00:07.973695 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706cea5-82a9-4203-b7b9-886c88e51907 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:00:07.975085 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 601/1186] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:00:07.980967 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4fc67-f3b9-41b4-8452-148e9bd8b1c4 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:00:07.981445 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4fc67-f3b9-41b4-8452-148e9bd8b1c4 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:00:07.981534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4fc67-f3b9-41b4-8452-148e9bd8b1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:00:08.001189 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-3ca4fc67-f3b9-41b4-8452-148e9bd8b1c4 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:00:08.002461 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3ca4fc67-f3b9-41b4-8452-148e9bd8b1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:00:08.026387 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:00:08.073669 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 586/1187] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:00:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 04:00:08.097258 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706cea5-82a9-4203-b7b9-886c88e51907 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:00:08.218798 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706cea5-82a9-4203-b7b9-886c88e51907 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:00:08.253803 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52223f14-8622-4dbf-ad1f-eb90e8c0c5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:00:08.254607 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52223f14-8622-4dbf-ad1f-eb90e8c0c5ee None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:00:08.254887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52223f14-8622-4dbf-ad1f-eb90e8c0c5ee None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:00:08.255161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52223f14-8622-4dbf-ad1f-eb90e8c0c5ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:00:08.265826 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52223f14-8622-4dbf-ad1f-eb90e8c0c5ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 04:00:08.273349 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-52223f14-8622-4dbf-ad1f-eb90e8c0c5ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 04:00:08.273349 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 04:00:08.273349 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 04:00:08.273349 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 04:00:08.273349 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 04:00:08.273349 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 04:00:08.273349 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 04:00:08.273349 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 04:00:08.273349 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 04:00:08.273349 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 04:00:08.273349 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 04:00:08.273349 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 04:00:08.273349 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 04:00:08.273349 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 04:00:08.273349 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 04:00:08.273349 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 04:00:08.274451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 04:00:08.274451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 04:00:08.274451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 04:00:08.274451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 04:00:08.274451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 04:00:08.274451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 04:00:08.274451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 04:00:08.274451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 04:00:08.274451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 04:00:08.274451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 04:00:08.274451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 04:00:08.274451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 04:00:08.274451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 04:00:08.274451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 04:00:08.274451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 04:00:08.274451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 04:00:08.275636 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 04:00:08.275636 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 04:00:08.275636 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 04:00:08.275636 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 04:00:08.275636 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 04:00:08.275636 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 04:00:08.275636 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 04:00:08.275636 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 04:00:08.275636 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 04:00:08.275636 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 04:00:08.275636 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 04:00:08.275636 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 04:00:08.275636 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 602/1188] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Jul 4 04:00:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 04:00:08.283151 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4fc67-f3b9-41b4-8452-148e9bd8b1c4 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:00:08.387440 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4fc67-f3b9-41b4-8452-148e9bd8b1c4 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:00:08.422143 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0bb758-31ac-4906-8598-4483879c2bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:00:08.422831 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bb758-31ac-4906-8598-4483879c2bfd None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:00:08.423106 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bb758-31ac-4906-8598-4483879c2bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:00:08.423379 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bb758-31ac-4906-8598-4483879c2bfd None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:00:08.424124 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0bb758-31ac-4906-8598-4483879c2bfd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:00:08.424472 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0bb758-31ac-4906-8598-4483879c2bfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:00:08.425864 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0bb758-31ac-4906-8598-4483879c2bfd None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:00:08.434457 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 587/1189] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 04:00:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:00:08.440509 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52223f14-8622-4dbf-ad1f-eb90e8c0c5ee None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:00:08.456957 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:00:08.564312 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52223f14-8622-4dbf-ad1f-eb90e8c0c5ee None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:00:08.601566 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f273f-1c5d-4ee2-b0b2-04276d4593b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:00:08.602466 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f273f-1c5d-4ee2-b0b2-04276d4593b8 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:00:08.602747 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f273f-1c5d-4ee2-b0b2-04276d4593b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:00:08.603027 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f273f-1c5d-4ee2-b0b2-04276d4593b8 None admin] PATH_INFO: `/v3/users/e0509995790a4891b33f26c6dc35decb` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:00:08.604349 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3f273f-1c5d-4ee2-b0b2-04276d4593b8 None admin] RBAC: Authorizing `identity:get_user(user_id=e0509995790a4891b33f26c6dc35decb)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:00:08.605815 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3f273f-1c5d-4ee2-b0b2-04276d4593b8 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:00:08.607518 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 603/1190] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 04:00:08 2022] GET /identity/v3/users/e0509995790a4891b33f26c6dc35decb => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:00:08.614411 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0bb758-31ac-4906-8598-4483879c2bfd None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:00:08.642958 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:00:08.723306 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0bb758-31ac-4906-8598-4483879c2bfd None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:00:08.760152 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47f7d0-2f45-42f5-b269-5ec6aec3dac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:00:08.761019 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47f7d0-2f45-42f5-b269-5ec6aec3dac3 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:00:08.761310 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47f7d0-2f45-42f5-b269-5ec6aec3dac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:00:08.761596 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47f7d0-2f45-42f5-b269-5ec6aec3dac3 None admin] PATH_INFO: `/v3/projects/482e6e2ea92448548f7bdc802ea112ca` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:00:08.762925 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb47f7d0-2f45-42f5-b269-5ec6aec3dac3 None admin] RBAC: Authorizing `identity:get_project(project_id=482e6e2ea92448548f7bdc802ea112ca)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:00:08.764401 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb47f7d0-2f45-42f5-b269-5ec6aec3dac3 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:00:08.766120 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 588/1191] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 04:00:08 2022] GET /identity/v3/projects/482e6e2ea92448548f7bdc802ea112ca => generated 361 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:00:08.775489 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f273f-1c5d-4ee2-b0b2-04276d4593b8 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:00:08.858389 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:00:08.884160 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f273f-1c5d-4ee2-b0b2-04276d4593b8 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:00:08.918745 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce2599-fad4-4b18-845c-d843c33be4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:00:08.919636 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce2599-fad4-4b18-845c-d843c33be4e5 None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:00:08.919926 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce2599-fad4-4b18-845c-d843c33be4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:00:08.920207 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce2599-fad4-4b18-845c-d843c33be4e5 None admin] PATH_INFO: `/v3/projects/482e6e2ea92448548f7bdc802ea112ca/users/e0509995790a4891b33f26c6dc35decb/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:00:08.922479 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce2599-fad4-4b18-845c-d843c33be4e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=482e6e2ea92448548f7bdc802ea112ca, user_id=e0509995790a4891b33f26c6dc35decb, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:00:08.923930 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce2599-fad4-4b18-845c-d843c33be4e5 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:00:08.940375 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 604/1192] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Jul 4 04:00:08 2022] PUT /identity/v3/projects/482e6e2ea92448548f7bdc802ea112ca/users/e0509995790a4891b33f26c6dc35decb/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:00:10.911399 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b10b68-5bf1-49b1-b1a0-2879e46cfbc8 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:00:10.912295 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b10b68-5bf1-49b1-b1a0-2879e46cfbc8 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:00:10.912295 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b10b68-5bf1-49b1-b1a0-2879e46cfbc8 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:00:10.914548 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 589/1193] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:00:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:00:10.923302 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bda40-0959-4aae-a2a9-b6c2b03e8bf9 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:00:10.923737 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bda40-0959-4aae-a2a9-b6c2b03e8bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:00:10.923936 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bda40-0959-4aae-a2a9-b6c2b03e8bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:00:10.951233 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-856bda40-0959-4aae-a2a9-b6c2b03e8bf9 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:00:10.953177 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-856bda40-0959-4aae-a2a9-b6c2b03e8bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:00:11.036842 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 605/1194] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:00:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 04:00:11.060123 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b10b68-5bf1-49b1-b1a0-2879e46cfbc8 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:00:11.158175 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:00:11.173075 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b10b68-5bf1-49b1-b1a0-2879e46cfbc8 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:00:11.209830 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c70315-77eb-4aea-8acc-3cfc1f6dd93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:00:11.210655 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c70315-77eb-4aea-8acc-3cfc1f6dd93e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:00:11.210937 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c70315-77eb-4aea-8acc-3cfc1f6dd93e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:00:11.211212 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c70315-77eb-4aea-8acc-3cfc1f6dd93e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:00:11.223457 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c70315-77eb-4aea-8acc-3cfc1f6dd93e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 04:00:11.230957 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-f0c70315-77eb-4aea-8acc-3cfc1f6dd93e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 04:00:11.230957 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 04:00:11.230957 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 04:00:11.230957 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 04:00:11.230957 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 04:00:11.230957 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 04:00:11.230957 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 04:00:11.230957 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 04:00:11.230957 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 04:00:11.230957 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 04:00:11.230957 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 04:00:11.230957 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 04:00:11.230957 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 04:00:11.230957 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 04:00:11.230957 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 04:00:11.230957 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 04:00:11.232053 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 04:00:11.232053 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 04:00:11.232053 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 04:00:11.232053 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 04:00:11.232053 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 04:00:11.232053 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 04:00:11.232053 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 04:00:11.232053 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 04:00:11.232053 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 04:00:11.232053 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 04:00:11.232053 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 04:00:11.232053 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 04:00:11.232053 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 04:00:11.232053 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 04:00:11.232053 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 04:00:11.232053 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 04:00:11.232949 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 04:00:11.232949 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 04:00:11.232949 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 04:00:11.232949 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 04:00:11.232949 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 04:00:11.232949 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 04:00:11.232949 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 04:00:11.232949 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 04:00:11.232949 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 04:00:11.232949 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 04:00:11.232949 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 04:00:11.232949 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 04:00:11.232949 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 590/1195] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Jul 4 04:00:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 04:00:11.239031 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bda40-0959-4aae-a2a9-b6c2b03e8bf9 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:00:11.315735 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:00:11.354125 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bda40-0959-4aae-a2a9-b6c2b03e8bf9 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:00:11.389939 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655e95c-f384-4f88-ab9f-4e8abbe0d4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:00:11.390623 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655e95c-f384-4f88-ab9f-4e8abbe0d4fc None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:00:11.390913 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655e95c-f384-4f88-ab9f-4e8abbe0d4fc None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:00:11.391189 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655e95c-f384-4f88-ab9f-4e8abbe0d4fc None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:00:11.391946 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9655e95c-f384-4f88-ab9f-4e8abbe0d4fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:00:11.392259 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9655e95c-f384-4f88-ab9f-4e8abbe0d4fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:00:11.393693 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9655e95c-f384-4f88-ab9f-4e8abbe0d4fc None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:00:11.401890 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 606/1196] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 04:00:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:00:11.407973 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c70315-77eb-4aea-8acc-3cfc1f6dd93e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:00:11.518120 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c70315-77eb-4aea-8acc-3cfc1f6dd93e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:00:11.554753 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6378a-a107-4d5d-bfbe-be0f95705398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:00:11.555630 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6378a-a107-4d5d-bfbe-be0f95705398 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:00:11.555920 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6378a-a107-4d5d-bfbe-be0f95705398 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:00:11.556199 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6378a-a107-4d5d-bfbe-be0f95705398 None admin] PATH_INFO: `/v3/users/e0509995790a4891b33f26c6dc35decb` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:00:11.557458 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b6378a-a107-4d5d-bfbe-be0f95705398 None admin] RBAC: Authorizing `identity:get_user(user_id=e0509995790a4891b33f26c6dc35decb)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:00:11.558973 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b6378a-a107-4d5d-bfbe-be0f95705398 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:00:11.560642 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 591/1197] 10.222.0.49 () {56 vars in 1177 bytes} [Mon Jul 4 04:00:11 2022] GET /identity/v3/users/e0509995790a4891b33f26c6dc35decb => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:00:11.569862 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655e95c-f384-4f88-ab9f-4e8abbe0d4fc None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:00:11.694790 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655e95c-f384-4f88-ab9f-4e8abbe0d4fc None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:00:11.720936 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:00:11.730681 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632694d-8325-4e44-84ae-b6a43c862982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:00:11.731322 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632694d-8325-4e44-84ae-b6a43c862982 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:00:11.731602 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632694d-8325-4e44-84ae-b6a43c862982 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:00:11.731878 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632694d-8325-4e44-84ae-b6a43c862982 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:00:11.799422 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632694d-8325-4e44-84ae-b6a43c862982 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:00:11.800828 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632694d-8325-4e44-84ae-b6a43c862982 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:00:11.904802 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 607/1198] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 04:00:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 04:00:11.911268 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6378a-a107-4d5d-bfbe-be0f95705398 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:00:11.930778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:00:12.018764 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6378a-a107-4d5d-bfbe-be0f95705398 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:00:12.054961 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82c75e-44d9-4366-a788-740e3feb2af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:00:12.055759 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82c75e-44d9-4366-a788-740e3feb2af8 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:00:12.056045 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82c75e-44d9-4366-a788-740e3feb2af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:00:12.056332 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82c75e-44d9-4366-a788-740e3feb2af8 None admin] PATH_INFO: `/v3/projects/482e6e2ea92448548f7bdc802ea112ca` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:00:12.057649 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a82c75e-44d9-4366-a788-740e3feb2af8 None admin] RBAC: Authorizing `identity:get_project(project_id=482e6e2ea92448548f7bdc802ea112ca)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:00:12.059158 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a82c75e-44d9-4366-a788-740e3feb2af8 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:00:12.060877 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 592/1199] 10.222.0.49 () {56 vars in 1186 bytes} [Mon Jul 4 04:00:11 2022] GET /identity/v3/projects/482e6e2ea92448548f7bdc802ea112ca => generated 361 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:00:12.070055 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632694d-8325-4e44-84ae-b6a43c862982 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:00:12.100668 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:00:12.179062 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632694d-8325-4e44-84ae-b6a43c862982 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:00:12.217489 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398e513-f108-4bea-b7d2-0b6ef5aec130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:00:12.218131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398e513-f108-4bea-b7d2-0b6ef5aec130 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:00:12.218445 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398e513-f108-4bea-b7d2-0b6ef5aec130 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:00:12.218727 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398e513-f108-4bea-b7d2-0b6ef5aec130 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:00:12.219561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398e513-f108-4bea-b7d2-0b6ef5aec130 None admin] RBAC: Adding query filter params (role.id=2eee98054d42475bb7e22a8487ab235e, scope.project.id=482e6e2ea92448548f7bdc802ea112ca, user.id=e0509995790a4891b33f26c6dc35decb) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:00:12.219874 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398e513-f108-4bea-b7d2-0b6ef5aec130 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:00:12.221323 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398e513-f108-4bea-b7d2-0b6ef5aec130 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:00:12.227355 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 608/1200] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 04:00:12 2022] GET /identity/v3/role_assignments?user.id=e0509995790a4891b33f26c6dc35decb&scope.project.id=482e6e2ea92448548f7bdc802ea112ca&role.id=2eee98054d42475bb7e22a8487ab235e => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:00:22.049847 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=58 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:00:22.224625 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=54 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:07.357144 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91c0c3-5a4e-48b1-8ec7-c82f04afacfa None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:07.357144 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91c0c3-5a4e-48b1-8ec7-c82f04afacfa None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:07.357144 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91c0c3-5a4e-48b1-8ec7-c82f04afacfa None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:07.357144 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 593/1201] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:01:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:01:07.364183 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc6804-ec16-449c-8681-79344527c762 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:07.365061 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc6804-ec16-449c-8681-79344527c762 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:07.365579 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc6804-ec16-449c-8681-79344527c762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:07.386547 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-a7bc6804-ec16-449c-8681-79344527c762 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:01:07.387839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a7bc6804-ec16-449c-8681-79344527c762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:01:07.484438 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 609/1202] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:01:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 04:01:07.518407 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91c0c3-5a4e-48b1-8ec7-c82f04afacfa None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:07.649281 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91c0c3-5a4e-48b1-8ec7-c82f04afacfa None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:07.690793 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55662f9-be54-49af-8012-e7caf974051c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:07.691678 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55662f9-be54-49af-8012-e7caf974051c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:07.691990 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55662f9-be54-49af-8012-e7caf974051c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:07.692257 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55662f9-be54-49af-8012-e7caf974051c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:07.703442 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55662f9-be54-49af-8012-e7caf974051c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:07.706722 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55662f9-be54-49af-8012-e7caf974051c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:07.724853 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-f55662f9-be54-49af-8012-e7caf974051c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 04:01:07.724853 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 04:01:07.724853 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 04:01:07.724853 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 04:01:07.724853 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 04:01:07.724853 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 04:01:07.724853 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 04:01:07.724853 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 04:01:07.724853 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 04:01:07.724853 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 04:01:07.724853 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 04:01:07.724853 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 04:01:07.724853 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 04:01:07.724853 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 04:01:07.724853 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 04:01:07.726218 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 04:01:07.726218 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 04:01:07.726218 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 04:01:07.726218 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 04:01:07.726218 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 04:01:07.726218 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 04:01:07.726218 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 04:01:07.726218 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 04:01:07.726218 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 04:01:07.726218 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 04:01:07.726218 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 04:01:07.726218 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 04:01:07.726218 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 04:01:07.726218 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 04:01:07.726218 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 04:01:07.726218 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 04:01:07.726218 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 04:01:07.727357 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 04:01:07.727357 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 04:01:07.727357 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 04:01:07.727357 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 04:01:07.727357 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 594/1203] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 04:01:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 04:01:07.732445 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc6804-ec16-449c-8681-79344527c762 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:07.863162 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc6804-ec16-449c-8681-79344527c762 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:07.901560 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:07.908986 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260eaee-5190-426c-99b7-bb84696e04f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:07.909679 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260eaee-5190-426c-99b7-bb84696e04f8 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:07.909979 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260eaee-5190-426c-99b7-bb84696e04f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:07.910369 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260eaee-5190-426c-99b7-bb84696e04f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:07.911183 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260eaee-5190-426c-99b7-bb84696e04f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:01:07.911519 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260eaee-5190-426c-99b7-bb84696e04f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:07.913355 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260eaee-5190-426c-99b7-bb84696e04f8 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:07.933344 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 610/1204] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 04:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:01:07.934625 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55662f9-be54-49af-8012-e7caf974051c None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:08.002238 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:08.057787 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55662f9-be54-49af-8012-e7caf974051c None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:08.107681 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f14176-ff47-42ee-9f7c-e807e5716711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:08.108422 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f14176-ff47-42ee-9f7c-e807e5716711 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:08.108714 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f14176-ff47-42ee-9f7c-e807e5716711 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:08.108992 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f14176-ff47-42ee-9f7c-e807e5716711 None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:08.109787 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f14176-ff47-42ee-9f7c-e807e5716711 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:08.111347 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f14176-ff47-42ee-9f7c-e807e5716711 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:08.137623 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 595/1205] 10.222.0.49 () {60 vars in 1132 bytes} [Mon Jul 4 04:01:07 2022] POST /identity/v3/users => generated 251 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:01:10.353309 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381501d5-ffd5-4d13-9838-c69e90e9c256 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:10.353860 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381501d5-ffd5-4d13-9838-c69e90e9c256 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:10.353860 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381501d5-ffd5-4d13-9838-c69e90e9c256 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:10.355401 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 611/1206] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:01:10.361723 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6a9b5-a454-4ba4-b2df-fe54b26a35a3 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:10.362596 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6a9b5-a454-4ba4-b2df-fe54b26a35a3 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:10.362596 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6a9b5-a454-4ba4-b2df-fe54b26a35a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:10.380975 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-2ef6a9b5-a454-4ba4-b2df-fe54b26a35a3 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:01:10.382651 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-2ef6a9b5-a454-4ba4-b2df-fe54b26a35a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:01:10.463712 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 596/1207] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:01:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 04:01:10.489031 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381501d5-ffd5-4d13-9838-c69e90e9c256 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:10.615175 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381501d5-ffd5-4d13-9838-c69e90e9c256 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:10.659276 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e9a91-5d74-4d6e-8190-f5d10a84dff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:10.660142 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e9a91-5d74-4d6e-8190-f5d10a84dff0 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:10.660414 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e9a91-5d74-4d6e-8190-f5d10a84dff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:10.660711 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e9a91-5d74-4d6e-8190-f5d10a84dff0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:10.673246 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e9a91-5d74-4d6e-8190-f5d10a84dff0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 04:01:10.680904 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-492e9a91-5d74-4d6e-8190-f5d10a84dff0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 04:01:10.680904 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 04:01:10.680904 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 04:01:10.680904 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 04:01:10.680904 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 04:01:10.680904 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 04:01:10.680904 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 04:01:10.680904 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 04:01:10.680904 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 04:01:10.680904 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 04:01:10.680904 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 04:01:10.680904 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 04:01:10.680904 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 04:01:10.680904 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 04:01:10.680904 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 04:01:10.680904 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 04:01:10.682253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 04:01:10.682253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 04:01:10.682253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 04:01:10.682253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 04:01:10.682253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 04:01:10.682253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 04:01:10.682253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 04:01:10.682253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 04:01:10.682253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 04:01:10.682253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 04:01:10.682253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 04:01:10.682253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 04:01:10.682253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 04:01:10.682253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 04:01:10.682253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 04:01:10.682253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 04:01:10.683157 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 04:01:10.683157 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 04:01:10.683157 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 04:01:10.683157 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 04:01:10.683157 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 04:01:10.683157 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 04:01:10.683157 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 04:01:10.683157 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 04:01:10.683157 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 04:01:10.683157 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 04:01:10.683157 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 04:01:10.683157 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 04:01:10.683157 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 612/1208] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Jul 4 04:01:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 04:01:10.689156 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6a9b5-a454-4ba4-b2df-fe54b26a35a3 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:10.732403 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:10.803870 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6a9b5-a454-4ba4-b2df-fe54b26a35a3 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:10.845750 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7415ede1-16e5-487d-9304-0efa38a9ddfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:10.846769 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415ede1-16e5-487d-9304-0efa38a9ddfb None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:10.847262 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415ede1-16e5-487d-9304-0efa38a9ddfb None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:10.847710 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415ede1-16e5-487d-9304-0efa38a9ddfb None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:10.848718 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7415ede1-16e5-487d-9304-0efa38a9ddfb None admin] RBAC: Adding query filter params (name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:01:10.849240 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7415ede1-16e5-487d-9304-0efa38a9ddfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:10.852022 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7415ede1-16e5-487d-9304-0efa38a9ddfb None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:10.877795 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 597/1209] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Jul 4 04:01:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:01:10.880024 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e9a91-5d74-4d6e-8190-f5d10a84dff0 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:10.954434 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:11.027104 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e9a91-5d74-4d6e-8190-f5d10a84dff0 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:11.067004 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da3e39-a662-4a05-bca7-d965cc5e2286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:11.067813 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da3e39-a662-4a05-bca7-d965cc5e2286 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:11.068103 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da3e39-a662-4a05-bca7-d965cc5e2286 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:11.068422 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da3e39-a662-4a05-bca7-d965cc5e2286 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:11.080877 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da3e39-a662-4a05-bca7-d965cc5e2286 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:11.082440 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da3e39-a662-4a05-bca7-d965cc5e2286 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:11.101701 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-71da3e39-a662-4a05-bca7-d965cc5e2286 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 04:01:11.101701 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 04:01:11.101701 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 04:01:11.101701 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 04:01:11.101701 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 04:01:11.101701 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 04:01:11.101701 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 04:01:11.101701 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 04:01:11.101701 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 04:01:11.101701 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 04:01:11.101701 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 04:01:11.101701 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 04:01:11.101701 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 04:01:11.101701 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 04:01:11.101701 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 04:01:11.102771 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 04:01:11.102771 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 04:01:11.102771 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 04:01:11.102771 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 04:01:11.102771 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 04:01:11.102771 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 04:01:11.102771 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 04:01:11.102771 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 04:01:11.102771 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 04:01:11.102771 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 04:01:11.102771 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 04:01:11.102771 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 04:01:11.102771 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 04:01:11.102771 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 04:01:11.102771 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 04:01:11.102771 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 04:01:11.102771 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 04:01:11.104282 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 04:01:11.104282 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 04:01:11.104282 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 04:01:11.104282 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 04:01:11.104282 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 613/1210] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 04:01:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 04:01:11.109189 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7415ede1-16e5-487d-9304-0efa38a9ddfb None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:11.229928 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:11.233872 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7415ede1-16e5-487d-9304-0efa38a9ddfb None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:11.281355 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c081396-7be6-46a6-9184-471ea8efef6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:11.282258 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c081396-7be6-46a6-9184-471ea8efef6e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:11.282608 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c081396-7be6-46a6-9184-471ea8efef6e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:11.282942 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c081396-7be6-46a6-9184-471ea8efef6e None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:11.283713 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c081396-7be6-46a6-9184-471ea8efef6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:01:11.284068 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c081396-7be6-46a6-9184-471ea8efef6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:11.285768 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c081396-7be6-46a6-9184-471ea8efef6e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:11.300918 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 598/1211] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 04:01:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:01:11.306612 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da3e39-a662-4a05-bca7-d965cc5e2286 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:11.413132 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da3e39-a662-4a05-bca7-d965cc5e2286 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:11.413132 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:11.451163 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d2386-4fd8-4b66-9fcc-319738432165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:11.452073 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d2386-4fd8-4b66-9fcc-319738432165 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:11.452357 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d2386-4fd8-4b66-9fcc-319738432165 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:11.452641 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d2386-4fd8-4b66-9fcc-319738432165 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:11.464324 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d2386-4fd8-4b66-9fcc-319738432165 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:11.465811 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d2386-4fd8-4b66-9fcc-319738432165 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:11.486833 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-1b0d2386-4fd8-4b66-9fcc-319738432165 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 04 04:01:11.486833 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 04:01:11.486833 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 04:01:11.486833 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 04:01:11.486833 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 04:01:11.486833 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 04:01:11.486833 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 04:01:11.486833 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 04:01:11.486833 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 04:01:11.486833 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 04:01:11.486833 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 04:01:11.486833 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 04:01:11.486833 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 04:01:11.486833 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 04:01:11.486833 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 04:01:11.486833 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 04:01:11.488147 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 04:01:11.488147 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 04:01:11.488147 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 04:01:11.488147 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 04:01:11.488147 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 04:01:11.488147 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 04:01:11.488147 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 04:01:11.488147 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 04:01:11.488147 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 04:01:11.488147 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 04:01:11.488147 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 04:01:11.488147 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 04:01:11.488147 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 04:01:11.488147 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 04:01:11.488147 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 04:01:11.488147 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 04:01:11.488147 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 04:01:11.488147 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 04:01:11.489126 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 04:01:11.489126 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 04:01:11.489126 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 04:01:11.489126 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 04:01:11.489126 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 04:01:11.489126 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 04:01:11.489126 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 04:01:11.489126 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 04:01:11.489126 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 04 04:01:11.489126 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 04:01:11.489126 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 614/1212] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 04:01:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 04:01:11.498208 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c081396-7be6-46a6-9184-471ea8efef6e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:11.629514 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c081396-7be6-46a6-9184-471ea8efef6e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:11.673200 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b3d0b-9690-4798-9e82-fad71635adaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:11.674001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b3d0b-9690-4798-9e82-fad71635adaf None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:11.674549 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b3d0b-9690-4798-9e82-fad71635adaf None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:11.674909 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b3d0b-9690-4798-9e82-fad71635adaf None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:11.675860 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b3d0b-9690-4798-9e82-fad71635adaf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:01:11.676185 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b3d0b-9690-4798-9e82-fad71635adaf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:11.677669 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b3d0b-9690-4798-9e82-fad71635adaf None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:11.697453 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 599/1213] 10.222.0.49 () {56 vars in 1143 bytes} [Mon Jul 4 04:01:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:01:11.703051 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d2386-4fd8-4b66-9fcc-319738432165 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:11.820344 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d2386-4fd8-4b66-9fcc-319738432165 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:11.861718 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049a336-1f86-4a0f-8c20-5ca2a5783e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:11.862414 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049a336-1f86-4a0f-8c20-5ca2a5783e4f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:11.862700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049a336-1f86-4a0f-8c20-5ca2a5783e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:11.862983 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049a336-1f86-4a0f-8c20-5ca2a5783e4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:11.898843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:11.945563 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049a336-1f86-4a0f-8c20-5ca2a5783e4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:11.947295 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049a336-1f86-4a0f-8c20-5ca2a5783e4f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:12.068654 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 615/1214] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 04:01:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 04:01:12.072716 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b3d0b-9690-4798-9e82-fad71635adaf None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:12.100379 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:12.206796 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b3d0b-9690-4798-9e82-fad71635adaf None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:12.249066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793b87d1-3dd2-47c6-b5c2-5d30870bdb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:12.249881 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b87d1-3dd2-47c6-b5c2-5d30870bdb1b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:12.251231 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b87d1-3dd2-47c6-b5c2-5d30870bdb1b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:12.251231 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b87d1-3dd2-47c6-b5c2-5d30870bdb1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:12.264562 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793b87d1-3dd2-47c6-b5c2-5d30870bdb1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:12.266248 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793b87d1-3dd2-47c6-b5c2-5d30870bdb1b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:12.291101 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-793b87d1-3dd2-47c6-b5c2-5d30870bdb1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 04:01:12.291101 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 04:01:12.291101 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 04:01:12.291101 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 04:01:12.291101 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 04:01:12.291101 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 04:01:12.291101 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 04:01:12.291101 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 04:01:12.291101 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 04:01:12.291101 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 04:01:12.291101 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 04:01:12.291101 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 04:01:12.291101 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 04:01:12.291101 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 04:01:12.291101 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 04:01:12.292296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 04:01:12.292296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 04:01:12.292296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 04:01:12.292296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 04:01:12.292296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 04:01:12.292296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 04:01:12.292296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 04:01:12.292296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 04:01:12.292296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 04:01:12.292296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 04:01:12.292296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 04:01:12.292296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 04:01:12.292296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 04:01:12.292296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 04:01:12.292296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 04:01:12.292296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 04:01:12.292296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 04:01:12.293245 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 04:01:12.293245 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 04:01:12.293245 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 04:01:12.293245 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 04:01:12.293245 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 600/1215] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 04:01:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 04:01:12.298260 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049a336-1f86-4a0f-8c20-5ca2a5783e4f None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:12.363533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:12.405713 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049a336-1f86-4a0f-8c20-5ca2a5783e4f None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:12.449433 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f421a7d-629c-4f23-8d97-fa554cd232a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:12.450459 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f421a7d-629c-4f23-8d97-fa554cd232a7 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:12.450837 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f421a7d-629c-4f23-8d97-fa554cd232a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:12.451127 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f421a7d-629c-4f23-8d97-fa554cd232a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:12.451895 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f421a7d-629c-4f23-8d97-fa554cd232a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:01:12.452213 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f421a7d-629c-4f23-8d97-fa554cd232a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:12.453631 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f421a7d-629c-4f23-8d97-fa554cd232a7 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:12.470586 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 616/1216] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 04:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:01:12.472543 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793b87d1-3dd2-47c6-b5c2-5d30870bdb1b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:12.574291 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:12.610497 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793b87d1-3dd2-47c6-b5c2-5d30870bdb1b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:12.649884 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf8d06-ec4f-4192-8322-7d26d009e12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:12.650660 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf8d06-ec4f-4192-8322-7d26d009e12f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:12.650955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf8d06-ec4f-4192-8322-7d26d009e12f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:12.651238 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf8d06-ec4f-4192-8322-7d26d009e12f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:12.659444 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf8d06-ec4f-4192-8322-7d26d009e12f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:12.661015 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf8d06-ec4f-4192-8322-7d26d009e12f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:12.678555 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-8eaf8d06-ec4f-4192-8322-7d26d009e12f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 04:01:12.678555 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 04:01:12.678555 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 04:01:12.678555 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 04:01:12.678555 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 04:01:12.678555 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 04:01:12.678555 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 04:01:12.678555 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 04:01:12.678555 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 04:01:12.678555 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 04:01:12.678555 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 04:01:12.678555 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 04:01:12.678555 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 04:01:12.678555 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 04:01:12.678555 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 04:01:12.682830 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 04:01:12.682830 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 04:01:12.682830 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 04:01:12.682830 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 04:01:12.682830 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 04:01:12.682830 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 04:01:12.682830 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 04:01:12.682830 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 04:01:12.682830 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 04:01:12.682830 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 04:01:12.682830 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 04:01:12.682830 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 04:01:12.682830 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 04:01:12.682830 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 04:01:12.682830 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 04:01:12.682830 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 04:01:12.682830 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 04:01:12.683986 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 04:01:12.683986 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 04:01:12.683986 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 04:01:12.683986 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 04:01:12.683986 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 04:01:12.683986 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 04:01:12.683986 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 04:01:12.683986 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 04:01:12.683986 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 601/1217] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 04:01:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 04:01:12.686139 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f421a7d-629c-4f23-8d97-fa554cd232a7 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:12.797093 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f421a7d-629c-4f23-8d97-fa554cd232a7 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:12.821107 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:12.835246 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95e749-0fef-4c2d-b907-77dba1bca549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:12.835914 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95e749-0fef-4c2d-b907-77dba1bca549 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:12.836197 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95e749-0fef-4c2d-b907-77dba1bca549 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:12.836476 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95e749-0fef-4c2d-b907-77dba1bca549 None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:12.837304 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95e749-0fef-4c2d-b907-77dba1bca549 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:01:12.837592 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95e749-0fef-4c2d-b907-77dba1bca549 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:12.839071 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95e749-0fef-4c2d-b907-77dba1bca549 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:12.851533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 617/1218] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Jul 4 04:01:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:01:12.857480 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf8d06-ec4f-4192-8322-7d26d009e12f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:12.980922 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf8d06-ec4f-4192-8322-7d26d009e12f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:13.013334 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:13.020048 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c621d2-371f-4cc5-b28e-32bc24d2bd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:13.020766 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c621d2-371f-4cc5-b28e-32bc24d2bd26 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:13.021054 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c621d2-371f-4cc5-b28e-32bc24d2bd26 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:13.021336 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c621d2-371f-4cc5-b28e-32bc24d2bd26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:13.022279 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c621d2-371f-4cc5-b28e-32bc24d2bd26 None admin] RBAC: Adding query filter params (role.id=7fd75ec0129248b28b5254e00d4f6f0b, scope.project.id=424a145a22434ef7a14b6108e6118ccb, user.id=c2a18591461343c3a0a1b0e317734ba3) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:01:13.022638 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c621d2-371f-4cc5-b28e-32bc24d2bd26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:13.024310 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c621d2-371f-4cc5-b28e-32bc24d2bd26 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:13.031498 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 602/1219] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 04:01:12 2022] GET /identity/v3/role_assignments?user.id=c2a18591461343c3a0a1b0e317734ba3&scope.project.id=424a145a22434ef7a14b6108e6118ccb&role.id=7fd75ec0129248b28b5254e00d4f6f0b => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:01:15.156563 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab344d7-4565-4156-bc9d-3cbc7ddef7ad None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:15.157190 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab344d7-4565-4156-bc9d-3cbc7ddef7ad None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:15.157190 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab344d7-4565-4156-bc9d-3cbc7ddef7ad None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:15.158655 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 618/1220] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:01:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:01:15.164871 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fd7c0-7771-49bb-83c6-7dffa487679a None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:15.165330 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fd7c0-7771-49bb-83c6-7dffa487679a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:15.165561 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fd7c0-7771-49bb-83c6-7dffa487679a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:15.183586 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-a30fd7c0-7771-49bb-83c6-7dffa487679a None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:01:15.184771 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a30fd7c0-7771-49bb-83c6-7dffa487679a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:01:15.258271 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 603/1221] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:01:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 04:01:15.278237 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab344d7-4565-4156-bc9d-3cbc7ddef7ad None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:15.388343 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab344d7-4565-4156-bc9d-3cbc7ddef7ad None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:15.423301 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1874a0-d0f0-47fc-a3c8-754042706fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:15.424101 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1874a0-d0f0-47fc-a3c8-754042706fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:15.424379 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1874a0-d0f0-47fc-a3c8-754042706fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:15.424660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1874a0-d0f0-47fc-a3c8-754042706fa5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:15.434979 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1874a0-d0f0-47fc-a3c8-754042706fa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 04:01:15.442602 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-fb1874a0-d0f0-47fc-a3c8-754042706fa5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 04:01:15.442602 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 04:01:15.442602 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 04:01:15.442602 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 04:01:15.442602 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 04:01:15.442602 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 04:01:15.442602 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 04:01:15.442602 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 04:01:15.442602 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 04:01:15.442602 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 04:01:15.442602 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 04:01:15.442602 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 04:01:15.442602 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 04:01:15.442602 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 04:01:15.442602 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 04:01:15.442602 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 04:01:15.443735 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 04:01:15.443735 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 04:01:15.443735 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 04:01:15.443735 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 04:01:15.443735 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 04:01:15.443735 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 04:01:15.443735 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 04:01:15.443735 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 04:01:15.443735 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 04:01:15.443735 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 04:01:15.443735 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 04:01:15.443735 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 04:01:15.443735 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 04:01:15.443735 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 04:01:15.443735 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 04:01:15.443735 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 04:01:15.444802 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 04:01:15.444802 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 04:01:15.444802 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 04:01:15.444802 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 04:01:15.444802 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 04:01:15.444802 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 04:01:15.444802 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 04:01:15.444802 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 04:01:15.444802 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 04:01:15.444802 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 04:01:15.444802 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 04:01:15.444802 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 04:01:15.449085 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 619/1222] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Jul 4 04:01:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 04:01:15.450140 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fd7c0-7771-49bb-83c6-7dffa487679a None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:15.562424 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fd7c0-7771-49bb-83c6-7dffa487679a None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:15.588360 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:15.600219 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b812a-f455-43a3-81f1-7f7e812d812b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:15.600895 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b812a-f455-43a3-81f1-7f7e812d812b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:15.601187 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b812a-f455-43a3-81f1-7f7e812d812b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:15.601485 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b812a-f455-43a3-81f1-7f7e812d812b None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:15.602256 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b812a-f455-43a3-81f1-7f7e812d812b None admin] RBAC: Adding query filter params (name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:01:15.602603 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b812a-f455-43a3-81f1-7f7e812d812b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:15.603969 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b812a-f455-43a3-81f1-7f7e812d812b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:15.612713 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 604/1223] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Jul 4 04:01:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:01:15.618684 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1874a0-d0f0-47fc-a3c8-754042706fa5 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:15.664514 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:15.725310 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1874a0-d0f0-47fc-a3c8-754042706fa5 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:15.762758 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279177c8-56bf-4ee0-80db-7c53a27d75d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:15.763753 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279177c8-56bf-4ee0-80db-7c53a27d75d6 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:15.764158 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279177c8-56bf-4ee0-80db-7c53a27d75d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:15.764470 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279177c8-56bf-4ee0-80db-7c53a27d75d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:15.776683 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279177c8-56bf-4ee0-80db-7c53a27d75d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:15.778178 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279177c8-56bf-4ee0-80db-7c53a27d75d6 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:15.796182 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-279177c8-56bf-4ee0-80db-7c53a27d75d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 04:01:15.796182 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 04:01:15.796182 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 04:01:15.796182 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 04:01:15.796182 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 04:01:15.796182 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 04:01:15.796182 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 04:01:15.796182 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 04:01:15.796182 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 04:01:15.796182 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 04:01:15.796182 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 04:01:15.796182 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 04:01:15.796182 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 04:01:15.796182 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 04:01:15.796182 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 04:01:15.797604 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 04:01:15.797604 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 04:01:15.797604 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 04:01:15.797604 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 04:01:15.797604 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 04:01:15.797604 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 04:01:15.797604 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 04:01:15.797604 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 04:01:15.797604 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 04:01:15.797604 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 04:01:15.797604 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 04:01:15.797604 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 04:01:15.797604 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 04:01:15.797604 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 04:01:15.797604 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 04:01:15.797604 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 04:01:15.797604 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 04:01:15.798882 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 04:01:15.798882 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 04:01:15.798882 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 04:01:15.798882 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 04:01:15.798882 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 620/1224] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 04:01:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 04:01:15.803530 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b812a-f455-43a3-81f1-7f7e812d812b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:15.905054 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b812a-f455-43a3-81f1-7f7e812d812b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:15.939375 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89f3db-38e5-4e45-9751-5793ccc75070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:15.940052 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89f3db-38e5-4e45-9751-5793ccc75070 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:15.940339 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89f3db-38e5-4e45-9751-5793ccc75070 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:15.940614 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89f3db-38e5-4e45-9751-5793ccc75070 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:15.941343 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e89f3db-38e5-4e45-9751-5793ccc75070 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:01:15.941654 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e89f3db-38e5-4e45-9751-5793ccc75070 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:15.943088 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e89f3db-38e5-4e45-9751-5793ccc75070 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:15.957329 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 605/1225] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 04:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:01:15.963287 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279177c8-56bf-4ee0-80db-7c53a27d75d6 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:16.065019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:16.072981 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279177c8-56bf-4ee0-80db-7c53a27d75d6 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:16.110794 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4216079-2087-4c0c-930a-10b658f28d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:16.111790 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4216079-2087-4c0c-930a-10b658f28d9a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:16.112103 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4216079-2087-4c0c-930a-10b658f28d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:16.112384 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4216079-2087-4c0c-930a-10b658f28d9a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:16.121406 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4216079-2087-4c0c-930a-10b658f28d9a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:16.123023 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4216079-2087-4c0c-930a-10b658f28d9a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:16.142056 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-f4216079-2087-4c0c-930a-10b658f28d9a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 04 04:01:16.142056 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 04:01:16.142056 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 04:01:16.142056 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 04:01:16.142056 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 04:01:16.142056 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 04:01:16.142056 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 04:01:16.142056 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 04:01:16.142056 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 04:01:16.142056 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 04:01:16.142056 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 04:01:16.142056 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 04:01:16.142056 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 04:01:16.142056 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 04:01:16.142056 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 04:01:16.142056 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 04:01:16.143121 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 04:01:16.143121 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 04:01:16.143121 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 04:01:16.143121 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 04:01:16.143121 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 04:01:16.143121 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 04:01:16.143121 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 04:01:16.143121 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 04:01:16.143121 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 04:01:16.143121 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 04:01:16.143121 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 04:01:16.143121 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 04:01:16.143121 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 04:01:16.143121 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 04:01:16.143121 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 04:01:16.143121 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 04:01:16.143121 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 04:01:16.143121 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 04:01:16.144057 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 04:01:16.144057 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 04:01:16.144057 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 04:01:16.144057 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 04:01:16.144057 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 04:01:16.144057 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 04:01:16.144057 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 04:01:16.144057 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 04:01:16.144057 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 04 04:01:16.144057 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 04:01:16.144057 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 621/1226] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 04:01:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 04:01:16.149390 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89f3db-38e5-4e45-9751-5793ccc75070 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:16.202610 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:16.262823 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89f3db-38e5-4e45-9751-5793ccc75070 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:16.301744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7911bc4-baa9-45df-bd26-1050d019d99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:16.302605 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7911bc4-baa9-45df-bd26-1050d019d99b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:16.302879 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7911bc4-baa9-45df-bd26-1050d019d99b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:16.303188 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7911bc4-baa9-45df-bd26-1050d019d99b None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:16.304217 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7911bc4-baa9-45df-bd26-1050d019d99b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:01:16.304597 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7911bc4-baa9-45df-bd26-1050d019d99b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:16.306311 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7911bc4-baa9-45df-bd26-1050d019d99b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:16.330596 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 606/1227] 10.222.0.49 () {56 vars in 1143 bytes} [Mon Jul 4 04:01:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:01:16.331864 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4216079-2087-4c0c-930a-10b658f28d9a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:16.447719 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4216079-2087-4c0c-930a-10b658f28d9a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:16.485974 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae64841-07df-4d79-85ac-e2848e422ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:16.486825 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae64841-07df-4d79-85ac-e2848e422ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:16.487183 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae64841-07df-4d79-85ac-e2848e422ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:16.487537 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae64841-07df-4d79-85ac-e2848e422ee9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:16.498921 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae64841-07df-4d79-85ac-e2848e422ee9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:16.500582 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae64841-07df-4d79-85ac-e2848e422ee9 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:16.521340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-8ae64841-07df-4d79-85ac-e2848e422ee9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 04:01:16.521340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 04:01:16.521340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 04:01:16.521340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 04:01:16.521340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 04:01:16.521340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 04:01:16.521340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 04:01:16.521340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 04:01:16.521340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 04:01:16.521340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 04:01:16.521340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 04:01:16.521340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 04:01:16.521340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 04:01:16.521340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 04:01:16.521340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 04:01:16.522530 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 04:01:16.522530 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 04:01:16.522530 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 04:01:16.522530 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 04:01:16.522530 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 04:01:16.522530 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 04:01:16.522530 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 04:01:16.522530 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 04:01:16.522530 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 04:01:16.522530 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 04:01:16.522530 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 04:01:16.522530 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 04:01:16.522530 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 04:01:16.522530 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 04:01:16.522530 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 04:01:16.522530 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 04:01:16.522530 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 04:01:16.523614 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 04:01:16.523614 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 04:01:16.523614 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 04:01:16.523614 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 04:01:16.523614 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 622/1228] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 04:01:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 04:01:16.529482 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7911bc4-baa9-45df-bd26-1050d019d99b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:16.648048 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7911bc4-baa9-45df-bd26-1050d019d99b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:16.650748 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:16.687841 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c8e18-b3f4-4953-863f-e229a8a516ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:16.688728 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c8e18-b3f4-4953-863f-e229a8a516ed None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:16.689100 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c8e18-b3f4-4953-863f-e229a8a516ed None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:16.689508 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c8e18-b3f4-4953-863f-e229a8a516ed None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:16.690484 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c8e18-b3f4-4953-863f-e229a8a516ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:01:16.690847 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c8e18-b3f4-4953-863f-e229a8a516ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:16.692613 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c8e18-b3f4-4953-863f-e229a8a516ed None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:16.705996 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 607/1229] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 04:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 04:01:16.712507 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae64841-07df-4d79-85ac-e2848e422ee9 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:16.721705 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:16.826635 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae64841-07df-4d79-85ac-e2848e422ee9 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:16.864312 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe0112-9b81-434a-8f59-d2b79201f68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:16.865116 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe0112-9b81-434a-8f59-d2b79201f68f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:16.865404 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe0112-9b81-434a-8f59-d2b79201f68f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:16.865681 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe0112-9b81-434a-8f59-d2b79201f68f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:16.872955 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe0112-9b81-434a-8f59-d2b79201f68f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:16.874632 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe0112-9b81-434a-8f59-d2b79201f68f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:16.889549 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-4cfe0112-9b81-434a-8f59-d2b79201f68f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 04:01:16.889549 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 04:01:16.889549 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 04:01:16.889549 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 04:01:16.889549 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 04:01:16.889549 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 04:01:16.889549 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 04:01:16.889549 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 04:01:16.889549 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 04:01:16.889549 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 04:01:16.889549 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 04:01:16.889549 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 04:01:16.889549 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 04:01:16.889549 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 04:01:16.889549 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 04:01:16.890748 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 04:01:16.890748 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 04:01:16.890748 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 04:01:16.890748 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 04:01:16.890748 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 04:01:16.890748 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 04:01:16.890748 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 04:01:16.890748 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 04:01:16.890748 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 04:01:16.890748 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 04:01:16.890748 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 04:01:16.890748 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 04:01:16.890748 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 04:01:16.890748 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 04:01:16.890748 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 04:01:16.890748 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 04:01:16.890748 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 04:01:16.891843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 04:01:16.891843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 04:01:16.891843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 04:01:16.891843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 04:01:16.891843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 04:01:16.891843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 04:01:16.891843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 04:01:16.891843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 04:01:16.891843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 623/1230] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 04:01:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 04:01:16.896986 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c8e18-b3f4-4953-863f-e229a8a516ed None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:17.013937 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c8e18-b3f4-4953-863f-e229a8a516ed None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:17.048925 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25fac9e-0213-49b8-b5a3-399814eb1da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:17.049714 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fac9e-0213-49b8-b5a3-399814eb1da4 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:17.050002 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fac9e-0213-49b8-b5a3-399814eb1da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:17.050386 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fac9e-0213-49b8-b5a3-399814eb1da4 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:17.051240 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25fac9e-0213-49b8-b5a3-399814eb1da4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:01:17.051586 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25fac9e-0213-49b8-b5a3-399814eb1da4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:17.053236 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25fac9e-0213-49b8-b5a3-399814eb1da4 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:17.067588 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 608/1231] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Jul 4 04:01:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:01:17.073786 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe0112-9b81-434a-8f59-d2b79201f68f None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:17.147217 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:17.185843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe0112-9b81-434a-8f59-d2b79201f68f None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:17.224375 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4428a76-e42e-49d8-96ec-6c4755addbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:17.225316 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4428a76-e42e-49d8-96ec-6c4755addbf7 None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:17.225663 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4428a76-e42e-49d8-96ec-6c4755addbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:17.225941 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4428a76-e42e-49d8-96ec-6c4755addbf7 None admin] PATH_INFO: `/v3/projects/424a145a22434ef7a14b6108e6118ccb/users/c2a18591461343c3a0a1b0e317734ba3/roles/7fd75ec0129248b28b5254e00d4f6f0b` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:17.250306 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4428a76-e42e-49d8-96ec-6c4755addbf7 None admin] RBAC: Authorizing `identity:create_grant(project_id=424a145a22434ef7a14b6108e6118ccb, user_id=c2a18591461343c3a0a1b0e317734ba3, role_id=7fd75ec0129248b28b5254e00d4f6f0b)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:17.252519 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4428a76-e42e-49d8-96ec-6c4755addbf7 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:17.269210 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 624/1232] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Jul 4 04:01:17 2022] PUT /identity/v3/projects/424a145a22434ef7a14b6108e6118ccb/users/c2a18591461343c3a0a1b0e317734ba3/roles/7fd75ec0129248b28b5254e00d4f6f0b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:01:19.357456 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd953771-63d7-456e-859d-06c07cd81ce0 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:19.358011 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd953771-63d7-456e-859d-06c07cd81ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:19.358011 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd953771-63d7-456e-859d-06c07cd81ce0 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:19.359519 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 609/1233] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:01:19.365434 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0aa748-c2dd-4224-91bb-1e3908331ae0 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:19.365841 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0aa748-c2dd-4224-91bb-1e3908331ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:19.366148 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0aa748-c2dd-4224-91bb-1e3908331ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:19.384894 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-eb0aa748-c2dd-4224-91bb-1e3908331ae0 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:01:19.386387 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-eb0aa748-c2dd-4224-91bb-1e3908331ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:01:19.458065 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 625/1234] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:01:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 04:01:19.482752 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd953771-63d7-456e-859d-06c07cd81ce0 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:19.511200 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:19.605585 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd953771-63d7-456e-859d-06c07cd81ce0 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:19.646336 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2243b635-7982-4ecd-bef0-7fff9c658909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:19.647072 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243b635-7982-4ecd-bef0-7fff9c658909 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:19.647366 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243b635-7982-4ecd-bef0-7fff9c658909 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:19.647648 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243b635-7982-4ecd-bef0-7fff9c658909 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:19.658270 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2243b635-7982-4ecd-bef0-7fff9c658909 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 04:01:19.667121 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-2243b635-7982-4ecd-bef0-7fff9c658909 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 04 04:01:19.667121 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 04:01:19.667121 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 04:01:19.667121 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 04:01:19.667121 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 04:01:19.667121 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 04:01:19.667121 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 04:01:19.667121 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 04:01:19.667121 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 04:01:19.667121 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 04:01:19.667121 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 04:01:19.667121 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 04:01:19.667121 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 04:01:19.667121 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 04:01:19.667121 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 04:01:19.667121 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 04:01:19.670383 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 04:01:19.670383 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 04:01:19.670383 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 04:01:19.670383 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 04:01:19.670383 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 04:01:19.670383 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 04:01:19.670383 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 04:01:19.670383 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 04:01:19.670383 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 04:01:19.670383 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 04:01:19.670383 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 04:01:19.670383 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 04:01:19.670383 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 04:01:19.670383 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 04:01:19.670383 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 04:01:19.670383 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 04:01:19.671483 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 04:01:19.671483 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 04:01:19.671483 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 04:01:19.671483 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 04:01:19.671483 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 04:01:19.671483 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 04:01:19.671483 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 04:01:19.671483 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 04:01:19.671483 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 04:01:19.671483 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 04:01:19.671483 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 04 04:01:19.671483 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 04:01:19.671483 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 610/1235] 10.222.0.49 () {56 vars in 1102 bytes} [Mon Jul 4 04:01:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 04:01:19.674589 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0aa748-c2dd-4224-91bb-1e3908331ae0 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:19.722542 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:19.779059 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0aa748-c2dd-4224-91bb-1e3908331ae0 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:19.813238 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19eec5-af94-4a4e-98a1-0691a04a795d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:19.813896 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19eec5-af94-4a4e-98a1-0691a04a795d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:19.814219 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19eec5-af94-4a4e-98a1-0691a04a795d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:19.814502 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19eec5-af94-4a4e-98a1-0691a04a795d None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:19.815228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19eec5-af94-4a4e-98a1-0691a04a795d None admin] RBAC: Adding query filter params (name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:01:19.815533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19eec5-af94-4a4e-98a1-0691a04a795d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:19.816964 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19eec5-af94-4a4e-98a1-0691a04a795d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:19.825628 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 626/1236] 10.222.0.49 () {56 vars in 1103 bytes} [Mon Jul 4 04:01:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 04:01:19.831574 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2243b635-7982-4ecd-bef0-7fff9c658909 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:19.920848 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:19.938906 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2243b635-7982-4ecd-bef0-7fff9c658909 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:19.979703 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d9557-f1f9-466a-866d-2c587d2dd021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:19.980680 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d9557-f1f9-466a-866d-2c587d2dd021 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:19.981071 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d9557-f1f9-466a-866d-2c587d2dd021 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:19.981394 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d9557-f1f9-466a-866d-2c587d2dd021 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:19.994087 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d9557-f1f9-466a-866d-2c587d2dd021 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:19.995940 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d9557-f1f9-466a-866d-2c587d2dd021 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:20.014770 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-701d9557-f1f9-466a-866d-2c587d2dd021 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 04:01:20.014770 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 04:01:20.014770 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 04:01:20.014770 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 04:01:20.014770 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 04:01:20.014770 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 04:01:20.014770 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 04:01:20.014770 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 04:01:20.014770 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 04:01:20.014770 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 04:01:20.014770 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 04:01:20.014770 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 04:01:20.014770 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 04:01:20.014770 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 04:01:20.014770 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 04:01:20.015936 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 04:01:20.015936 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 04:01:20.015936 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 04:01:20.015936 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 04:01:20.015936 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 04:01:20.015936 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 04:01:20.015936 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 04:01:20.015936 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 04:01:20.015936 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 04:01:20.015936 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 04:01:20.015936 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 04:01:20.015936 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 04:01:20.015936 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 04:01:20.015936 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 04:01:20.015936 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 04:01:20.015936 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 04:01:20.015936 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 04:01:20.017128 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 04:01:20.017128 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 04:01:20.017128 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 04:01:20.017128 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 04:01:20.017128 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 611/1237] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 04:01:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 04:01:20.022030 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19eec5-af94-4a4e-98a1-0691a04a795d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:20.128601 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19eec5-af94-4a4e-98a1-0691a04a795d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:20.138007 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:20.168229 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af70b8-99e6-4e05-ac13-d0884bb58db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:20.168908 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af70b8-99e6-4e05-ac13-d0884bb58db5 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:20.169231 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af70b8-99e6-4e05-ac13-d0884bb58db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:20.169540 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af70b8-99e6-4e05-ac13-d0884bb58db5 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:20.170277 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af70b8-99e6-4e05-ac13-d0884bb58db5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:01:20.170591 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af70b8-99e6-4e05-ac13-d0884bb58db5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:20.172038 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af70b8-99e6-4e05-ac13-d0884bb58db5 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:20.184684 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 627/1238] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 04:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:01:20.190553 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d9557-f1f9-466a-866d-2c587d2dd021 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:20.304534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d9557-f1f9-466a-866d-2c587d2dd021 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:20.351757 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebf9bf-59ed-43a3-8a5a-f8ac7f8df837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:20.352583 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebf9bf-59ed-43a3-8a5a-f8ac7f8df837 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:20.352865 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebf9bf-59ed-43a3-8a5a-f8ac7f8df837 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:20.353142 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebf9bf-59ed-43a3-8a5a-f8ac7f8df837 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:20.356008 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:20.362661 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eebf9bf-59ed-43a3-8a5a-f8ac7f8df837 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:20.364158 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eebf9bf-59ed-43a3-8a5a-f8ac7f8df837 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:20.378579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-1eebf9bf-59ed-43a3-8a5a-f8ac7f8df837 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 04 04:01:20.378579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 04:01:20.378579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 04:01:20.378579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 04:01:20.378579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 04:01:20.378579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 04:01:20.378579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 04:01:20.378579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 04:01:20.378579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 04:01:20.378579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 04:01:20.378579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 04:01:20.378579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 04:01:20.378579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 04:01:20.378579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 04:01:20.378579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 04:01:20.378579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 04:01:20.379727 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 04:01:20.379727 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 04:01:20.379727 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 04:01:20.379727 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 04:01:20.379727 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 04:01:20.379727 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 04:01:20.379727 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 04:01:20.379727 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 04:01:20.379727 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 04:01:20.379727 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 04:01:20.379727 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 04:01:20.379727 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 04:01:20.379727 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 04:01:20.379727 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 04:01:20.379727 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 04:01:20.379727 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 04:01:20.379727 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 04:01:20.379727 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 04:01:20.381365 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 04:01:20.381365 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 04:01:20.381365 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 04:01:20.381365 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 04:01:20.381365 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 04:01:20.381365 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 04:01:20.381365 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 04:01:20.381365 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 04:01:20.381365 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 04 04:01:20.381365 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 04:01:20.384941 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 612/1239] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 04:01:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 04:01:20.386297 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af70b8-99e6-4e05-ac13-d0884bb58db5 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:20.499323 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af70b8-99e6-4e05-ac13-d0884bb58db5 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:20.539127 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47a82b-07fe-4f02-ab45-329a17ebb251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:20.539810 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47a82b-07fe-4f02-ab45-329a17ebb251 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:20.540198 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47a82b-07fe-4f02-ab45-329a17ebb251 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:20.540502 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47a82b-07fe-4f02-ab45-329a17ebb251 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:20.541332 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c47a82b-07fe-4f02-ab45-329a17ebb251 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:01:20.541657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c47a82b-07fe-4f02-ab45-329a17ebb251 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:20.543232 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c47a82b-07fe-4f02-ab45-329a17ebb251 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:20.563543 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 628/1240] 10.222.0.49 () {56 vars in 1143 bytes} [Mon Jul 4 04:01:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:01:20.569459 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebf9bf-59ed-43a3-8a5a-f8ac7f8df837 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:20.682339 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebf9bf-59ed-43a3-8a5a-f8ac7f8df837 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:20.717869 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210a76a-8831-4193-88fb-601f3feeff1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:20.718562 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210a76a-8831-4193-88fb-601f3feeff1d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:20.718846 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210a76a-8831-4193-88fb-601f3feeff1d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:20.719128 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210a76a-8831-4193-88fb-601f3feeff1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:20.783741 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:20.790848 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9210a76a-8831-4193-88fb-601f3feeff1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:20.792365 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9210a76a-8831-4193-88fb-601f3feeff1d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:20.908484 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 613/1241] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 04:01:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 04:01:20.914663 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47a82b-07fe-4f02-ab45-329a17ebb251 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:20.945774 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:21.026753 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47a82b-07fe-4f02-ab45-329a17ebb251 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:21.062230 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09229f-9daf-4e5a-89ac-1db754b70e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:21.062956 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09229f-9daf-4e5a-89ac-1db754b70e41 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:21.063243 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09229f-9daf-4e5a-89ac-1db754b70e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:21.063519 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09229f-9daf-4e5a-89ac-1db754b70e41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:21.074025 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09229f-9daf-4e5a-89ac-1db754b70e41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:21.075512 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09229f-9daf-4e5a-89ac-1db754b70e41 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:21.093559 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-2b09229f-9daf-4e5a-89ac-1db754b70e41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 04:01:21.093559 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 04:01:21.093559 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 04:01:21.093559 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 04:01:21.093559 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 04:01:21.093559 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 04:01:21.093559 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 04:01:21.093559 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 04:01:21.093559 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 04:01:21.093559 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 04:01:21.093559 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 04:01:21.093559 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 04:01:21.093559 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 04:01:21.093559 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 04:01:21.093559 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 04:01:21.094732 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 04:01:21.094732 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 04:01:21.094732 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 04:01:21.094732 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 04:01:21.094732 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 04:01:21.094732 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 04:01:21.094732 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 04:01:21.094732 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 04:01:21.094732 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 04:01:21.094732 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 04:01:21.094732 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 04:01:21.094732 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 04:01:21.094732 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 04:01:21.094732 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 04:01:21.094732 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 04:01:21.094732 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 04:01:21.094732 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 04:01:21.096518 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 04:01:21.096518 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 04:01:21.096518 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 04:01:21.096518 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 04:01:21.096518 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 629/1242] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 04:01:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 04:01:21.100687 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210a76a-8831-4193-88fb-601f3feeff1d None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:21.205373 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:21.212975 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210a76a-8831-4193-88fb-601f3feeff1d None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:21.248199 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c69848-bd42-4ebc-a55b-cb5affbae8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:21.248882 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c69848-bd42-4ebc-a55b-cb5affbae8ec None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:21.249172 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c69848-bd42-4ebc-a55b-cb5affbae8ec None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:21.249451 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c69848-bd42-4ebc-a55b-cb5affbae8ec None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:21.250211 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c69848-bd42-4ebc-a55b-cb5affbae8ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:01:21.250524 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c69848-bd42-4ebc-a55b-cb5affbae8ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:21.251933 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c69848-bd42-4ebc-a55b-cb5affbae8ec None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:21.264530 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 614/1243] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 04:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:01:21.270374 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09229f-9daf-4e5a-89ac-1db754b70e41 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:21.350808 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:21.373954 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09229f-9daf-4e5a-89ac-1db754b70e41 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:21.411816 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45929f86-2b6e-4bc3-bcc8-5f0ac386ae08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:21.412614 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45929f86-2b6e-4bc3-bcc8-5f0ac386ae08 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:21.412903 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45929f86-2b6e-4bc3-bcc8-5f0ac386ae08 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:21.413186 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45929f86-2b6e-4bc3-bcc8-5f0ac386ae08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:21.420182 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45929f86-2b6e-4bc3-bcc8-5f0ac386ae08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:21.421659 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45929f86-2b6e-4bc3-bcc8-5f0ac386ae08 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:21.435596 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-45929f86-2b6e-4bc3-bcc8-5f0ac386ae08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 04:01:21.435596 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 04:01:21.435596 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 04:01:21.435596 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 04:01:21.435596 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 04:01:21.435596 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 04:01:21.435596 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 04:01:21.435596 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 04:01:21.435596 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 04:01:21.435596 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 04:01:21.435596 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 04:01:21.435596 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 04:01:21.435596 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 04:01:21.435596 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 04:01:21.435596 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 04:01:21.436934 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 04:01:21.436934 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 04:01:21.436934 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 04:01:21.436934 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 04:01:21.436934 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 04:01:21.436934 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 04:01:21.436934 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 04:01:21.436934 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 04:01:21.436934 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 04:01:21.436934 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 04:01:21.436934 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 04:01:21.436934 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 04:01:21.436934 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 04:01:21.436934 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 04:01:21.436934 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 04:01:21.436934 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 04:01:21.436934 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 04:01:21.437858 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 04:01:21.437858 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 04:01:21.437858 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 04:01:21.437858 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 04:01:21.437858 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 04:01:21.437858 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 04:01:21.437858 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 04:01:21.437858 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 04:01:21.437858 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 630/1244] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 04:01:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 04:01:21.442949 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c69848-bd42-4ebc-a55b-cb5affbae8ec None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:21.547008 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c69848-bd42-4ebc-a55b-cb5affbae8ec None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:21.585544 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff8b2e-f034-4e41-bdab-9ce91ac19494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:21.586269 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff8b2e-f034-4e41-bdab-9ce91ac19494 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:21.586558 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff8b2e-f034-4e41-bdab-9ce91ac19494 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:21.586844 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff8b2e-f034-4e41-bdab-9ce91ac19494 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:21.587669 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff8b2e-f034-4e41-bdab-9ce91ac19494 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:01:21.588004 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff8b2e-f034-4e41-bdab-9ce91ac19494 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:21.589480 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff8b2e-f034-4e41-bdab-9ce91ac19494 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:21.602865 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 615/1245] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Jul 4 04:01:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:01:21.608980 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45929f86-2b6e-4bc3-bcc8-5f0ac386ae08 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:21.722599 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45929f86-2b6e-4bc3-bcc8-5f0ac386ae08 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:21.767128 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8846ed7-b122-4cd6-b279-6bd91ffa0b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:21.767825 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8846ed7-b122-4cd6-b279-6bd91ffa0b93 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:21.768115 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8846ed7-b122-4cd6-b279-6bd91ffa0b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:21.768419 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8846ed7-b122-4cd6-b279-6bd91ffa0b93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:21.769253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8846ed7-b122-4cd6-b279-6bd91ffa0b93 None admin] RBAC: Adding query filter params (role.id=7fd75ec0129248b28b5254e00d4f6f0b, scope.project.id=424a145a22434ef7a14b6108e6118ccb, user.id=c2a18591461343c3a0a1b0e317734ba3) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:01:21.769580 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8846ed7-b122-4cd6-b279-6bd91ffa0b93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:21.771096 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8846ed7-b122-4cd6-b279-6bd91ffa0b93 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:21.778259 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 631/1246] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 04:01:21 2022] GET /identity/v3/role_assignments?user.id=c2a18591461343c3a0a1b0e317734ba3&scope.project.id=424a145a22434ef7a14b6108e6118ccb&role.id=7fd75ec0129248b28b5254e00d4f6f0b => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 04:01:23.909484 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b32780-1d72-45c6-b501-918402911a31 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:23.910027 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b32780-1d72-45c6-b501-918402911a31 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:23.910140 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b32780-1d72-45c6-b501-918402911a31 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:23.911914 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 616/1247] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:01:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:01:23.918078 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53165331-f77b-4372-aae9-dad029afcb20 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:23.918588 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53165331-f77b-4372-aae9-dad029afcb20 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:23.918693 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53165331-f77b-4372-aae9-dad029afcb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:23.923839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:23.938417 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-53165331-f77b-4372-aae9-dad029afcb20 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:01:23.938417 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-53165331-f77b-4372-aae9-dad029afcb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:01:24.017541 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 632/1248] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:01:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 04 04:01:24.047202 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b32780-1d72-45c6-b501-918402911a31 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:24.069393 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:24.156342 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b32780-1d72-45c6-b501-918402911a31 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:24.193193 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da008fa8-a937-454b-b177-ba9593ed4c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:24.193912 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da008fa8-a937-454b-b177-ba9593ed4c1f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:24.194193 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da008fa8-a937-454b-b177-ba9593ed4c1f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:24.194477 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da008fa8-a937-454b-b177-ba9593ed4c1f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:24.205928 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da008fa8-a937-454b-b177-ba9593ed4c1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 04:01:24.214271 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-da008fa8-a937-454b-b177-ba9593ed4c1f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 04:01:24.214271 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 04:01:24.214271 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 04:01:24.214271 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 04:01:24.214271 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 04:01:24.214271 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 04:01:24.214271 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 04:01:24.214271 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 04:01:24.214271 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 04:01:24.214271 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 04:01:24.214271 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 04:01:24.214271 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 04:01:24.214271 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 04:01:24.214271 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 04:01:24.214271 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 04:01:24.214271 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 04:01:24.215228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 04:01:24.215228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 04:01:24.215228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 04:01:24.215228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 04:01:24.215228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 04:01:24.215228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 04:01:24.215228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 04:01:24.215228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 04:01:24.215228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 04:01:24.215228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 04:01:24.215228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 04:01:24.215228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 04:01:24.215228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 04:01:24.215228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 04:01:24.215228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 04:01:24.215228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 04:01:24.219066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 04:01:24.219066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 04:01:24.219066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 04:01:24.219066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 04:01:24.219066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 04:01:24.219066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 04:01:24.219066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 04:01:24.219066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 04:01:24.219066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 04:01:24.219066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 04:01:24.219066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 04:01:24.219066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 04:01:24.219066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 617/1249] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Jul 4 04:01:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 04:01:24.221703 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53165331-f77b-4372-aae9-dad029afcb20 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:24.332820 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53165331-f77b-4372-aae9-dad029afcb20 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:24.365372 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:24.370445 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09da04-0a1c-462c-aab3-e87831c4a597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:24.371236 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09da04-0a1c-462c-aab3-e87831c4a597 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:24.371518 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09da04-0a1c-462c-aab3-e87831c4a597 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:24.371778 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09da04-0a1c-462c-aab3-e87831c4a597 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:24.372545 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09da04-0a1c-462c-aab3-e87831c4a597 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:01:24.373000 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09da04-0a1c-462c-aab3-e87831c4a597 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:24.374381 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09da04-0a1c-462c-aab3-e87831c4a597 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:24.384369 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 633/1250] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 04:01:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:01:24.390499 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da008fa8-a937-454b-b177-ba9593ed4c1f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:24.475808 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:24.505982 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da008fa8-a937-454b-b177-ba9593ed4c1f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:24.551361 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91488165-8fe8-4e19-80c9-f256db62e79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:24.552274 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91488165-8fe8-4e19-80c9-f256db62e79c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:24.552611 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91488165-8fe8-4e19-80c9-f256db62e79c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:24.553033 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91488165-8fe8-4e19-80c9-f256db62e79c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:24.566859 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91488165-8fe8-4e19-80c9-f256db62e79c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:24.568969 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91488165-8fe8-4e19-80c9-f256db62e79c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:24.587514 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-91488165-8fe8-4e19-80c9-f256db62e79c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 04:01:24.587514 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 04:01:24.587514 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 04:01:24.587514 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 04:01:24.587514 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 04:01:24.587514 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 04:01:24.587514 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 04:01:24.587514 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 04:01:24.587514 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 04:01:24.587514 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 04:01:24.587514 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 04:01:24.587514 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 04:01:24.587514 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 04:01:24.587514 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 04:01:24.587514 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 04:01:24.588586 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 04:01:24.588586 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 04:01:24.588586 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 04:01:24.588586 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 04:01:24.588586 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 04:01:24.588586 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 04:01:24.588586 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 04:01:24.588586 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 04:01:24.588586 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 04:01:24.588586 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 04:01:24.588586 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 04:01:24.588586 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 04:01:24.588586 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 04:01:24.588586 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 04:01:24.588586 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 04:01:24.588586 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 04:01:24.588586 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 04:01:24.594748 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 04:01:24.594748 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 04:01:24.594748 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 04:01:24.594748 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 04:01:24.594748 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 618/1251] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 04:01:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 04:01:24.595090 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09da04-0a1c-462c-aab3-e87831c4a597 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:24.703829 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09da04-0a1c-462c-aab3-e87831c4a597 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:24.742827 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73787db4-1092-48dd-88c5-d6255ad1b30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:24.743466 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73787db4-1092-48dd-88c5-d6255ad1b30e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:24.743849 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73787db4-1092-48dd-88c5-d6255ad1b30e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:24.744136 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73787db4-1092-48dd-88c5-d6255ad1b30e None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:24.745160 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73787db4-1092-48dd-88c5-d6255ad1b30e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:01:24.745538 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73787db4-1092-48dd-88c5-d6255ad1b30e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:24.747298 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73787db4-1092-48dd-88c5-d6255ad1b30e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:24.761711 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 634/1252] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 04:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:01:24.768028 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91488165-8fe8-4e19-80c9-f256db62e79c None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:24.881466 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91488165-8fe8-4e19-80c9-f256db62e79c None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:24.910687 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:24.920084 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158dbc2c-e5dc-4cac-b86c-88510d9631ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:24.920901 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158dbc2c-e5dc-4cac-b86c-88510d9631ee None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:24.921187 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158dbc2c-e5dc-4cac-b86c-88510d9631ee None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:24.921464 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158dbc2c-e5dc-4cac-b86c-88510d9631ee None admin] PATH_INFO: `/v3/users/placement` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:24.930960 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158dbc2c-e5dc-4cac-b86c-88510d9631ee None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:24.932739 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158dbc2c-e5dc-4cac-b86c-88510d9631ee None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:24.949323 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-158dbc2c-e5dc-4cac-b86c-88510d9631ee None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 04 04:01:24.949323 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 04:01:24.949323 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 04:01:24.949323 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 04:01:24.949323 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 04:01:24.949323 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 04:01:24.949323 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 04:01:24.949323 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 04:01:24.949323 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 04:01:24.949323 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 04:01:24.949323 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 04:01:24.949323 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 04:01:24.949323 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 04:01:24.949323 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 04:01:24.949323 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 04:01:24.949323 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 04:01:24.950559 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 04:01:24.950559 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 04:01:24.950559 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 04:01:24.950559 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 04:01:24.950559 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 04:01:24.950559 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 04:01:24.950559 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 04:01:24.950559 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 04:01:24.950559 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 04:01:24.950559 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 04:01:24.950559 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 04:01:24.950559 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 04:01:24.950559 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 04:01:24.950559 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 04:01:24.950559 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 04:01:24.950559 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 04:01:24.950559 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 04:01:24.950559 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 04:01:24.956998 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 04:01:24.956998 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 04:01:24.956998 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 04:01:24.956998 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 04:01:24.956998 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 04:01:24.956998 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 04:01:24.956998 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 04:01:24.956998 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 04:01:24.956998 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 04 04:01:24.956998 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 04:01:24.956998 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 619/1253] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 04:01:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 04:01:24.957651 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73787db4-1092-48dd-88c5-d6255ad1b30e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:25.019728 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:25.074419 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73787db4-1092-48dd-88c5-d6255ad1b30e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:25.113264 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b76c0c-3e12-454d-9812-8953bd28aa71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:25.114017 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b76c0c-3e12-454d-9812-8953bd28aa71 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:25.114344 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b76c0c-3e12-454d-9812-8953bd28aa71 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:25.114694 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b76c0c-3e12-454d-9812-8953bd28aa71 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:25.115840 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b76c0c-3e12-454d-9812-8953bd28aa71 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:01:25.116256 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b76c0c-3e12-454d-9812-8953bd28aa71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:25.118259 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b76c0c-3e12-454d-9812-8953bd28aa71 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:25.140349 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 635/1254] 10.222.0.49 () {56 vars in 1143 bytes} [Mon Jul 4 04:01:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:01:25.146287 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158dbc2c-e5dc-4cac-b86c-88510d9631ee None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:25.250933 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158dbc2c-e5dc-4cac-b86c-88510d9631ee None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:25.294084 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a4f90-bbf5-4708-aaea-7e62f2fcbc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:25.294730 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a4f90-bbf5-4708-aaea-7e62f2fcbc66 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:25.295012 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a4f90-bbf5-4708-aaea-7e62f2fcbc66 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:25.295287 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a4f90-bbf5-4708-aaea-7e62f2fcbc66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:25.353995 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:25.371638 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a4f90-bbf5-4708-aaea-7e62f2fcbc66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:25.373218 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a4f90-bbf5-4708-aaea-7e62f2fcbc66 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:25.476570 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 620/1255] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 04:01:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 04:01:25.483697 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b76c0c-3e12-454d-9812-8953bd28aa71 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:25.604974 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b76c0c-3e12-454d-9812-8953bd28aa71 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:25.619620 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:25.642569 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456dd52-cc43-4dd3-a5d8-666ea3bf0d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:25.643394 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456dd52-cc43-4dd3-a5d8-666ea3bf0d3a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:25.643684 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456dd52-cc43-4dd3-a5d8-666ea3bf0d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:25.643967 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456dd52-cc43-4dd3-a5d8-666ea3bf0d3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:25.654897 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d456dd52-cc43-4dd3-a5d8-666ea3bf0d3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:25.656358 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d456dd52-cc43-4dd3-a5d8-666ea3bf0d3a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:25.674467 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-d456dd52-cc43-4dd3-a5d8-666ea3bf0d3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 04:01:25.674467 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 04:01:25.674467 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 04:01:25.674467 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 04:01:25.674467 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 04:01:25.674467 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 04:01:25.674467 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 04:01:25.674467 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 04:01:25.674467 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 04:01:25.674467 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 04:01:25.674467 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 04:01:25.674467 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 04:01:25.674467 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 04:01:25.674467 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 04:01:25.674467 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 04:01:25.675532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 04:01:25.675532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 04:01:25.675532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 04:01:25.675532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 04:01:25.675532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 04:01:25.675532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 04:01:25.675532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 04:01:25.675532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 04:01:25.675532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 04:01:25.675532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 04:01:25.675532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 04:01:25.675532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 04:01:25.675532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 04:01:25.675532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 04:01:25.675532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 04:01:25.675532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 04:01:25.675532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 04:01:25.676523 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 04:01:25.676523 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 04:01:25.676523 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 04:01:25.676523 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 04:01:25.676523 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 636/1256] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 04:01:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 04:01:25.682464 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a4f90-bbf5-4708-aaea-7e62f2fcbc66 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:25.788443 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:25.803828 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a4f90-bbf5-4708-aaea-7e62f2fcbc66 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:25.842066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41786548-dacc-4cac-969f-773aeb821356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:25.843045 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41786548-dacc-4cac-969f-773aeb821356 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:25.843329 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41786548-dacc-4cac-969f-773aeb821356 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:25.843608 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41786548-dacc-4cac-969f-773aeb821356 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:25.844334 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41786548-dacc-4cac-969f-773aeb821356 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:01:25.844644 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41786548-dacc-4cac-969f-773aeb821356 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:25.846039 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41786548-dacc-4cac-969f-773aeb821356 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:25.858919 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 621/1257] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 04:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:01:25.864526 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456dd52-cc43-4dd3-a5d8-666ea3bf0d3a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:25.969238 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456dd52-cc43-4dd3-a5d8-666ea3bf0d3a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:26.007505 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59407c64-682a-4838-849e-6de173f1113a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:26.008307 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59407c64-682a-4838-849e-6de173f1113a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:26.008598 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59407c64-682a-4838-849e-6de173f1113a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:26.008876 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59407c64-682a-4838-849e-6de173f1113a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:26.016471 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59407c64-682a-4838-849e-6de173f1113a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:26.017976 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59407c64-682a-4838-849e-6de173f1113a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:26.032524 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-59407c64-682a-4838-849e-6de173f1113a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 04:01:26.032524 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 04:01:26.032524 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 04:01:26.032524 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 04:01:26.032524 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 04:01:26.032524 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 04:01:26.032524 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 04:01:26.032524 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 04:01:26.032524 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 04:01:26.032524 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 04:01:26.032524 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 04:01:26.032524 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 04:01:26.032524 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 04:01:26.032524 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 04:01:26.032524 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 04:01:26.033467 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 04:01:26.033467 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 04:01:26.033467 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 04:01:26.033467 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 04:01:26.033467 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 04:01:26.033467 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 04:01:26.033467 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 04:01:26.033467 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 04:01:26.033467 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 04:01:26.033467 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 04:01:26.033467 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 04:01:26.033467 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 04:01:26.033467 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 04:01:26.033467 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 04:01:26.033467 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 04:01:26.033467 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 04:01:26.033467 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 04:01:26.034530 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 04:01:26.034530 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 04:01:26.034530 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 04:01:26.034530 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 04:01:26.034530 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 04:01:26.034530 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 04:01:26.034530 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 04:01:26.034530 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 04:01:26.034530 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 637/1258] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 04:01:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 04:01:26.039799 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41786548-dacc-4cac-969f-773aeb821356 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:26.145312 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41786548-dacc-4cac-969f-773aeb821356 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:26.183011 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222d838-219f-48f1-9756-6a6bf8d40b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:26.183714 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222d838-219f-48f1-9756-6a6bf8d40b34 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:26.184026 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222d838-219f-48f1-9756-6a6bf8d40b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:26.184289 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222d838-219f-48f1-9756-6a6bf8d40b34 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:26.185085 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222d838-219f-48f1-9756-6a6bf8d40b34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:01:26.185523 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222d838-219f-48f1-9756-6a6bf8d40b34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:26.187000 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222d838-219f-48f1-9756-6a6bf8d40b34 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:26.200873 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 622/1259] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Jul 4 04:01:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:01:26.207031 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59407c64-682a-4838-849e-6de173f1113a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:26.234199 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:26.312457 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59407c64-682a-4838-849e-6de173f1113a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:26.347460 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e01c6-1ec3-4c72-b44d-1107c66b893f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:26.348121 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e01c6-1ec3-4c72-b44d-1107c66b893f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:26.348406 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e01c6-1ec3-4c72-b44d-1107c66b893f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:26.348682 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e01c6-1ec3-4c72-b44d-1107c66b893f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:26.349518 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e01c6-1ec3-4c72-b44d-1107c66b893f None admin] RBAC: Adding query filter params (role.id=2eee98054d42475bb7e22a8487ab235e, scope.project.id=424a145a22434ef7a14b6108e6118ccb, user.id=c2a18591461343c3a0a1b0e317734ba3) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:01:26.349834 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e01c6-1ec3-4c72-b44d-1107c66b893f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:26.351320 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e01c6-1ec3-4c72-b44d-1107c66b893f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:26.356849 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 638/1260] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 04:01:26 2022] GET /identity/v3/role_assignments?user.id=c2a18591461343c3a0a1b0e317734ba3&scope.project.id=424a145a22434ef7a14b6108e6118ccb&role.id=2eee98054d42475bb7e22a8487ab235e => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:01:28.372057 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f863bcd-1ed6-4901-90e9-0007cb06300c None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:28.372634 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f863bcd-1ed6-4901-90e9-0007cb06300c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:28.372634 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f863bcd-1ed6-4901-90e9-0007cb06300c None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:28.373971 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 623/1261] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:01:28.382090 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ab018-fcb5-4a12-aee5-5e64949688e9 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:28.382851 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ab018-fcb5-4a12-aee5-5e64949688e9 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:28.383015 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ab018-fcb5-4a12-aee5-5e64949688e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:28.408985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-9b9ab018-fcb5-4a12-aee5-5e64949688e9 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:01:28.410192 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9b9ab018-fcb5-4a12-aee5-5e64949688e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:01:28.479455 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 639/1262] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:01:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 04:01:28.502588 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f863bcd-1ed6-4901-90e9-0007cb06300c None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:28.517951 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:28.626235 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f863bcd-1ed6-4901-90e9-0007cb06300c None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:28.661779 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb79cd3d-60e2-43d7-9721-39acb06488c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:28.662608 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79cd3d-60e2-43d7-9721-39acb06488c4 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:28.662891 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79cd3d-60e2-43d7-9721-39acb06488c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:28.663170 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79cd3d-60e2-43d7-9721-39acb06488c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:28.673850 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb79cd3d-60e2-43d7-9721-39acb06488c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 04:01:28.681423 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-fb79cd3d-60e2-43d7-9721-39acb06488c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 04:01:28.681423 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 04:01:28.681423 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 04:01:28.681423 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 04:01:28.681423 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 04:01:28.681423 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 04:01:28.681423 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 04:01:28.681423 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 04:01:28.681423 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 04:01:28.681423 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 04:01:28.681423 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 04:01:28.681423 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 04:01:28.681423 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 04:01:28.681423 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 04:01:28.681423 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 04:01:28.681423 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 04:01:28.682518 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 04:01:28.682518 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 04:01:28.682518 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 04:01:28.682518 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 04:01:28.682518 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 04:01:28.682518 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 04:01:28.682518 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 04:01:28.682518 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 04:01:28.682518 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 04:01:28.682518 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 04:01:28.682518 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 04:01:28.682518 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 04:01:28.682518 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 04:01:28.682518 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 04:01:28.682518 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 04:01:28.682518 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 04:01:28.683559 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 04:01:28.683559 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 04:01:28.683559 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 04:01:28.683559 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 04:01:28.683559 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 04:01:28.683559 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 04:01:28.683559 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 04:01:28.683559 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 04:01:28.683559 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 04:01:28.683559 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 04:01:28.683559 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 04:01:28.683559 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 04:01:28.686345 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 624/1263] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Jul 4 04:01:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 04:01:28.689865 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ab018-fcb5-4a12-aee5-5e64949688e9 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:28.712658 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:28.802486 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ab018-fcb5-4a12-aee5-5e64949688e9 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:28.837760 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668cac2-1064-4b3b-95e6-afcfdad6aad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:28.838439 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668cac2-1064-4b3b-95e6-afcfdad6aad0 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:28.838721 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668cac2-1064-4b3b-95e6-afcfdad6aad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:28.838995 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668cac2-1064-4b3b-95e6-afcfdad6aad0 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:28.839747 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668cac2-1064-4b3b-95e6-afcfdad6aad0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:01:28.840050 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668cac2-1064-4b3b-95e6-afcfdad6aad0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:28.841591 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668cac2-1064-4b3b-95e6-afcfdad6aad0 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:28.849691 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 640/1264] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 04:01:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:01:28.856135 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb79cd3d-60e2-43d7-9721-39acb06488c4 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:28.937317 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:28.982708 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb79cd3d-60e2-43d7-9721-39acb06488c4 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:29.019074 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0374d7-afff-44ac-bcf7-4d231c47608e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:29.019868 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0374d7-afff-44ac-bcf7-4d231c47608e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:29.020154 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0374d7-afff-44ac-bcf7-4d231c47608e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:29.020436 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0374d7-afff-44ac-bcf7-4d231c47608e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:29.031541 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0374d7-afff-44ac-bcf7-4d231c47608e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:29.033011 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0374d7-afff-44ac-bcf7-4d231c47608e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:29.051235 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-3f0374d7-afff-44ac-bcf7-4d231c47608e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 04:01:29.051235 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 04:01:29.051235 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 04:01:29.051235 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 04:01:29.051235 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 04:01:29.051235 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 04:01:29.051235 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 04:01:29.051235 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 04:01:29.051235 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 04:01:29.051235 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 04:01:29.051235 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 04:01:29.051235 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 04:01:29.051235 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 04:01:29.051235 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 04:01:29.051235 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 04:01:29.052244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 04:01:29.052244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 04:01:29.052244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 04:01:29.052244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 04:01:29.052244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 04:01:29.052244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 04:01:29.052244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 04:01:29.052244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 04:01:29.052244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 04:01:29.052244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 04:01:29.052244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 04:01:29.052244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 04:01:29.052244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 04:01:29.052244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 04:01:29.052244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 04:01:29.052244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 04:01:29.052244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 04:01:29.053306 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 04:01:29.053306 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 04:01:29.053306 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 04:01:29.053306 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 04:01:29.053306 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 625/1265] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 04:01:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 04:01:29.058561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668cac2-1064-4b3b-95e6-afcfdad6aad0 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:29.144332 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:29.165083 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668cac2-1064-4b3b-95e6-afcfdad6aad0 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:29.200151 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7d2b7-a2e3-4f03-bb65-4bd16e6ab4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:29.200768 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7d2b7-a2e3-4f03-bb65-4bd16e6ab4da None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:29.201056 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7d2b7-a2e3-4f03-bb65-4bd16e6ab4da None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:29.201342 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7d2b7-a2e3-4f03-bb65-4bd16e6ab4da None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:29.202071 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a7d2b7-a2e3-4f03-bb65-4bd16e6ab4da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:01:29.202417 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a7d2b7-a2e3-4f03-bb65-4bd16e6ab4da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:29.203819 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a7d2b7-a2e3-4f03-bb65-4bd16e6ab4da None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:29.215700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 641/1266] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 04:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:01:29.221994 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0374d7-afff-44ac-bcf7-4d231c47608e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:29.331336 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0374d7-afff-44ac-bcf7-4d231c47608e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:29.351237 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:29.369588 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b6448-ef67-4777-9994-5405979556bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:29.370426 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b6448-ef67-4777-9994-5405979556bb None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:29.370708 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b6448-ef67-4777-9994-5405979556bb None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:29.370986 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b6448-ef67-4777-9994-5405979556bb None admin] PATH_INFO: `/v3/users/placement` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:29.380013 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b6448-ef67-4777-9994-5405979556bb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:29.381804 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b6448-ef67-4777-9994-5405979556bb None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:29.396535 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-c42b6448-ef67-4777-9994-5405979556bb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 04 04:01:29.396535 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 04:01:29.396535 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 04:01:29.396535 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 04:01:29.396535 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 04:01:29.396535 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 04:01:29.396535 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 04:01:29.396535 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 04:01:29.396535 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 04:01:29.396535 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 04:01:29.396535 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 04:01:29.396535 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 04:01:29.396535 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 04:01:29.396535 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 04:01:29.396535 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 04:01:29.396535 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 04:01:29.397682 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 04:01:29.397682 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 04:01:29.397682 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 04:01:29.397682 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 04:01:29.397682 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 04:01:29.397682 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 04:01:29.397682 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 04:01:29.397682 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 04:01:29.397682 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 04:01:29.397682 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 04:01:29.397682 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 04:01:29.397682 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 04:01:29.397682 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 04:01:29.397682 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 04:01:29.397682 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 04:01:29.397682 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 04:01:29.397682 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 04:01:29.397682 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 04:01:29.398912 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 04:01:29.398912 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 04:01:29.398912 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 04:01:29.398912 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 04:01:29.398912 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 04:01:29.398912 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 04:01:29.398912 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 04:01:29.398912 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 04:01:29.398912 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 04 04:01:29.398912 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 04:01:29.398912 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 626/1267] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 04:01:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 04:01:29.405380 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7d2b7-a2e3-4f03-bb65-4bd16e6ab4da None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:29.511629 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7d2b7-a2e3-4f03-bb65-4bd16e6ab4da None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:29.550310 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51317e26-1b6f-42ae-b32b-561fd19173fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:29.551171 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51317e26-1b6f-42ae-b32b-561fd19173fb None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:29.551518 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51317e26-1b6f-42ae-b32b-561fd19173fb None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:29.551923 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51317e26-1b6f-42ae-b32b-561fd19173fb None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:29.552889 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51317e26-1b6f-42ae-b32b-561fd19173fb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:01:29.553260 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51317e26-1b6f-42ae-b32b-561fd19173fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:29.555073 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51317e26-1b6f-42ae-b32b-561fd19173fb None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:29.567022 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:29.577681 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 642/1268] 10.222.0.49 () {56 vars in 1143 bytes} [Mon Jul 4 04:01:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:01:29.583432 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b6448-ef67-4777-9994-5405979556bb None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:29.695181 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b6448-ef67-4777-9994-5405979556bb None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:29.740058 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f059a7-2c6e-49ad-afdb-04c12822348c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:29.741333 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f059a7-2c6e-49ad-afdb-04c12822348c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:29.741767 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f059a7-2c6e-49ad-afdb-04c12822348c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:29.742242 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f059a7-2c6e-49ad-afdb-04c12822348c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:29.755244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f059a7-2c6e-49ad-afdb-04c12822348c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:29.757036 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f059a7-2c6e-49ad-afdb-04c12822348c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:29.774182 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-78f059a7-2c6e-49ad-afdb-04c12822348c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 04:01:29.774182 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 04:01:29.774182 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 04:01:29.774182 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 04:01:29.774182 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 04:01:29.774182 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 04:01:29.774182 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 04:01:29.774182 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 04:01:29.774182 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 04:01:29.774182 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 04:01:29.774182 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 04:01:29.774182 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 04:01:29.774182 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 04:01:29.774182 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 04:01:29.774182 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 04:01:29.775244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 04:01:29.775244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 04:01:29.775244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 04:01:29.775244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 04:01:29.775244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 04:01:29.775244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 04:01:29.775244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 04:01:29.775244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 04:01:29.775244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 04:01:29.775244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 04:01:29.775244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 04:01:29.775244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 04:01:29.775244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 04:01:29.775244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 04:01:29.775244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 04:01:29.775244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 04:01:29.775244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 04:01:29.776341 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 04:01:29.776341 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 04:01:29.776341 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 04:01:29.776341 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 04:01:29.776341 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 627/1269] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 04:01:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 04:01:29.781044 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51317e26-1b6f-42ae-b32b-561fd19173fb None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:29.886604 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51317e26-1b6f-42ae-b32b-561fd19173fb None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:29.921524 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efedf832-93f0-44f8-8cfe-63caa55a5213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:29.922211 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efedf832-93f0-44f8-8cfe-63caa55a5213 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:29.922482 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efedf832-93f0-44f8-8cfe-63caa55a5213 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:29.922763 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efedf832-93f0-44f8-8cfe-63caa55a5213 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:29.923489 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efedf832-93f0-44f8-8cfe-63caa55a5213 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:01:29.923802 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efedf832-93f0-44f8-8cfe-63caa55a5213 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:29.925190 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efedf832-93f0-44f8-8cfe-63caa55a5213 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:29.936558 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 643/1270] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 04:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:01:29.942443 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f059a7-2c6e-49ad-afdb-04c12822348c None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:29.981601 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:30.062213 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f059a7-2c6e-49ad-afdb-04c12822348c None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:30.097595 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f954af-0b48-4f38-8f71-e81da5e4eec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:30.098411 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f954af-0b48-4f38-8f71-e81da5e4eec7 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:30.098695 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f954af-0b48-4f38-8f71-e81da5e4eec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:30.098975 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f954af-0b48-4f38-8f71-e81da5e4eec7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:30.107148 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f954af-0b48-4f38-8f71-e81da5e4eec7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:30.109458 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f954af-0b48-4f38-8f71-e81da5e4eec7 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:30.133976 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-94f954af-0b48-4f38-8f71-e81da5e4eec7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 04:01:30.133976 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 04:01:30.133976 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 04:01:30.133976 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 04:01:30.133976 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 04:01:30.133976 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 04:01:30.133976 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 04:01:30.133976 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 04:01:30.133976 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 04:01:30.133976 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 04:01:30.133976 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 04:01:30.133976 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 04:01:30.133976 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 04:01:30.133976 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 04:01:30.133976 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 04:01:30.135040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 04:01:30.135040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 04:01:30.135040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 04:01:30.135040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 04:01:30.135040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 04:01:30.135040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 04:01:30.135040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 04:01:30.135040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 04:01:30.135040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 04:01:30.135040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 04:01:30.135040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 04:01:30.135040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 04:01:30.135040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 04:01:30.135040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 04:01:30.135040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 04:01:30.135040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 04:01:30.135040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 04:01:30.135968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 04:01:30.135968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 04:01:30.135968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 04:01:30.135968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 04:01:30.135968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 04:01:30.135968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 04:01:30.135968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 04:01:30.135968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 04:01:30.135968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 628/1271] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 04:01:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 04:01:30.141867 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efedf832-93f0-44f8-8cfe-63caa55a5213 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:30.213526 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:30.262566 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efedf832-93f0-44f8-8cfe-63caa55a5213 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:30.301559 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f58b42-c419-4683-873d-577817d5b55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:30.302206 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f58b42-c419-4683-873d-577817d5b55b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:30.302524 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f58b42-c419-4683-873d-577817d5b55b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:30.302805 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f58b42-c419-4683-873d-577817d5b55b None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:30.303597 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f58b42-c419-4683-873d-577817d5b55b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:01:30.303915 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f58b42-c419-4683-873d-577817d5b55b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:30.305383 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f58b42-c419-4683-873d-577817d5b55b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:30.317601 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 644/1272] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Jul 4 04:01:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:01:30.324015 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f954af-0b48-4f38-8f71-e81da5e4eec7 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:30.425757 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:30.435614 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f954af-0b48-4f38-8f71-e81da5e4eec7 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:30.471338 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862be3fe-17b6-4215-a73c-619bcb7acdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:30.472227 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862be3fe-17b6-4215-a73c-619bcb7acdb3 None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:30.472515 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862be3fe-17b6-4215-a73c-619bcb7acdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:30.472799 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862be3fe-17b6-4215-a73c-619bcb7acdb3 None admin] PATH_INFO: `/v3/projects/424a145a22434ef7a14b6108e6118ccb/users/c2a18591461343c3a0a1b0e317734ba3/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:30.475051 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862be3fe-17b6-4215-a73c-619bcb7acdb3 None admin] RBAC: Authorizing `identity:create_grant(project_id=424a145a22434ef7a14b6108e6118ccb, user_id=c2a18591461343c3a0a1b0e317734ba3, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:30.476512 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862be3fe-17b6-4215-a73c-619bcb7acdb3 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:30.492181 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 629/1273] 10.222.0.49 () {58 vars in 1439 bytes} [Mon Jul 4 04:01:30 2022] PUT /identity/v3/projects/424a145a22434ef7a14b6108e6118ccb/users/c2a18591461343c3a0a1b0e317734ba3/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:01:32.477544 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c0d2a-0342-4475-9db1-270d4b3a1093 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:32.478096 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c0d2a-0342-4475-9db1-270d4b3a1093 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:32.478096 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c0d2a-0342-4475-9db1-270d4b3a1093 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:32.479544 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 645/1274] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:01:32.485898 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f436d8-0c2b-413a-a940-cb024975eddc None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:32.486703 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f436d8-0c2b-413a-a940-cb024975eddc None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:32.486834 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f436d8-0c2b-413a-a940-cb024975eddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:32.515008 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-f3f436d8-0c2b-413a-a940-cb024975eddc None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:01:32.516211 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f3f436d8-0c2b-413a-a940-cb024975eddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:01:32.587344 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 630/1275] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:01:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 04:01:32.611772 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c0d2a-0342-4475-9db1-270d4b3a1093 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:32.722401 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c0d2a-0342-4475-9db1-270d4b3a1093 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:32.740673 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:32.766444 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1279e6-22a5-42b1-96af-e710ec6188e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:32.767237 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1279e6-22a5-42b1-96af-e710ec6188e1 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:32.767519 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1279e6-22a5-42b1-96af-e710ec6188e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:32.767798 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1279e6-22a5-42b1-96af-e710ec6188e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:32.781427 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1279e6-22a5-42b1-96af-e710ec6188e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 04 04:01:32.789506 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-5b1279e6-22a5-42b1-96af-e710ec6188e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 04:01:32.789506 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 04:01:32.789506 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 04:01:32.789506 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 04:01:32.789506 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 04:01:32.789506 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 04:01:32.789506 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 04:01:32.789506 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 04:01:32.789506 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 04:01:32.789506 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 04:01:32.789506 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 04:01:32.789506 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 04:01:32.789506 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 04 04:01:32.789506 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 04 04:01:32.789506 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 04 04:01:32.789506 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 04 04:01:32.790666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 04 04:01:32.790666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 04 04:01:32.790666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 04 04:01:32.790666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 04 04:01:32.790666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 04:01:32.790666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 04:01:32.790666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 04:01:32.790666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 04:01:32.790666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 04:01:32.790666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 04:01:32.790666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 04:01:32.790666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 04:01:32.790666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 04:01:32.790666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 04:01:32.790666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 04:01:32.790666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 04:01:32.791787 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 04:01:32.791787 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 04:01:32.791787 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 04:01:32.791787 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 04:01:32.791787 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 04 04:01:32.791787 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 04 04:01:32.791787 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 04 04:01:32.791787 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 04 04:01:32.791787 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 04 04:01:32.791787 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 04 04:01:32.791787 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 04 04:01:32.791787 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 04:01:32.791787 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 646/1276] 10.222.0.49 () {56 vars in 1096 bytes} [Mon Jul 4 04:01:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 04:01:32.797173 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f436d8-0c2b-413a-a940-cb024975eddc None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:32.880798 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:32.901576 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f436d8-0c2b-413a-a940-cb024975eddc None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:32.937178 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f858b4-a565-4a43-a43d-b3ed50f22e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:32.937863 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f858b4-a565-4a43-a43d-b3ed50f22e0d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:32.938120 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f858b4-a565-4a43-a43d-b3ed50f22e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:32.938425 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f858b4-a565-4a43-a43d-b3ed50f22e0d None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:32.939178 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f858b4-a565-4a43-a43d-b3ed50f22e0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:01:32.939485 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f858b4-a565-4a43-a43d-b3ed50f22e0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:32.940878 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f858b4-a565-4a43-a43d-b3ed50f22e0d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:32.949640 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 631/1277] 10.222.0.49 () {56 vars in 1099 bytes} [Mon Jul 4 04:01:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 04:01:32.956127 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1279e6-22a5-42b1-96af-e710ec6188e1 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:33.062819 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1279e6-22a5-42b1-96af-e710ec6188e1 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:33.099554 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62135b78-80ba-43aa-b73d-be20b98dffd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:33.100733 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62135b78-80ba-43aa-b73d-be20b98dffd0 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:33.101100 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62135b78-80ba-43aa-b73d-be20b98dffd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:33.101462 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62135b78-80ba-43aa-b73d-be20b98dffd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:33.115072 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62135b78-80ba-43aa-b73d-be20b98dffd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:33.116598 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62135b78-80ba-43aa-b73d-be20b98dffd0 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:33.134993 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-62135b78-80ba-43aa-b73d-be20b98dffd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 04:01:33.134993 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 04:01:33.134993 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 04:01:33.134993 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 04:01:33.134993 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 04:01:33.134993 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 04:01:33.134993 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 04:01:33.134993 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 04:01:33.134993 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 04:01:33.134993 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 04:01:33.134993 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 04:01:33.134993 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 04:01:33.134993 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 04:01:33.134993 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 04:01:33.134993 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 04:01:33.136124 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 04:01:33.136124 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 04:01:33.136124 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 04:01:33.136124 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 04:01:33.136124 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 04:01:33.136124 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 04:01:33.136124 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 04:01:33.136124 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 04:01:33.136124 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 04:01:33.136124 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 04:01:33.136124 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 04:01:33.136124 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 04:01:33.136124 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 04:01:33.136124 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 04:01:33.136124 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 04:01:33.136124 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 04:01:33.136124 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 04:01:33.141211 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 04:01:33.141211 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 04:01:33.141211 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 04:01:33.141211 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 04:01:33.141211 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 647/1278] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 04:01:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 04:01:33.142061 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f858b4-a565-4a43-a43d-b3ed50f22e0d None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:33.256156 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f858b4-a565-4a43-a43d-b3ed50f22e0d None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:33.291000 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c514af-7d02-4820-ba4a-cb6a784402e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:33.291660 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c514af-7d02-4820-ba4a-cb6a784402e0 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:33.291946 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c514af-7d02-4820-ba4a-cb6a784402e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:33.292227 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c514af-7d02-4820-ba4a-cb6a784402e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:33.292955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c514af-7d02-4820-ba4a-cb6a784402e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:01:33.293267 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c514af-7d02-4820-ba4a-cb6a784402e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:33.294773 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c514af-7d02-4820-ba4a-cb6a784402e0 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:33.306680 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 632/1279] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 04:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:01:33.312657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62135b78-80ba-43aa-b73d-be20b98dffd0 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:33.345730 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:33.418998 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62135b78-80ba-43aa-b73d-be20b98dffd0 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:33.459039 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea0046-d50b-43d6-9620-d3fa6887b357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:33.459823 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea0046-d50b-43d6-9620-d3fa6887b357 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:33.460107 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea0046-d50b-43d6-9620-d3fa6887b357 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:33.460393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea0046-d50b-43d6-9620-d3fa6887b357 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:33.468878 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea0046-d50b-43d6-9620-d3fa6887b357 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:33.470375 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea0046-d50b-43d6-9620-d3fa6887b357 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:33.485469 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-7dea0046-d50b-43d6-9620-d3fa6887b357 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 04 04:01:33.485469 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 04:01:33.485469 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 04:01:33.485469 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 04:01:33.485469 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 04:01:33.485469 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 04:01:33.485469 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 04:01:33.485469 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 04:01:33.485469 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 04:01:33.485469 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 04:01:33.485469 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 04:01:33.485469 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 04:01:33.485469 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 04 04:01:33.485469 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 04 04:01:33.485469 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 04 04:01:33.485469 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 04 04:01:33.486951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 04:01:33.486951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 04:01:33.486951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 04 04:01:33.486951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 04:01:33.486951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 04 04:01:33.486951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 04 04:01:33.486951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 04:01:33.486951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 04:01:33.486951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 04:01:33.486951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 04:01:33.486951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 04:01:33.486951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 04:01:33.486951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 04:01:33.486951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 04:01:33.486951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 04:01:33.486951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 04:01:33.486951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 04:01:33.486951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 04:01:33.488013 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 04:01:33.488013 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 04:01:33.488013 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 04 04:01:33.488013 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 04 04:01:33.488013 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 04 04:01:33.488013 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 04 04:01:33.488013 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 04 04:01:33.488013 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 04 04:01:33.488013 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 04 04:01:33.488013 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 04:01:33.488013 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 648/1280] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 04:01:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 04:01:33.494086 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c514af-7d02-4820-ba4a-cb6a784402e0 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:33.499418 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:33.606917 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c514af-7d02-4820-ba4a-cb6a784402e0 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:33.643003 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a71381-0eda-462a-81cb-8222bac035f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:33.643672 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a71381-0eda-462a-81cb-8222bac035f9 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:33.643962 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a71381-0eda-462a-81cb-8222bac035f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:33.644242 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a71381-0eda-462a-81cb-8222bac035f9 None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:33.645087 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a71381-0eda-462a-81cb-8222bac035f9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:01:33.645403 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a71381-0eda-462a-81cb-8222bac035f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:33.646912 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a71381-0eda-462a-81cb-8222bac035f9 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:33.665168 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 633/1281] 10.222.0.49 () {56 vars in 1143 bytes} [Mon Jul 4 04:01:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:01:33.674623 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea0046-d50b-43d6-9620-d3fa6887b357 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:33.783064 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:33.795030 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea0046-d50b-43d6-9620-d3fa6887b357 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:33.842427 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea006a54-2c16-41c0-bd51-836c43d9939c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:33.843077 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea006a54-2c16-41c0-bd51-836c43d9939c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:33.843328 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea006a54-2c16-41c0-bd51-836c43d9939c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:33.843652 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea006a54-2c16-41c0-bd51-836c43d9939c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:33.912680 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea006a54-2c16-41c0-bd51-836c43d9939c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:33.914188 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea006a54-2c16-41c0-bd51-836c43d9939c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:34.012738 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:34.024408 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 649/1282] 10.222.0.49 () {58 vars in 1282 bytes} [Mon Jul 4 04:01:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 04 04:01:34.033863 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a71381-0eda-462a-81cb-8222bac035f9 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:34.104125 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:34.144942 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a71381-0eda-462a-81cb-8222bac035f9 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:34.180507 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb0eca-1fdf-43cc-94e3-46f0f14f48aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:34.181228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb0eca-1fdf-43cc-94e3-46f0f14f48aa None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:34.181520 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb0eca-1fdf-43cc-94e3-46f0f14f48aa None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:34.181794 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb0eca-1fdf-43cc-94e3-46f0f14f48aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:34.192192 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb0eca-1fdf-43cc-94e3-46f0f14f48aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:34.193669 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb0eca-1fdf-43cc-94e3-46f0f14f48aa None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:34.211326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-d9cb0eca-1fdf-43cc-94e3-46f0f14f48aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 04:01:34.211326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 04:01:34.211326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 04:01:34.211326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 04:01:34.211326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 04:01:34.211326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 04:01:34.211326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 04:01:34.211326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 04:01:34.211326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 04:01:34.211326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 04:01:34.211326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 04:01:34.211326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 04:01:34.211326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 04 04:01:34.211326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 04 04:01:34.211326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 04 04:01:34.212350 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 04 04:01:34.212350 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 04:01:34.212350 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 04:01:34.212350 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 04:01:34.212350 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 04:01:34.212350 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 04:01:34.212350 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 04:01:34.212350 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 04:01:34.212350 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 04:01:34.212350 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 04:01:34.212350 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 04:01:34.212350 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 04:01:34.212350 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 04:01:34.212350 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 04:01:34.212350 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 04:01:34.212350 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 04:01:34.212350 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 04:01:34.213356 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 04 04:01:34.213356 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 04 04:01:34.213356 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 04 04:01:34.213356 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 04:01:34.213356 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 634/1283] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 04:01:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 04:01:34.219041 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea006a54-2c16-41c0-bd51-836c43d9939c None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:34.334924 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea006a54-2c16-41c0-bd51-836c43d9939c None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:34.370558 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db30c9-006d-47c5-b6be-c9fc831397dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:34.371199 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db30c9-006d-47c5-b6be-c9fc831397dc None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:34.371482 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db30c9-006d-47c5-b6be-c9fc831397dc None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:34.371760 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db30c9-006d-47c5-b6be-c9fc831397dc None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:34.372560 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db30c9-006d-47c5-b6be-c9fc831397dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:01:34.372873 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db30c9-006d-47c5-b6be-c9fc831397dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:34.374263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db30c9-006d-47c5-b6be-c9fc831397dc None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:34.385673 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 650/1284] 10.222.0.49 () {56 vars in 1109 bytes} [Mon Jul 4 04:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:01:34.391388 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb0eca-1fdf-43cc-94e3-46f0f14f48aa None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:34.496631 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb0eca-1fdf-43cc-94e3-46f0f14f48aa None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:34.510917 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:34.546375 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178fc001-feca-4830-b447-8a7318b36d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:34.547229 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178fc001-feca-4830-b447-8a7318b36d5f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:34.547475 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178fc001-feca-4830-b447-8a7318b36d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:34.547796 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178fc001-feca-4830-b447-8a7318b36d5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:34.555691 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178fc001-feca-4830-b447-8a7318b36d5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:34.557430 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178fc001-feca-4830-b447-8a7318b36d5f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:34.572296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-178fc001-feca-4830-b447-8a7318b36d5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 04:01:34.572296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 04:01:34.572296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 04:01:34.572296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 04:01:34.572296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 04:01:34.572296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 04:01:34.572296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 04:01:34.572296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 04:01:34.572296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 04:01:34.572296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 04:01:34.572296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 04:01:34.572296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 04:01:34.572296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 04 04:01:34.572296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 04 04:01:34.572296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 04 04:01:34.573320 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 04 04:01:34.573320 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 04:01:34.573320 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 04:01:34.573320 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 04:01:34.573320 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 04:01:34.573320 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 04:01:34.573320 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 04:01:34.573320 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 04:01:34.573320 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 04 04:01:34.573320 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 04:01:34.573320 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 04 04:01:34.573320 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 04:01:34.573320 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 04:01:34.573320 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 04:01:34.573320 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 04 04:01:34.573320 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 04:01:34.573320 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 04 04:01:34.574561 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 04 04:01:34.574561 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 04 04:01:34.574561 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 04 04:01:34.574561 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 04 04:01:34.574561 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 04 04:01:34.574561 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 04 04:01:34.574561 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 04 04:01:34.574561 dv-cinder-742162-5-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 04 04:01:34.574561 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 635/1285] 10.222.0.49 () {56 vars in 1111 bytes} [Mon Jul 4 04:01:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 04:01:34.579666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db30c9-006d-47c5-b6be-c9fc831397dc None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:34.632258 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:34.686773 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db30c9-006d-47c5-b6be-c9fc831397dc None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:34.734667 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e079ed5-e44b-4e59-8879-a87c50122e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:34.735320 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e079ed5-e44b-4e59-8879-a87c50122e5b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:34.735606 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e079ed5-e44b-4e59-8879-a87c50122e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:34.735886 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e079ed5-e44b-4e59-8879-a87c50122e5b None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:34.736683 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e079ed5-e44b-4e59-8879-a87c50122e5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:01:34.737002 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e079ed5-e44b-4e59-8879-a87c50122e5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:34.738471 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e079ed5-e44b-4e59-8879-a87c50122e5b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:34.751192 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 651/1286] 10.222.0.49 () {56 vars in 1148 bytes} [Mon Jul 4 04:01:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:01:34.760940 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178fc001-feca-4830-b447-8a7318b36d5f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:34.868387 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178fc001-feca-4830-b447-8a7318b36d5f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:34.903794 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3b84f-de53-41c5-8c80-4a50bcb9f8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:34.904442 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3b84f-de53-41c5-8c80-4a50bcb9f8db None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:34.904728 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3b84f-de53-41c5-8c80-4a50bcb9f8db None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:34.904965 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3b84f-de53-41c5-8c80-4a50bcb9f8db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:34.905836 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee3b84f-de53-41c5-8c80-4a50bcb9f8db None admin] RBAC: Adding query filter params (role.id=2eee98054d42475bb7e22a8487ab235e, scope.project.id=424a145a22434ef7a14b6108e6118ccb, user.id=c2a18591461343c3a0a1b0e317734ba3) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:01:34.906188 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee3b84f-de53-41c5-8c80-4a50bcb9f8db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:34.907645 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee3b84f-de53-41c5-8c80-4a50bcb9f8db None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:34.913671 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 636/1287] 10.222.0.49 () {56 vars in 1374 bytes} [Mon Jul 4 04:01:34 2022] GET /identity/v3/role_assignments?user.id=c2a18591461343c3a0a1b0e317734ba3&scope.project.id=424a145a22434ef7a14b6108e6118ccb&role.id=2eee98054d42475bb7e22a8487ab235e => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:01:36.943720 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e599b-0be3-4708-bf0d-489d900f1fa4 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:36.944759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e599b-0be3-4708-bf0d-489d900f1fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:36.944759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e599b-0be3-4708-bf0d-489d900f1fa4 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:36.946919 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 652/1288] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:01:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:01:36.953283 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248017d8-0def-4546-a5f6-ac1fcb5418dc None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:36.953746 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248017d8-0def-4546-a5f6-ac1fcb5418dc None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:36.953849 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248017d8-0def-4546-a5f6-ac1fcb5418dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:36.979290 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-248017d8-0def-4546-a5f6-ac1fcb5418dc None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:01:36.981103 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-248017d8-0def-4546-a5f6-ac1fcb5418dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:01:37.013696 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:37.053546 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 637/1289] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:01:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 04:01:37.076344 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e599b-0be3-4708-bf0d-489d900f1fa4 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:37.192966 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e599b-0be3-4708-bf0d-489d900f1fa4 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:37.204058 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:37.230374 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec07c1-f91a-4b2f-9b44-ca0d945b2e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:37.231156 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec07c1-f91a-4b2f-9b44-ca0d945b2e00 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:37.231471 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec07c1-f91a-4b2f-9b44-ca0d945b2e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:37.231750 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec07c1-f91a-4b2f-9b44-ca0d945b2e00 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:37.232411 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec07c1-f91a-4b2f-9b44-ca0d945b2e00 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:37.233800 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec07c1-f91a-4b2f-9b44-ca0d945b2e00 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:37.245849 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-f5ec07c1-f91a-4b2f-9b44-ca0d945b2e00 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 04:01:37.245849 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 04:01:37.245849 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 04:01:37.245849 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 04:01:37.245849 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 04:01:37.245849 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 04:01:37.245849 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 04:01:37.245849 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 04:01:37.245849 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 04:01:37.245849 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 04:01:37.245849 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 04:01:37.245849 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 04:01:37.245849 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 04:01:37.245849 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 04:01:37.245849 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 04:01:37.245849 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 04:01:37.245849 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 04:01:37.247152 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 04:01:37.247152 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 04:01:37.247152 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 04:01:37.247152 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 04:01:37.247152 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 04:01:37.247152 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 04:01:37.247152 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 04:01:37.247152 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 04:01:37.247152 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 04:01:37.247152 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 04:01:37.247152 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 04:01:37.247152 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 04:01:37.247152 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 04:01:37.247152 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 04:01:37.247152 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 04:01:37.247152 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 04:01:37.248272 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 04:01:37.248272 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 04:01:37.248272 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 04:01:37.248272 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 04:01:37.248272 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 04:01:37.248272 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 04:01:37.248272 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 04:01:37.248272 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 04:01:37.248272 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 04:01:37.248272 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 04:01:37.248272 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 04:01:37.248272 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 04:01:37.248272 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 04:01:37.248272 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 04:01:37.248272 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 653/1290] 10.222.0.49 () {56 vars in 1117 bytes} [Mon Jul 4 04:01:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 04 04:01:37.258592 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248017d8-0def-4546-a5f6-ac1fcb5418dc None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:37.367937 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248017d8-0def-4546-a5f6-ac1fcb5418dc None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:37.404455 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44e730-8679-4766-b7dc-e22407f2a42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:37.405120 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44e730-8679-4766-b7dc-e22407f2a42d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:37.405406 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44e730-8679-4766-b7dc-e22407f2a42d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:37.405687 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44e730-8679-4766-b7dc-e22407f2a42d None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:37.406428 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44e730-8679-4766-b7dc-e22407f2a42d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:01:37.406744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44e730-8679-4766-b7dc-e22407f2a42d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:37.408144 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44e730-8679-4766-b7dc-e22407f2a42d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:37.413056 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 638/1291] 10.222.0.49 () {56 vars in 1116 bytes} [Mon Jul 4 04:01:37 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:01:37.421421 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec07c1-f91a-4b2f-9b44-ca0d945b2e00 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:37.532213 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec07c1-f91a-4b2f-9b44-ca0d945b2e00 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:37.571841 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf2d9f-2317-469f-a93b-b65a3915876c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:37.572577 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf2d9f-2317-469f-a93b-b65a3915876c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:37.572862 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf2d9f-2317-469f-a93b-b65a3915876c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:37.573180 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf2d9f-2317-469f-a93b-b65a3915876c None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:37.573983 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf2d9f-2317-469f-a93b-b65a3915876c None admin] RBAC: Adding query filter params (type=placement) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:01:37.574373 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf2d9f-2317-469f-a93b-b65a3915876c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:37.576030 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf2d9f-2317-469f-a93b-b65a3915876c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:37.581261 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 654/1292] 10.222.0.49 () {56 vars in 1116 bytes} [Mon Jul 4 04:01:37 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 04:01:39.567598 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2c014-5fec-4fdf-b53f-3f420ad2ea0a None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:39.568178 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2c014-5fec-4fdf-b53f-3f420ad2ea0a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:39.568178 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2c014-5fec-4fdf-b53f-3f420ad2ea0a None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:39.570399 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 639/1293] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:01:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:01:39.575803 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebe118-bb8b-49da-a544-48749c27da27 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:39.576265 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebe118-bb8b-49da-a544-48749c27da27 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:39.576363 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebe118-bb8b-49da-a544-48749c27da27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:39.594609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-93ebe118-bb8b-49da-a544-48749c27da27 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:01:39.595791 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-93ebe118-bb8b-49da-a544-48749c27da27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:01:39.628147 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:39.667406 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 655/1294] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:01:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 04:01:39.691021 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2c014-5fec-4fdf-b53f-3f420ad2ea0a None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:39.735719 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:39.820678 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2c014-5fec-4fdf-b53f-3f420ad2ea0a None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:39.856542 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbffab35-76bc-4625-b0b6-684307dbfc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:39.857245 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffab35-76bc-4625-b0b6-684307dbfc07 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:39.857531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffab35-76bc-4625-b0b6-684307dbfc07 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:39.857814 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffab35-76bc-4625-b0b6-684307dbfc07 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:39.858582 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbffab35-76bc-4625-b0b6-684307dbfc07 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:39.859983 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbffab35-76bc-4625-b0b6-684307dbfc07 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:39.878758 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 640/1295] 10.222.0.49 () {60 vars in 1141 bytes} [Mon Jul 4 04:01:39 2022] POST /identity/v3/services => generated 246 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:01:41.924659 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322b793-f7c3-4636-9a0d-dc200c48c06f None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:41.925267 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322b793-f7c3-4636-9a0d-dc200c48c06f None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:41.925267 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322b793-f7c3-4636-9a0d-dc200c48c06f None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:41.926676 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 656/1296] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:01:41.933159 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f11ae-b4aa-4811-857d-3ea58884ad19 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:41.933930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f11ae-b4aa-4811-857d-3ea58884ad19 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:41.934108 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f11ae-b4aa-4811-857d-3ea58884ad19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:41.953648 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-da4f11ae-b4aa-4811-857d-3ea58884ad19 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:01:41.954871 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-da4f11ae-b4aa-4811-857d-3ea58884ad19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:01:42.040442 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 641/1297] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:01:41 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 04:01:42.065135 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322b793-f7c3-4636-9a0d-dc200c48c06f None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:42.179127 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322b793-f7c3-4636-9a0d-dc200c48c06f None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:42.215164 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b05310-6ed8-4890-a8ca-f6c958aae140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:42.215974 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b05310-6ed8-4890-a8ca-f6c958aae140 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:42.216259 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b05310-6ed8-4890-a8ca-f6c958aae140 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:42.216536 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b05310-6ed8-4890-a8ca-f6c958aae140 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:42.217192 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b05310-6ed8-4890-a8ca-f6c958aae140 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:42.218630 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b05310-6ed8-4890-a8ca-f6c958aae140 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:42.230807 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-b4b05310-6ed8-4890-a8ca-f6c958aae140 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 04:01:42.230807 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 04:01:42.230807 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 04:01:42.230807 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 04:01:42.230807 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 04:01:42.230807 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 04:01:42.230807 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 04:01:42.230807 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 04:01:42.230807 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 04:01:42.230807 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 04:01:42.230807 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 04:01:42.230807 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 04:01:42.230807 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 04:01:42.230807 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 04:01:42.230807 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 04:01:42.230807 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 04:01:42.230807 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 04:01:42.232022 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 04:01:42.232022 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 04:01:42.232022 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 04:01:42.232022 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 04:01:42.232022 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 04:01:42.232022 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 04:01:42.232022 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 04:01:42.232022 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 04:01:42.232022 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 04:01:42.232022 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 04:01:42.232022 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 04:01:42.232022 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 04:01:42.232022 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 04:01:42.232022 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 04:01:42.232022 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 04:01:42.232022 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 04:01:42.233293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 04:01:42.233293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 04:01:42.233293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 04:01:42.233293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 04:01:42.233293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 04:01:42.233293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 04:01:42.233293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 04:01:42.233293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 04:01:42.233293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 04:01:42.233293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 04:01:42.233293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 04:01:42.233293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 04:01:42.233293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 04:01:42.233293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 04:01:42.233293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 657/1298] 10.222.0.49 () {56 vars in 1117 bytes} [Mon Jul 4 04:01:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 04:01:42.241113 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f11ae-b4aa-4811-857d-3ea58884ad19 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:42.267663 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:42.362037 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f11ae-b4aa-4811-857d-3ea58884ad19 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:42.398194 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b52322-6182-4475-b34f-97340c6039bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:42.398874 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b52322-6182-4475-b34f-97340c6039bd None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:42.399168 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b52322-6182-4475-b34f-97340c6039bd None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:42.399450 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b52322-6182-4475-b34f-97340c6039bd None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:42.400162 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b52322-6182-4475-b34f-97340c6039bd None admin] RBAC: Adding query filter params (name=placement) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:01:42.400476 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b52322-6182-4475-b34f-97340c6039bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:42.401880 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b52322-6182-4475-b34f-97340c6039bd None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:42.407273 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 642/1299] 10.222.0.49 () {56 vars in 1116 bytes} [Mon Jul 4 04:01:42 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:01:42.416087 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b05310-6ed8-4890-a8ca-f6c958aae140 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:42.456526 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:42.540923 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b05310-6ed8-4890-a8ca-f6c958aae140 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:42.582339 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1605562-e360-472a-bb1e-a1361ca45372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:42.583158 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1605562-e360-472a-bb1e-a1361ca45372 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:42.583466 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1605562-e360-472a-bb1e-a1361ca45372 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:42.583888 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1605562-e360-472a-bb1e-a1361ca45372 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:42.584837 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1605562-e360-472a-bb1e-a1361ca45372 None admin] RBAC: Adding query filter params (interface=public, service_id=d0c80cd7ba4c446686e2800a69412e33, region_id=RegionOne) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:01:42.585157 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1605562-e360-472a-bb1e-a1361ca45372 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:42.586918 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1605562-e360-472a-bb1e-a1361ca45372 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:42.593656 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 658/1300] 10.222.0.49 () {56 vars in 1251 bytes} [Mon Jul 4 04:01:42 2022] GET /identity/v3/endpoints?service_id=d0c80cd7ba4c446686e2800a69412e33&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:01:42.599721 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b52322-6182-4475-b34f-97340c6039bd None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:42.686308 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:42.705522 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b52322-6182-4475-b34f-97340c6039bd None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:42.741431 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0081432-12c8-49fb-b554-995a7a71f576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:42.742017 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0081432-12c8-49fb-b554-995a7a71f576 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:42.742412 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0081432-12c8-49fb-b554-995a7a71f576 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:42.742687 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0081432-12c8-49fb-b554-995a7a71f576 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:42.743403 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0081432-12c8-49fb-b554-995a7a71f576 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:42.744798 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0081432-12c8-49fb-b554-995a7a71f576 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:42.751824 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 643/1301] 10.222.0.49 () {56 vars in 1087 bytes} [Mon Jul 4 04:01:42 2022] GET /identity/v3/services => generated 2191 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:01:44.756983 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f1455-8d33-4c93-8c8a-c4ab84005111 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:44.757570 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f1455-8d33-4c93-8c8a-c4ab84005111 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:44.757570 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f1455-8d33-4c93-8c8a-c4ab84005111 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:44.759826 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 659/1302] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:01:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:01:44.768572 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b21c9-93dd-4583-b2cb-d94ac3096251 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:44.768986 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b21c9-93dd-4583-b2cb-d94ac3096251 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:44.769193 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b21c9-93dd-4583-b2cb-d94ac3096251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:44.789947 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-b49b21c9-93dd-4583-b2cb-d94ac3096251 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:01:44.791219 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b49b21c9-93dd-4583-b2cb-d94ac3096251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:01:44.863134 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 644/1303] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:01:44 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 04 04:01:44.887449 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f1455-8d33-4c93-8c8a-c4ab84005111 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:44.995740 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:45.003405 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f1455-8d33-4c93-8c8a-c4ab84005111 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:45.040259 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215d7e7-5dbc-4f11-8d4c-e9aa797f224e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:45.040997 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215d7e7-5dbc-4f11-8d4c-e9aa797f224e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:45.041285 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215d7e7-5dbc-4f11-8d4c-e9aa797f224e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:45.041556 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215d7e7-5dbc-4f11-8d4c-e9aa797f224e None admin] PATH_INFO: `/v3/services/placement` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:45.042247 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6215d7e7-5dbc-4f11-8d4c-e9aa797f224e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:45.043695 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6215d7e7-5dbc-4f11-8d4c-e9aa797f224e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:45.055868 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-6215d7e7-5dbc-4f11-8d4c-e9aa797f224e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 04:01:45.055868 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 04:01:45.055868 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 04 04:01:45.055868 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 04 04:01:45.055868 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 04 04:01:45.055868 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 04 04:01:45.055868 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 04 04:01:45.055868 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 04:01:45.055868 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 04:01:45.055868 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 04:01:45.055868 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 04 04:01:45.055868 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 04:01:45.055868 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 04 04:01:45.055868 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 04 04:01:45.055868 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 04 04:01:45.055868 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 04 04:01:45.055868 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 04 04:01:45.057029 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 04 04:01:45.057029 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 04 04:01:45.057029 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 04 04:01:45.057029 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 04 04:01:45.057029 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 04 04:01:45.057029 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 04 04:01:45.057029 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 04 04:01:45.057029 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 04 04:01:45.057029 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 04 04:01:45.057029 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 04 04:01:45.057029 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 04 04:01:45.057029 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 04 04:01:45.057029 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 04 04:01:45.057029 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 04 04:01:45.057029 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 04 04:01:45.057029 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 04 04:01:45.057910 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 04 04:01:45.057910 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 04 04:01:45.057910 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 04 04:01:45.057910 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 04 04:01:45.057910 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 04 04:01:45.057910 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 04 04:01:45.057910 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 04 04:01:45.057910 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 04 04:01:45.057910 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 04 04:01:45.057910 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 04 04:01:45.057910 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 04 04:01:45.057910 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 04 04:01:45.057910 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 04 04:01:45.057910 dv-cinder-742162-5-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 04 04:01:45.057910 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 660/1304] 10.222.0.49 () {56 vars in 1117 bytes} [Mon Jul 4 04:01:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 04 04:01:45.064066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b21c9-93dd-4583-b2cb-d94ac3096251 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:45.143157 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:45.167411 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b21c9-93dd-4583-b2cb-d94ac3096251 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:45.202366 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3fd8a-0169-4da5-9797-1043629058ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:45.203032 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3fd8a-0169-4da5-9797-1043629058ef None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:45.203314 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3fd8a-0169-4da5-9797-1043629058ef None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:45.203596 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3fd8a-0169-4da5-9797-1043629058ef None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:45.204305 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3fd8a-0169-4da5-9797-1043629058ef None admin] RBAC: Adding query filter params (name=placement) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:01:45.204623 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3fd8a-0169-4da5-9797-1043629058ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:45.206012 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3fd8a-0169-4da5-9797-1043629058ef None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:45.211382 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 645/1305] 10.222.0.49 () {56 vars in 1116 bytes} [Mon Jul 4 04:01:45 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:01:45.217607 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215d7e7-5dbc-4f11-8d4c-e9aa797f224e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:01:45.324036 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215d7e7-5dbc-4f11-8d4c-e9aa797f224e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:01:45.358574 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c81379-cabf-4717-af93-40fa7cc3204d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:01:45.359244 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c81379-cabf-4717-af93-40fa7cc3204d None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:01:45.359559 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c81379-cabf-4717-af93-40fa7cc3204d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:01:45.359837 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c81379-cabf-4717-af93-40fa7cc3204d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:01:45.360617 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c81379-cabf-4717-af93-40fa7cc3204d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:01:45.362033 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c81379-cabf-4717-af93-40fa7cc3204d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:01:45.384440 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 661/1306] 10.222.0.49 () {60 vars in 1144 bytes} [Mon Jul 4 04:01:45 2022] POST /identity/v3/endpoints => generated 331 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:01:55.208121 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=30 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:01:55.379981 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:02:47.623750 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf063e-9ed0-4954-b4d2-cc935a68ec56 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:02:47.624348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf063e-9ed0-4954-b4d2-cc935a68ec56 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:02:47.624645 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf063e-9ed0-4954-b4d2-cc935a68ec56 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:02:47.626463 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 646/1307] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:02:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:02:47.631647 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b6456-7ee8-495e-9dfa-e3b1aa389f0b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:02:47.632098 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b6456-7ee8-495e-9dfa-e3b1aa389f0b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:02:47.632196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b6456-7ee8-495e-9dfa-e3b1aa389f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:02:47.791137 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-a08b6456-7ee8-495e-9dfa-e3b1aa389f0b None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:02:47.792386 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a08b6456-7ee8-495e-9dfa-e3b1aa389f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:02:48.001554 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 662/1308] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:02:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:02:48.053989 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d67ee6-109a-4874-879f-6a8d3b4b1ad5 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:02:48.054422 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d67ee6-109a-4874-879f-6a8d3b4b1ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:02:48.054857 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d67ee6-109a-4874-879f-6a8d3b4b1ad5 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:02:48.056668 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 647/1309] 10.222.0.49 () {54 vars in 964 bytes} [Mon Jul 4 04:02:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:02:48.067107 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a8952-8a25-489f-b1f6-a35ad3058830 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:02:48.067742 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a8952-8a25-489f-b1f6-a35ad3058830 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:02:48.068129 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a8952-8a25-489f-b1f6-a35ad3058830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:02:48.228288 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-792a8952-8a25-489f-b1f6-a35ad3058830 None None] MFA Rules not processed for user `b36a8402144c458fa98f80d7e3516127`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:02:48.229609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-792a8952-8a25-489f-b1f6-a35ad3058830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:02:48.258338 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:02:48.331233 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 663/1310] 10.222.0.49 () {58 vars in 1061 bytes} [Mon Jul 4 04:02:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:02:48.339752 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d67ee6-109a-4874-879f-6a8d3b4b1ad5 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:02:48.341541 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-80d67ee6-109a-4874-879f-6a8d3b4b1ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:02:48.458549 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d67ee6-109a-4874-879f-6a8d3b4b1ad5 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:02:48.540395 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2816e86-818e-428e-8e8b-7879a982e5ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:02:48.541230 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2816e86-818e-428e-8e8b-7879a982e5ca service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:02:48.541766 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2816e86-818e-428e-8e8b-7879a982e5ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:02:48.542177 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2816e86-818e-428e-8e8b-7879a982e5ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:02:48.544063 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e2816e86-818e-428e-8e8b-7879a982e5ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:02:48.602978 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:02:48.668302 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2816e86-818e-428e-8e8b-7879a982e5ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:02:48.669946 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2816e86-818e-428e-8e8b-7879a982e5ca service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:02:48.690473 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 648/1311] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:02:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:02:51.013632 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74890748-6cdb-4912-aa47-7084a61aae01 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:02:51.014237 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74890748-6cdb-4912-aa47-7084a61aae01 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:02:51.014237 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74890748-6cdb-4912-aa47-7084a61aae01 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:02:51.016064 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 664/1312] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:02:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:02:51.021312 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3c956-56b8-466a-b142-94cc7b634d9b None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:02:51.021762 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3c956-56b8-466a-b142-94cc7b634d9b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:02:51.021853 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3c956-56b8-466a-b142-94cc7b634d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:02:51.095434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-d4b3c956-56b8-466a-b142-94cc7b634d9b None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:02:51.096650 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d4b3c956-56b8-466a-b142-94cc7b634d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:02:51.197353 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 649/1313] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:02:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:02:51.247412 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0560c-7a9e-4bb4-889d-13fa94e77c7a None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:02:51.247704 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0560c-7a9e-4bb4-889d-13fa94e77c7a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:02:51.247986 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0560c-7a9e-4bb4-889d-13fa94e77c7a None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:02:51.249393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 665/1314] 10.222.0.49 () {54 vars in 964 bytes} [Mon Jul 4 04:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:02:51.255547 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde024a-c4bd-469d-b75d-116dbac1936a None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:02:51.255851 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde024a-c4bd-469d-b75d-116dbac1936a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:02:51.256141 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde024a-c4bd-469d-b75d-116dbac1936a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:02:51.267406 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:02:51.343717 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-abde024a-c4bd-469d-b75d-116dbac1936a None None] MFA Rules not processed for user `b36a8402144c458fa98f80d7e3516127`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:02:51.344959 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-abde024a-c4bd-469d-b75d-116dbac1936a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:02:51.428212 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 650/1315] 10.222.0.49 () {58 vars in 1061 bytes} [Mon Jul 4 04:02:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:02:51.437383 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0560c-7a9e-4bb4-889d-13fa94e77c7a None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:02:51.438947 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9ad0560c-7a9e-4bb4-889d-13fa94e77c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:02:51.545784 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0560c-7a9e-4bb4-889d-13fa94e77c7a None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:02:51.620534 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:02:51.623369 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6097949-dbe6-4e55-9641-19ab2ccb6947 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:02:51.624083 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6097949-dbe6-4e55-9641-19ab2ccb6947 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:02:51.624656 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6097949-dbe6-4e55-9641-19ab2ccb6947 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:02:51.624939 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6097949-dbe6-4e55-9641-19ab2ccb6947 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:02:51.627431 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b6097949-dbe6-4e55-9641-19ab2ccb6947 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:02:51.739610 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6097949-dbe6-4e55-9641-19ab2ccb6947 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:02:51.741062 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6097949-dbe6-4e55-9641-19ab2ccb6947 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:02:51.759610 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 666/1316] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:02:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 04:02:54.295186 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d52424-76aa-4ecf-b1f5-2ee18f704384 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:02:54.296010 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d52424-76aa-4ecf-b1f5-2ee18f704384 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:02:54.296010 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d52424-76aa-4ecf-b1f5-2ee18f704384 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:02:54.298215 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 651/1317] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:02:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:02:54.303704 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca7e9a-8aff-411c-8d25-209cca696157 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:02:54.304133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca7e9a-8aff-411c-8d25-209cca696157 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:02:54.304289 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca7e9a-8aff-411c-8d25-209cca696157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:02:54.381152 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-acca7e9a-8aff-411c-8d25-209cca696157 None None] MFA Rules not processed for user `3c37bbe571ec415c9de778d6219de1a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:02:54.383144 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-acca7e9a-8aff-411c-8d25-209cca696157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:02:54.437226 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:02:54.485221 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 667/1318] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:02:54 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:02:54.527022 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d52424-76aa-4ecf-b1f5-2ee18f704384 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:02:54.529537 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c6d52424-76aa-4ecf-b1f5-2ee18f704384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:02:54.659697 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d52424-76aa-4ecf-b1f5-2ee18f704384 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:02:54.662626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:02:54.737536 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8a434-ffbe-4a99-b677-b7dc4863c596 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:02:54.738187 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8a434-ffbe-4a99-b677-b7dc4863c596 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:02:54.738488 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8a434-ffbe-4a99-b677-b7dc4863c596 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:02:54.738761 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8a434-ffbe-4a99-b677-b7dc4863c596 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:02:54.740417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-96b8a434-ffbe-4a99-b677-b7dc4863c596 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:02:54.857832 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8a434-ffbe-4a99-b677-b7dc4863c596 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:02:54.859337 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8a434-ffbe-4a99-b677-b7dc4863c596 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:02:54.878640 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 652/1319] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:02:54 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:02:57.476015 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7c8ef-7193-4402-9ed5-f8fc75a2e70e None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:02:57.476862 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7c8ef-7193-4402-9ed5-f8fc75a2e70e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:02:57.476862 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7c8ef-7193-4402-9ed5-f8fc75a2e70e None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:02:57.479100 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 668/1320] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:02:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:02:57.487315 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacadca-2ea0-4c96-940e-96a0392fb2aa None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:02:57.487783 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacadca-2ea0-4c96-940e-96a0392fb2aa None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:02:57.487878 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacadca-2ea0-4c96-940e-96a0392fb2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:02:57.529526 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:02:57.555667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-fbacadca-2ea0-4c96-940e-96a0392fb2aa None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:02:57.556880 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-fbacadca-2ea0-4c96-940e-96a0392fb2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:02:57.667074 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 653/1321] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:02:57 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:02:57.704978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7c8ef-7193-4402-9ed5-f8fc75a2e70e None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:02:57.706549 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-10f7c8ef-7193-4402-9ed5-f8fc75a2e70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:02:57.820668 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7c8ef-7193-4402-9ed5-f8fc75a2e70e None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:02:57.896857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d05b7-d40f-42e4-ab2a-ac4b817c9b05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:02:57.897499 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d05b7-d40f-42e4-ab2a-ac4b817c9b05 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:02:57.897783 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d05b7-d40f-42e4-ab2a-ac4b817c9b05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:02:57.898085 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d05b7-d40f-42e4-ab2a-ac4b817c9b05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:02:57.899749 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f86d05b7-d40f-42e4-ab2a-ac4b817c9b05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:02:57.907591 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:02:58.020629 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d05b7-d40f-42e4-ab2a-ac4b817c9b05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:02:58.022094 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d05b7-d40f-42e4-ab2a-ac4b817c9b05 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:02:58.041297 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 669/1322] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:02:57 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:03:01.002179 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9789147-f5aa-4806-a449-cfcf715bf7c0 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:01.002695 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9789147-f5aa-4806-a449-cfcf715bf7c0 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:01.002788 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9789147-f5aa-4806-a449-cfcf715bf7c0 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:01.004204 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 654/1323] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:03:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:03:01.009789 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9349f84-364f-46d0-9d54-fb26de1a3c92 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:01.010234 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9349f84-364f-46d0-9d54-fb26de1a3c92 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:01.010419 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9349f84-364f-46d0-9d54-fb26de1a3c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:01.079875 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-c9349f84-364f-46d0-9d54-fb26de1a3c92 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:03:01.081120 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c9349f84-364f-46d0-9d54-fb26de1a3c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:03:01.146917 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:03:01.192195 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 670/1324] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:03:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:03:01.228379 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9789147-f5aa-4806-a449-cfcf715bf7c0 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:03:01.229941 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a9789147-f5aa-4806-a449-cfcf715bf7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:03:01.341893 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9789147-f5aa-4806-a449-cfcf715bf7c0 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:03:01.354604 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:03:01.418425 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca890f3-495f-4730-829d-3b1d46918ce9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:03:01.419080 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca890f3-495f-4730-829d-3b1d46918ce9 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:01.419364 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca890f3-495f-4730-829d-3b1d46918ce9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:01.419650 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca890f3-495f-4730-829d-3b1d46918ce9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:01.421347 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4ca890f3-495f-4730-829d-3b1d46918ce9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:03:01.538508 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca890f3-495f-4730-829d-3b1d46918ce9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:03:01.540137 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca890f3-495f-4730-829d-3b1d46918ce9 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:03:01.559829 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 655/1325] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:03:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:03:03.636833 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e587c-ddb0-48f6-b30c-60f500e60e46 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:03.637392 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e587c-ddb0-48f6-b30c-60f500e60e46 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:03.637392 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e587c-ddb0-48f6-b30c-60f500e60e46 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:03.638732 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 671/1326] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:03:03.644102 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caddab1c-7e66-4f90-8015-c93e09d026bd None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:03.644526 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caddab1c-7e66-4f90-8015-c93e09d026bd None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:03.644685 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caddab1c-7e66-4f90-8015-c93e09d026bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:03.693390 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:03:03.712538 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-caddab1c-7e66-4f90-8015-c93e09d026bd None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:03:03.713760 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-caddab1c-7e66-4f90-8015-c93e09d026bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:03:03.816802 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 656/1327] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:03:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:03:03.852127 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e587c-ddb0-48f6-b30c-60f500e60e46 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:03:03.853667 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-941e587c-ddb0-48f6-b30c-60f500e60e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:03:03.967704 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e587c-ddb0-48f6-b30c-60f500e60e46 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:03:04.044542 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd7241-1faf-4ad6-98f3-8df8a1bbaf12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:03:04.045192 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd7241-1faf-4ad6-98f3-8df8a1bbaf12 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:04.045477 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd7241-1faf-4ad6-98f3-8df8a1bbaf12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:04.045754 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd7241-1faf-4ad6-98f3-8df8a1bbaf12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:04.047421 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-8bbd7241-1faf-4ad6-98f3-8df8a1bbaf12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:03:04.064047 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:03:04.167025 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd7241-1faf-4ad6-98f3-8df8a1bbaf12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:03:04.168503 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd7241-1faf-4ad6-98f3-8df8a1bbaf12 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:03:04.189002 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 672/1328] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:03:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:03:06.244173 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789c111-bf33-44a1-85dd-02d9ba7609e3 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:06.244647 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789c111-bf33-44a1-85dd-02d9ba7609e3 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:06.244762 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789c111-bf33-44a1-85dd-02d9ba7609e3 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:06.246126 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 657/1329] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:03:06.252077 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fd35d-2a26-489d-8b30-daa89b36e791 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:06.252551 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fd35d-2a26-489d-8b30-daa89b36e791 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:06.252673 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fd35d-2a26-489d-8b30-daa89b36e791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:06.326423 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ef9fd35d-2a26-489d-8b30-daa89b36e791 None None] MFA Rules not processed for user `3c37bbe571ec415c9de778d6219de1a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:03:06.327683 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ef9fd35d-2a26-489d-8b30-daa89b36e791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:03:06.397480 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:03:06.432132 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 673/1330] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:03:06 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:03:06.469955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789c111-bf33-44a1-85dd-02d9ba7609e3 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:03:06.471514 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d789c111-bf33-44a1-85dd-02d9ba7609e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:03:06.584110 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789c111-bf33-44a1-85dd-02d9ba7609e3 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:03:06.605392 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:03:06.681113 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8135936-c4be-42e8-9b66-322215177910 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:03:06.681887 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8135936-c4be-42e8-9b66-322215177910 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:06.682307 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8135936-c4be-42e8-9b66-322215177910 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:06.682582 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8135936-c4be-42e8-9b66-322215177910 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:06.686190 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a8135936-c4be-42e8-9b66-322215177910 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:03:06.804039 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8135936-c4be-42e8-9b66-322215177910 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:03:06.805508 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8135936-c4be-42e8-9b66-322215177910 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:03:06.823335 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 658/1331] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:03:06 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:03:09.062787 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223e191-20bc-4f27-9cc4-4bf151930350 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:09.063399 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223e191-20bc-4f27-9cc4-4bf151930350 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:09.063399 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223e191-20bc-4f27-9cc4-4bf151930350 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:09.064725 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 674/1332] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:03:09.071145 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c9f46-e783-4e06-9c97-7351f7b8f4d8 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:09.071895 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c9f46-e783-4e06-9c97-7351f7b8f4d8 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:09.072062 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c9f46-e783-4e06-9c97-7351f7b8f4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:09.155828 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:03:09.159293 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-a87c9f46-e783-4e06-9c97-7351f7b8f4d8 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:03:09.161321 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a87c9f46-e783-4e06-9c97-7351f7b8f4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:03:09.279973 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 659/1333] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:03:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:03:09.315811 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223e191-20bc-4f27-9cc4-4bf151930350 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:03:09.318443 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d223e191-20bc-4f27-9cc4-4bf151930350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:03:09.431405 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223e191-20bc-4f27-9cc4-4bf151930350 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:03:09.507989 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51b2b3-3dff-4ef7-a10f-68ce9e439376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:03:09.508642 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51b2b3-3dff-4ef7-a10f-68ce9e439376 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:09.508938 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51b2b3-3dff-4ef7-a10f-68ce9e439376 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:09.509217 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51b2b3-3dff-4ef7-a10f-68ce9e439376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:09.510920 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-db51b2b3-3dff-4ef7-a10f-68ce9e439376 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:03:09.538963 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:03:09.631131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51b2b3-3dff-4ef7-a10f-68ce9e439376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:03:09.632613 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51b2b3-3dff-4ef7-a10f-68ce9e439376 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:03:09.651298 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 675/1334] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:03:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:03:11.706600 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7efdf3-5c34-4c16-85d8-6e65ae464e01 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:11.707380 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7efdf3-5c34-4c16-85d8-6e65ae464e01 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:11.707541 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7efdf3-5c34-4c16-85d8-6e65ae464e01 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:11.709678 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 660/1335] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:03:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:03:11.715987 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d294aa8-7124-48d1-b0fd-b85d034afcef None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:11.716522 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d294aa8-7124-48d1-b0fd-b85d034afcef None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:11.716613 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d294aa8-7124-48d1-b0fd-b85d034afcef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:11.793475 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-7d294aa8-7124-48d1-b0fd-b85d034afcef None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:03:11.794756 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7d294aa8-7124-48d1-b0fd-b85d034afcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:03:11.885875 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:03:11.910049 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 676/1336] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:03:11.952274 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7efdf3-5c34-4c16-85d8-6e65ae464e01 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:03:11.953829 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5a7efdf3-5c34-4c16-85d8-6e65ae464e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:03:12.066804 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7efdf3-5c34-4c16-85d8-6e65ae464e01 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:03:12.095833 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:03:12.145903 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f959866-badd-4556-9ac9-1e2479c9d59b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:03:12.146935 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f959866-badd-4556-9ac9-1e2479c9d59b service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:12.147341 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f959866-badd-4556-9ac9-1e2479c9d59b service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:12.147770 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f959866-badd-4556-9ac9-1e2479c9d59b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:12.150522 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1f959866-badd-4556-9ac9-1e2479c9d59b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:03:12.275789 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f959866-badd-4556-9ac9-1e2479c9d59b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:03:12.277181 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f959866-badd-4556-9ac9-1e2479c9d59b service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:03:12.297317 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 661/1337] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:03:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:03:14.738281 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b6a09-da18-4e22-bb17-8ec533ef9481 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:14.738841 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b6a09-da18-4e22-bb17-8ec533ef9481 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:14.738841 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b6a09-da18-4e22-bb17-8ec533ef9481 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:14.740215 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 677/1338] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 04:03:14.745638 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bdbb9-46c7-4eb4-a38a-5c3ae3e0b294 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:14.746084 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bdbb9-46c7-4eb4-a38a-5c3ae3e0b294 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:14.746218 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bdbb9-46c7-4eb4-a38a-5c3ae3e0b294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:14.812193 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-323bdbb9-46c7-4eb4-a38a-5c3ae3e0b294 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:03:14.813396 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-323bdbb9-46c7-4eb4-a38a-5c3ae3e0b294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:03:14.822587 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:03:14.919334 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 662/1339] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:03:14 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:03:14.958433 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b6a09-da18-4e22-bb17-8ec533ef9481 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:03:14.960077 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f54b6a09-da18-4e22-bb17-8ec533ef9481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:03:15.067259 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b6a09-da18-4e22-bb17-8ec533ef9481 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:03:15.145460 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7397bd-9ee4-4700-8a5d-483d3416f521 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:03:15.146462 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7397bd-9ee4-4700-8a5d-483d3416f521 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:15.146862 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7397bd-9ee4-4700-8a5d-483d3416f521 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:15.147256 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7397bd-9ee4-4700-8a5d-483d3416f521 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:15.149864 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-dd7397bd-9ee4-4700-8a5d-483d3416f521 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:03:15.190386 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:03:15.270186 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7397bd-9ee4-4700-8a5d-483d3416f521 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:03:15.271697 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7397bd-9ee4-4700-8a5d-483d3416f521 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:03:15.291279 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 678/1340] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:03:14 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:03:19.332825 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d9dfa-5466-42bc-9446-8a0b2ae19881 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:19.333350 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d9dfa-5466-42bc-9446-8a0b2ae19881 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:19.333439 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d9dfa-5466-42bc-9446-8a0b2ae19881 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:19.335007 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 663/1341] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:03:19.340305 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed9441-acf3-46da-8575-d9338cca048c None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:19.340791 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed9441-acf3-46da-8575-d9338cca048c None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:19.340881 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed9441-acf3-46da-8575-d9338cca048c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:19.416614 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-06ed9441-acf3-46da-8575-d9338cca048c None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:03:19.417847 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-06ed9441-acf3-46da-8575-d9338cca048c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:03:19.512756 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:03:19.525949 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 679/1342] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:03:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:03:19.566395 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d9dfa-5466-42bc-9446-8a0b2ae19881 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:03:19.568819 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-021d9dfa-5466-42bc-9446-8a0b2ae19881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:03:19.676721 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d9dfa-5466-42bc-9446-8a0b2ae19881 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:03:19.680640 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c644d-8c22-4e88-8df6-19aff2e9bef1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:03:19.681316 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c644d-8c22-4e88-8df6-19aff2e9bef1 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:19.681587 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c644d-8c22-4e88-8df6-19aff2e9bef1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:19.681874 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c644d-8c22-4e88-8df6-19aff2e9bef1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:19.691541 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c644d-8c22-4e88-8df6-19aff2e9bef1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:03:19.693006 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c644d-8c22-4e88-8df6-19aff2e9bef1 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:03:19.702903 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 664/1343] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:03:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:03:22.303238 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffcd9c-8dfc-4bcd-9ad9-69ed207a08a5 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:22.303793 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffcd9c-8dfc-4bcd-9ad9-69ed207a08a5 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:22.303793 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffcd9c-8dfc-4bcd-9ad9-69ed207a08a5 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:22.305455 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 680/1344] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:03:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:03:22.311152 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293233ed-16c4-49fe-8cd7-c40b6d698747 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:22.311638 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293233ed-16c4-49fe-8cd7-c40b6d698747 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:22.311744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293233ed-16c4-49fe-8cd7-c40b6d698747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:22.342245 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-293233ed-16c4-49fe-8cd7-c40b6d698747 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:03:22.343469 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-293233ed-16c4-49fe-8cd7-c40b6d698747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:03:22.374963 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:03:22.432893 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 665/1345] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:03:22 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:03:22.471097 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffcd9c-8dfc-4bcd-9ad9-69ed207a08a5 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:03:22.473190 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-13ffcd9c-8dfc-4bcd-9ad9-69ed207a08a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:03:22.488126 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffcd9c-8dfc-4bcd-9ad9-69ed207a08a5 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:03:22.492178 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf02af-c235-4859-81b9-b034a5096fef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:03:22.492846 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf02af-c235-4859-81b9-b034a5096fef service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:22.493134 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf02af-c235-4859-81b9-b034a5096fef service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:22.493414 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf02af-c235-4859-81b9-b034a5096fef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:22.504362 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf02af-c235-4859-81b9-b034a5096fef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:03:22.505929 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf02af-c235-4859-81b9-b034a5096fef service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:03:22.516785 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 681/1346] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:03:22 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 04:03:26.847011 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93fcff-d041-467d-a7c9-9ed7583c2470 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:26.847518 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93fcff-d041-467d-a7c9-9ed7583c2470 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:26.847603 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93fcff-d041-467d-a7c9-9ed7583c2470 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:26.849145 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 666/1347] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:03:26.854514 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380055b-e0e8-4567-8430-f054ed56e7bf None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:26.854958 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380055b-e0e8-4567-8430-f054ed56e7bf None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:26.855069 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380055b-e0e8-4567-8430-f054ed56e7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:26.873803 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-a380055b-e0e8-4567-8430-f054ed56e7bf None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:03:26.875314 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a380055b-e0e8-4567-8430-f054ed56e7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:03:26.883949 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 682/1348] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:03:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:03:26.921372 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93fcff-d041-467d-a7c9-9ed7583c2470 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:03:26.933167 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93fcff-d041-467d-a7c9-9ed7583c2470 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:03:26.937404 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e19bb-53a6-4a6c-87a2-aa3f7a463bac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:03:26.938059 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e19bb-53a6-4a6c-87a2-aa3f7a463bac service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:26.938452 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e19bb-53a6-4a6c-87a2-aa3f7a463bac service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:26.938739 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e19bb-53a6-4a6c-87a2-aa3f7a463bac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:26.948243 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e19bb-53a6-4a6c-87a2-aa3f7a463bac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:03:26.949708 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e19bb-53a6-4a6c-87a2-aa3f7a463bac service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:03:26.959161 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 667/1349] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:03:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:03:31.898299 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071008a3-9fb0-4cf1-aa6b-45323a4e11c3 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:31.898845 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071008a3-9fb0-4cf1-aa6b-45323a4e11c3 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:31.898845 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071008a3-9fb0-4cf1-aa6b-45323a4e11c3 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:31.900247 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 683/1350] 10.222.0.49 () {54 vars in 921 bytes} [Mon Jul 4 04:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:03:31.906521 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35444be-423f-4027-bbb7-06fe2ec0e25f None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:31.906991 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35444be-423f-4027-bbb7-06fe2ec0e25f None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:31.907070 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35444be-423f-4027-bbb7-06fe2ec0e25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:31.988042 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-f35444be-423f-4027-bbb7-06fe2ec0e25f None None] MFA Rules not processed for user `c2a18591461343c3a0a1b0e317734ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:03:31.989621 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f35444be-423f-4027-bbb7-06fe2ec0e25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:03:32.070033 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 668/1351] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Jul 4 04:03:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:03:36.057371 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b46c0-6f85-4051-928d-982a7f6919c1 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:36.057932 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b46c0-6f85-4051-928d-982a7f6919c1 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:36.057932 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b46c0-6f85-4051-928d-982a7f6919c1 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:36.059503 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 684/1352] 10.222.0.49 () {54 vars in 921 bytes} [Mon Jul 4 04:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:03:36.064588 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0990c6e-16f8-4a87-9c4f-3bfe07b2f5ed None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:36.065629 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0990c6e-16f8-4a87-9c4f-3bfe07b2f5ed None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:36.066169 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0990c6e-16f8-4a87-9c4f-3bfe07b2f5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:36.087067 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-d0990c6e-16f8-4a87-9c4f-3bfe07b2f5ed None None] MFA Rules not processed for user `c2a18591461343c3a0a1b0e317734ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:03:36.088579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d0990c6e-16f8-4a87-9c4f-3bfe07b2f5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:03:36.099431 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 669/1353] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Jul 4 04:03:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:03:36.868453 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=13 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:03:37.721450 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd4725-1941-474a-bb0f-31d4c4ec42bc None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:37.722115 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd4725-1941-474a-bb0f-31d4c4ec42bc None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:37.722115 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd4725-1941-474a-bb0f-31d4c4ec42bc None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:37.723418 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 685/1354] 10.222.0.49 () {54 vars in 921 bytes} [Mon Jul 4 04:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:03:37.728639 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcaa09-53c4-436c-9301-786a1bff28d5 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:37.729087 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcaa09-53c4-436c-9301-786a1bff28d5 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:37.729262 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcaa09-53c4-436c-9301-786a1bff28d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:37.748432 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-10fcaa09-53c4-436c-9301-786a1bff28d5 None None] MFA Rules not processed for user `c2a18591461343c3a0a1b0e317734ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:03:37.749970 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-10fcaa09-53c4-436c-9301-786a1bff28d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:03:37.759394 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 670/1355] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Jul 4 04:03:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:03:41.318006 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca4057-b15e-483f-a4bb-6bf8582546d3 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:41.319063 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca4057-b15e-483f-a4bb-6bf8582546d3 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:41.319563 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca4057-b15e-483f-a4bb-6bf8582546d3 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:41.322304 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 686/1356] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:03:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:03:41.328166 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83111c1b-9f0b-4604-aa18-5297038c86c6 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:41.329174 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83111c1b-9f0b-4604-aa18-5297038c86c6 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:41.329677 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83111c1b-9f0b-4604-aa18-5297038c86c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:41.351775 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-83111c1b-9f0b-4604-aa18-5297038c86c6 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:03:41.354131 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-83111c1b-9f0b-4604-aa18-5297038c86c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:03:41.363229 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 671/1357] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:03:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:03:41.419197 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74107e4f-6fd7-4d15-8ab7-162dbf6c045d None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:41.420362 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74107e4f-6fd7-4d15-8ab7-162dbf6c045d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:41.420896 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74107e4f-6fd7-4d15-8ab7-162dbf6c045d None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:41.422548 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 687/1358] 10.222.0.49 () {54 vars in 961 bytes} [Mon Jul 4 04:03:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 04:03:41.433271 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765a308-eeba-4070-820a-4413a5a20fd1 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:41.433874 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765a308-eeba-4070-820a-4413a5a20fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:41.434348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765a308-eeba-4070-820a-4413a5a20fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:41.479455 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:03:41.489164 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-7765a308-eeba-4070-820a-4413a5a20fd1 None None] MFA Rules not processed for user `8334e75253f843a980b01c6f0cda6015`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:03:41.490695 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-7765a308-eeba-4070-820a-4413a5a20fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:03:41.578131 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 672/1359] 10.222.0.49 () {58 vars in 1058 bytes} [Mon Jul 4 04:03:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:03:41.586299 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74107e4f-6fd7-4d15-8ab7-162dbf6c045d None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:03:41.604893 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74107e4f-6fd7-4d15-8ab7-162dbf6c045d None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:03:41.610906 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566f571-5332-400e-9827-c36f262abfad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:03:41.611922 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566f571-5332-400e-9827-c36f262abfad service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:41.612470 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566f571-5332-400e-9827-c36f262abfad service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:41.613010 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566f571-5332-400e-9827-c36f262abfad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:41.622590 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566f571-5332-400e-9827-c36f262abfad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:03:41.625045 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566f571-5332-400e-9827-c36f262abfad service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:03:41.642072 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 688/1360] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:03:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:03:43.844278 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa483cc-c98a-4470-8805-7ec96d771dc4 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:43.844829 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa483cc-c98a-4470-8805-7ec96d771dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:43.844829 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa483cc-c98a-4470-8805-7ec96d771dc4 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:43.846461 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 673/1361] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:03:43.851496 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0060cd1-f17f-41ef-b4f6-30e1d5a90c0e None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:43.852319 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0060cd1-f17f-41ef-b4f6-30e1d5a90c0e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:43.852566 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0060cd1-f17f-41ef-b4f6-30e1d5a90c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:43.870795 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-d0060cd1-f17f-41ef-b4f6-30e1d5a90c0e None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:03:43.871987 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d0060cd1-f17f-41ef-b4f6-30e1d5a90c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:03:43.881073 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 689/1362] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:03:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:03:43.924064 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa483cc-c98a-4470-8805-7ec96d771dc4 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:03:43.938998 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa483cc-c98a-4470-8805-7ec96d771dc4 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:03:43.944500 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08ae7c-fb65-4a13-8d5b-326c6d7c6f0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:03:43.945123 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08ae7c-fb65-4a13-8d5b-326c6d7c6f0d service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:43.945415 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08ae7c-fb65-4a13-8d5b-326c6d7c6f0d service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:43.945691 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08ae7c-fb65-4a13-8d5b-326c6d7c6f0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:43.954185 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08ae7c-fb65-4a13-8d5b-326c6d7c6f0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:03:43.955780 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08ae7c-fb65-4a13-8d5b-326c6d7c6f0d service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:03:43.968252 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 674/1363] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:03:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:03:46.287998 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c2dc6-3d63-401b-8e9d-09b2d6988531 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:46.287998 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c2dc6-3d63-401b-8e9d-09b2d6988531 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:46.288599 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c2dc6-3d63-401b-8e9d-09b2d6988531 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:46.290196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 690/1364] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:03:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:03:46.295802 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f93bbf-a496-4431-a441-52da69c88f81 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:46.296241 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f93bbf-a496-4431-a441-52da69c88f81 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:46.296401 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f93bbf-a496-4431-a441-52da69c88f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:46.315276 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-04f93bbf-a496-4431-a441-52da69c88f81 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:03:46.316493 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-04f93bbf-a496-4431-a441-52da69c88f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:03:46.330206 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 675/1365] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:03:46.378729 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0a4d6-b62e-42a7-8f3a-32150c0c1b8b None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:46.379025 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0a4d6-b62e-42a7-8f3a-32150c0c1b8b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:46.379309 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0a4d6-b62e-42a7-8f3a-32150c0c1b8b None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:46.380757 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 691/1366] 10.222.0.49 () {54 vars in 961 bytes} [Mon Jul 4 04:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:03:46.386224 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ceca3-10b2-4059-94c8-9f2132b9ec6f None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:46.386522 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ceca3-10b2-4059-94c8-9f2132b9ec6f None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:46.386805 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ceca3-10b2-4059-94c8-9f2132b9ec6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:46.405835 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-4a1ceca3-10b2-4059-94c8-9f2132b9ec6f None None] MFA Rules not processed for user `8334e75253f843a980b01c6f0cda6015`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:03:46.407058 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4a1ceca3-10b2-4059-94c8-9f2132b9ec6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:03:46.417231 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 676/1367] 10.222.0.49 () {58 vars in 1058 bytes} [Mon Jul 4 04:03:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:03:46.425292 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0a4d6-b62e-42a7-8f3a-32150c0c1b8b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:03:46.439947 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0a4d6-b62e-42a7-8f3a-32150c0c1b8b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:03:46.445518 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6293b-e76e-409f-b648-595154f198bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:03:46.446183 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6293b-e76e-409f-b648-595154f198bc service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:46.446484 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6293b-e76e-409f-b648-595154f198bc service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:46.446764 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6293b-e76e-409f-b648-595154f198bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:46.455057 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6293b-e76e-409f-b648-595154f198bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:03:46.456652 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6293b-e76e-409f-b648-595154f198bc service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:03:46.466139 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 692/1368] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:03:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:03:48.558323 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d73ddf-0d17-49e8-a2e8-7826a6b18726 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:48.558899 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d73ddf-0d17-49e8-a2e8-7826a6b18726 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:48.558899 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d73ddf-0d17-49e8-a2e8-7826a6b18726 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:48.560332 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 677/1369] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:03:48.565820 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07e840-f323-4733-b3c8-91e3a09e1533 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:48.566285 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07e840-f323-4733-b3c8-91e3a09e1533 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:48.566408 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07e840-f323-4733-b3c8-91e3a09e1533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:48.586729 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-0f07e840-f323-4733-b3c8-91e3a09e1533 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:03:48.587981 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0f07e840-f323-4733-b3c8-91e3a09e1533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:03:48.596886 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 693/1370] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:03:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:03:48.642790 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d73ddf-0d17-49e8-a2e8-7826a6b18726 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:03:48.659767 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d73ddf-0d17-49e8-a2e8-7826a6b18726 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:03:48.666098 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b96ea-930a-4054-91f8-11f4142a11c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:03:48.667024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b96ea-930a-4054-91f8-11f4142a11c2 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:48.667535 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b96ea-930a-4054-91f8-11f4142a11c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:48.668018 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b96ea-930a-4054-91f8-11f4142a11c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:48.677085 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b96ea-930a-4054-91f8-11f4142a11c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:03:48.679014 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b96ea-930a-4054-91f8-11f4142a11c2 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:03:48.689426 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 678/1371] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:03:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:03:49.295423 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761dfa68-61d3-4457-8b09-829a674e4504 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:49.295625 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761dfa68-61d3-4457-8b09-829a674e4504 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:49.295849 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761dfa68-61d3-4457-8b09-829a674e4504 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:49.297431 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 694/1372] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:03:49.302897 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310715c-bfb0-4ba3-a818-e1368f127ca3 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:49.303151 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310715c-bfb0-4ba3-a818-e1368f127ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:49.303466 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310715c-bfb0-4ba3-a818-e1368f127ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:49.321448 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-4310715c-bfb0-4ba3-a818-e1368f127ca3 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:03:49.322658 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4310715c-bfb0-4ba3-a818-e1368f127ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:03:49.331490 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 679/1373] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:03:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:03:49.669933 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b28fa-ebee-4e93-9263-8eb79ba49bf9 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:49.670918 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b28fa-ebee-4e93-9263-8eb79ba49bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:49.670918 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b28fa-ebee-4e93-9263-8eb79ba49bf9 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:49.672216 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 695/1374] 10.222.0.49 () {54 vars in 963 bytes} [Mon Jul 4 04:03:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:03:49.677192 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e343b21-2850-4d2e-a23d-578deaaceaf9 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:49.677708 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e343b21-2850-4d2e-a23d-578deaaceaf9 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:49.677870 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e343b21-2850-4d2e-a23d-578deaaceaf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:49.729321 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-2e343b21-2850-4d2e-a23d-578deaaceaf9 None None] MFA Rules not processed for user `9d20ab1d200447c098d32ebfa130c5de`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:03:49.730581 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-2e343b21-2850-4d2e-a23d-578deaaceaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:03:49.792410 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 680/1375] 10.222.0.49 () {58 vars in 1060 bytes} [Mon Jul 4 04:03:49 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:03:49.800357 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b28fa-ebee-4e93-9263-8eb79ba49bf9 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:03:49.811580 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b28fa-ebee-4e93-9263-8eb79ba49bf9 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:03:49.815179 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79ca67-e049-4dd9-b7cb-43c82f337550 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:03:49.815825 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79ca67-e049-4dd9-b7cb-43c82f337550 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:49.816107 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79ca67-e049-4dd9-b7cb-43c82f337550 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:49.816383 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79ca67-e049-4dd9-b7cb-43c82f337550 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:49.826340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c79ca67-e049-4dd9-b7cb-43c82f337550 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:03:49.827824 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c79ca67-e049-4dd9-b7cb-43c82f337550 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:03:49.839071 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 696/1376] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:03:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 04:03:50.752363 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de01901-7cb8-4a08-82d4-e08444a0cae5 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:50.752954 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de01901-7cb8-4a08-82d4-e08444a0cae5 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:50.752954 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de01901-7cb8-4a08-82d4-e08444a0cae5 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:50.754555 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 681/1377] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:03:50.764643 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c4b1e-8048-4f9b-aace-0c6ef0c5e43b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:50.765746 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c4b1e-8048-4f9b-aace-0c6ef0c5e43b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:50.765746 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c4b1e-8048-4f9b-aace-0c6ef0c5e43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:50.798767 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-6b9c4b1e-8048-4f9b-aace-0c6ef0c5e43b None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:03:50.799987 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6b9c4b1e-8048-4f9b-aace-0c6ef0c5e43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:03:50.808170 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 697/1378] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:03:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:03:50.851466 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de01901-7cb8-4a08-82d4-e08444a0cae5 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:03:50.867920 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de01901-7cb8-4a08-82d4-e08444a0cae5 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:03:50.874763 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33371eee-6d66-46e4-8d7d-98f0466e347c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:03:50.875501 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33371eee-6d66-46e4-8d7d-98f0466e347c service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:50.875823 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33371eee-6d66-46e4-8d7d-98f0466e347c service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:50.876116 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33371eee-6d66-46e4-8d7d-98f0466e347c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:50.885622 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33371eee-6d66-46e4-8d7d-98f0466e347c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:03:50.887350 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33371eee-6d66-46e4-8d7d-98f0466e347c service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:03:50.891452 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:03:50.898957 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 682/1379] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:03:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:03:52.949054 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2c7ce-a287-41af-b2a0-1b875c9c5a5d None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:52.949588 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2c7ce-a287-41af-b2a0-1b875c9c5a5d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:52.949588 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2c7ce-a287-41af-b2a0-1b875c9c5a5d None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:52.951059 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 698/1380] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:03:52.956354 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14d8a0-8362-4704-a3b1-ea7e778b9c3f None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:52.956819 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14d8a0-8362-4704-a3b1-ea7e778b9c3f None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:52.956927 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14d8a0-8362-4704-a3b1-ea7e778b9c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:52.976239 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-bd14d8a0-8362-4704-a3b1-ea7e778b9c3f None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:03:52.977473 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-bd14d8a0-8362-4704-a3b1-ea7e778b9c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:03:52.986405 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 683/1381] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:03:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:03:53.031044 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2c7ce-a287-41af-b2a0-1b875c9c5a5d None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:03:53.046624 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2c7ce-a287-41af-b2a0-1b875c9c5a5d None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:03:53.053220 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c754d-3991-4460-90ed-c1e46be8f6f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:03:53.053904 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c754d-3991-4460-90ed-c1e46be8f6f9 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:53.054184 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c754d-3991-4460-90ed-c1e46be8f6f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:53.054516 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c754d-3991-4460-90ed-c1e46be8f6f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:53.063781 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c754d-3991-4460-90ed-c1e46be8f6f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:03:53.065391 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c754d-3991-4460-90ed-c1e46be8f6f9 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:03:53.075677 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 699/1382] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:03:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:03:55.154635 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4029e9-6c43-4dc4-9450-7d3e0e144395 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:55.155202 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4029e9-6c43-4dc4-9450-7d3e0e144395 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:55.155202 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4029e9-6c43-4dc4-9450-7d3e0e144395 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:55.156550 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 684/1383] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:03:55.161956 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b39635-5fb1-4dfd-bc07-2666f2f54686 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:55.162479 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b39635-5fb1-4dfd-bc07-2666f2f54686 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:55.162591 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b39635-5fb1-4dfd-bc07-2666f2f54686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:55.180902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-83b39635-5fb1-4dfd-bc07-2666f2f54686 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:03:55.182082 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-83b39635-5fb1-4dfd-bc07-2666f2f54686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:03:55.191081 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 700/1384] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:03:55.232675 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4029e9-6c43-4dc4-9450-7d3e0e144395 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:03:55.248488 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4029e9-6c43-4dc4-9450-7d3e0e144395 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:03:55.254976 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655c3ca-d7fe-409b-9f4d-aa773c2c8bfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:03:55.255637 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655c3ca-d7fe-409b-9f4d-aa773c2c8bfc service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:55.255938 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655c3ca-d7fe-409b-9f4d-aa773c2c8bfc service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:55.256193 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655c3ca-d7fe-409b-9f4d-aa773c2c8bfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:55.265396 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655c3ca-d7fe-409b-9f4d-aa773c2c8bfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:03:55.267056 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655c3ca-d7fe-409b-9f4d-aa773c2c8bfc service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:03:55.277342 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 685/1385] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:03:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:03:57.305487 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955271f-9670-470a-acc3-2adc7b86f196 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:57.306045 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955271f-9670-470a-acc3-2adc7b86f196 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:57.306045 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955271f-9670-470a-acc3-2adc7b86f196 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:57.307684 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 701/1386] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:03:57.312919 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2944b-322c-4f17-9e8c-8d24adebe780 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:57.313384 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2944b-322c-4f17-9e8c-8d24adebe780 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:57.313479 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2944b-322c-4f17-9e8c-8d24adebe780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:57.331673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-3af2944b-322c-4f17-9e8c-8d24adebe780 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:03:57.332926 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3af2944b-322c-4f17-9e8c-8d24adebe780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:03:57.340987 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 686/1387] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:03:57.384069 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955271f-9670-470a-acc3-2adc7b86f196 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:03:57.399825 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955271f-9670-470a-acc3-2adc7b86f196 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:03:57.405559 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e6a7e-c0f9-401e-86a6-956606974a9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:03:57.406190 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e6a7e-c0f9-401e-86a6-956606974a9c service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:57.406474 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e6a7e-c0f9-401e-86a6-956606974a9c service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:57.406752 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e6a7e-c0f9-401e-86a6-956606974a9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:57.415235 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e6a7e-c0f9-401e-86a6-956606974a9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:03:57.416891 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e6a7e-c0f9-401e-86a6-956606974a9c service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:03:57.427659 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 702/1388] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:03:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:03:59.977278 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e949b08-1414-4997-a30a-cf8c8c086ae3 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:59.977749 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e949b08-1414-4997-a30a-cf8c8c086ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:59.977844 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e949b08-1414-4997-a30a-cf8c8c086ae3 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:03:59.979269 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 687/1389] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:03:59.985521 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947d544-714f-4501-91d8-e98529f394da None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:03:59.986045 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947d544-714f-4501-91d8-e98529f394da None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:03:59.986245 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947d544-714f-4501-91d8-e98529f394da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:00.005876 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-6947d544-714f-4501-91d8-e98529f394da None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:04:00.007202 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6947d544-714f-4501-91d8-e98529f394da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:04:00.016508 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 703/1390] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:03:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:04:00.060909 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e949b08-1414-4997-a30a-cf8c8c086ae3 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:04:00.079658 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e949b08-1414-4997-a30a-cf8c8c086ae3 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:04:00.086576 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11734d18-1633-4157-9679-409f1dfd15f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:04:00.087466 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11734d18-1633-4157-9679-409f1dfd15f9 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:00.087830 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11734d18-1633-4157-9679-409f1dfd15f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:00.088193 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11734d18-1633-4157-9679-409f1dfd15f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:00.099151 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11734d18-1633-4157-9679-409f1dfd15f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:04:00.101530 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11734d18-1633-4157-9679-409f1dfd15f9 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:04:00.114065 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 688/1391] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:04:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:04:02.365345 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5084a4e-2547-4def-90da-68a55b1a0aa8 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:02.365898 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5084a4e-2547-4def-90da-68a55b1a0aa8 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:02.365898 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5084a4e-2547-4def-90da-68a55b1a0aa8 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:02.367315 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 704/1392] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:04:02.373238 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd9a36-a62f-4f44-b580-62cdbe67b8bc None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:02.374065 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd9a36-a62f-4f44-b580-62cdbe67b8bc None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:02.374470 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd9a36-a62f-4f44-b580-62cdbe67b8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:02.398726 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-9bbd9a36-a62f-4f44-b580-62cdbe67b8bc None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:04:02.400506 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9bbd9a36-a62f-4f44-b580-62cdbe67b8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:04:02.411545 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 689/1393] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:04:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:04:02.465383 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5084a4e-2547-4def-90da-68a55b1a0aa8 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:04:02.481252 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5084a4e-2547-4def-90da-68a55b1a0aa8 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:04:02.487276 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6e8d4-49b2-499e-aab1-ac71cce97b22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:04:02.487923 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6e8d4-49b2-499e-aab1-ac71cce97b22 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:02.488208 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6e8d4-49b2-499e-aab1-ac71cce97b22 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:02.488504 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6e8d4-49b2-499e-aab1-ac71cce97b22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:02.497751 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6e8d4-49b2-499e-aab1-ac71cce97b22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:04:02.499675 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6e8d4-49b2-499e-aab1-ac71cce97b22 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:04:02.509808 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 705/1394] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:04:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 04:04:04.530568 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc57897-468d-4fb7-9c03-b57333880c16 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:04.531142 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc57897-468d-4fb7-9c03-b57333880c16 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:04.531142 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc57897-468d-4fb7-9c03-b57333880c16 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:04.532499 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 690/1395] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:04:04.537943 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd4693-2d62-4004-8b9c-226f5beecb3a None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:04.538414 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd4693-2d62-4004-8b9c-226f5beecb3a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:04.538531 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd4693-2d62-4004-8b9c-226f5beecb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:04.556733 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-59dd4693-2d62-4004-8b9c-226f5beecb3a None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:04:04.557932 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-59dd4693-2d62-4004-8b9c-226f5beecb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:04:04.567533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 706/1396] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:04:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:04:04.611456 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc57897-468d-4fb7-9c03-b57333880c16 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:04:04.627029 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc57897-468d-4fb7-9c03-b57333880c16 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:04:04.632844 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579865ff-3d56-413d-aeb8-f1bf05368d4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:04:04.633481 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579865ff-3d56-413d-aeb8-f1bf05368d4b service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:04.633770 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579865ff-3d56-413d-aeb8-f1bf05368d4b service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:04.634047 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579865ff-3d56-413d-aeb8-f1bf05368d4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:04.642627 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579865ff-3d56-413d-aeb8-f1bf05368d4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:04:04.644268 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579865ff-3d56-413d-aeb8-f1bf05368d4b service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:04:04.654332 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 691/1397] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:04:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:04:04.832661 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf7dcb-50c4-40f1-a095-3a93e9c703c9 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:04.832886 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf7dcb-50c4-40f1-a095-3a93e9c703c9 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:04.833185 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf7dcb-50c4-40f1-a095-3a93e9c703c9 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:04.834672 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 707/1398] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:04:04.840723 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c7414-6395-45cf-9e5a-d334ac8b8175 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:04.841022 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c7414-6395-45cf-9e5a-d334ac8b8175 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:04.841303 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c7414-6395-45cf-9e5a-d334ac8b8175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:04.861661 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-3a4c7414-6395-45cf-9e5a-d334ac8b8175 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:04:04.862978 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3a4c7414-6395-45cf-9e5a-d334ac8b8175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:04:04.873817 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 692/1399] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:04:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:04:04.928115 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a81d41-9636-427e-bab2-a9e9e8c1a5ce None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:04.928414 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a81d41-9636-427e-bab2-a9e9e8c1a5ce None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:04.928705 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a81d41-9636-427e-bab2-a9e9e8c1a5ce None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:04.930141 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 708/1400] 10.222.0.49 () {54 vars in 962 bytes} [Mon Jul 4 04:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:04:04.935168 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918b651-355d-45bf-93e4-1113e20e1037 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:04.935465 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918b651-355d-45bf-93e4-1113e20e1037 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:04.935744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918b651-355d-45bf-93e4-1113e20e1037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:04.992421 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-4918b651-355d-45bf-93e4-1113e20e1037 None None] MFA Rules not processed for user `60e29ce1e3d64431bc7aa80d55787ae5`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:04:04.993625 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4918b651-355d-45bf-93e4-1113e20e1037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:04:05.057261 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 693/1401] 10.222.0.49 () {58 vars in 1059 bytes} [Mon Jul 4 04:04:04 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:04:05.065274 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a81d41-9636-427e-bab2-a9e9e8c1a5ce None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:04:05.077290 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a81d41-9636-427e-bab2-a9e9e8c1a5ce None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:04:05.081334 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf1f86-3e2f-45f3-8fea-b6fdb51cd2c6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e29ce1e3d64431bc7aa80d55787ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:04:05.082401 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf1f86-3e2f-45f3-8fea-b6fdb51cd2c6 service glance] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:05.082881 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf1f86-3e2f-45f3-8fea-b6fdb51cd2c6 service glance] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:05.083176 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf1f86-3e2f-45f3-8fea-b6fdb51cd2c6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:05.094104 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf1f86-3e2f-45f3-8fea-b6fdb51cd2c6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:04:05.095714 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf1f86-3e2f-45f3-8fea-b6fdb51cd2c6 service glance] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:04:05.107405 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 709/1402] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:04:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:04:05.827040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4783b-f255-469f-8845-d380f3f12cec None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:05.827506 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4783b-f255-469f-8845-d380f3f12cec None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:05.827831 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4783b-f255-469f-8845-d380f3f12cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:05.878882 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-dae4783b-f255-469f-8845-d380f3f12cec None None] MFA Rules not processed for user `03e7f908f0a7499792e59e31d497edb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:04:05.880087 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-dae4783b-f255-469f-8845-d380f3f12cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:04:05.920029 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:04:05.944340 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 694/1403] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Jul 4 04:04:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:04:05.991579 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59f712-dbb5-4263-b4bd-f3b6e56c741f None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:05.992020 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59f712-dbb5-4263-b4bd-f3b6e56c741f None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:05.992134 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59f712-dbb5-4263-b4bd-f3b6e56c741f None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:05.993557 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 710/1404] 10.222.0.49 () {54 vars in 942 bytes} [Mon Jul 4 04:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:04:06.000026 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9ab1e-52ff-40b5-86c2-279b32ff22d4 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:06.000348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9ab1e-52ff-40b5-86c2-279b32ff22d4 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:06.000630 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9ab1e-52ff-40b5-86c2-279b32ff22d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:06.051450 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-09e9ab1e-52ff-40b5-86c2-279b32ff22d4 None None] MFA Rules not processed for user `24f93fdc98ff425791da3e2194b3a671`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:04:06.052714 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-09e9ab1e-52ff-40b5-86c2-279b32ff22d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:04:06.126272 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 695/1405] 10.222.0.49 () {58 vars in 1039 bytes} [Mon Jul 4 04:04:05 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:04:06.136121 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59f712-dbb5-4263-b4bd-f3b6e56c741f None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:04:06.149769 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59f712-dbb5-4263-b4bd-f3b6e56c741f None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:04:06.154895 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33651b1e-a1ba-4065-aad9-fdcf66c67f31 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f93fdc98ff425791da3e2194b3a671', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:04:06.155575 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33651b1e-a1ba-4065-aad9-fdcf66c67f31 service swift] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:06.155895 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33651b1e-a1ba-4065-aad9-fdcf66c67f31 service swift] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:06.156180 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33651b1e-a1ba-4065-aad9-fdcf66c67f31 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:06.165475 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33651b1e-a1ba-4065-aad9-fdcf66c67f31 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:04:06.167120 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33651b1e-a1ba-4065-aad9-fdcf66c67f31 service swift] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:04:06.175571 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 711/1406] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Jul 4 04:04:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 04:04:06.689502 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af235c2-b93e-4ec6-905e-3be3b404e52e None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:06.689797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af235c2-b93e-4ec6-905e-3be3b404e52e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:06.690085 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af235c2-b93e-4ec6-905e-3be3b404e52e None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:06.691597 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 696/1407] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:04:06.696707 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7acd3-db9d-413a-b489-aaef91fb963d None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:06.697002 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7acd3-db9d-413a-b489-aaef91fb963d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:06.697287 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7acd3-db9d-413a-b489-aaef91fb963d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:06.715892 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-bbc7acd3-db9d-413a-b489-aaef91fb963d None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:04:06.717218 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-bbc7acd3-db9d-413a-b489-aaef91fb963d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:04:06.726791 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 712/1408] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:04:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:04:06.773634 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af235c2-b93e-4ec6-905e-3be3b404e52e None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:04:06.788570 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af235c2-b93e-4ec6-905e-3be3b404e52e None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:04:06.794893 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8799a6-1d2b-48e8-b10c-6af1d6e56868 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:04:06.795787 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8799a6-1d2b-48e8-b10c-6af1d6e56868 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:06.796288 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8799a6-1d2b-48e8-b10c-6af1d6e56868 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:06.796670 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8799a6-1d2b-48e8-b10c-6af1d6e56868 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:06.805936 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8799a6-1d2b-48e8-b10c-6af1d6e56868 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:04:06.809921 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8799a6-1d2b-48e8-b10c-6af1d6e56868 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:04:06.821220 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 697/1409] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:04:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:04:16.710978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=69 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:04:16.816317 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=59 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:04:28.094882 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795c19f-63f5-41a8-bf0a-7f6b4b185e74 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:28.095482 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795c19f-63f5-41a8-bf0a-7f6b4b185e74 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:28.095482 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795c19f-63f5-41a8-bf0a-7f6b4b185e74 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:28.097778 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 713/1410] 10.222.0.49 () {54 vars in 918 bytes} [Mon Jul 4 04:04:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:04:28.104340 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f999e97-b822-4a75-be9c-277d59ba4e57 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:28.104799 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f999e97-b822-4a75-be9c-277d59ba4e57 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:28.104907 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f999e97-b822-4a75-be9c-277d59ba4e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:28.127552 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-5f999e97-b822-4a75-be9c-277d59ba4e57 None None] MFA Rules not processed for user `c2a18591461343c3a0a1b0e317734ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:04:28.128788 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5f999e97-b822-4a75-be9c-277d59ba4e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:04:28.138677 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 698/1411] 10.222.0.49 () {58 vars in 1015 bytes} [Mon Jul 4 04:04:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:04:28.153245 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a0175-bfaf-48bb-baeb-efb0c6fc6c45 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:28.153542 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a0175-bfaf-48bb-baeb-efb0c6fc6c45 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:28.153828 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a0175-bfaf-48bb-baeb-efb0c6fc6c45 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:28.155371 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 714/1412] 10.222.0.49 () {54 vars in 918 bytes} [Mon Jul 4 04:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:04:28.161628 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da34ef3-5f64-4789-b84e-f241ad454665 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:28.161921 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da34ef3-5f64-4789-b84e-f241ad454665 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:28.162203 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da34ef3-5f64-4789-b84e-f241ad454665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:28.181752 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-4da34ef3-5f64-4789-b84e-f241ad454665 None None] MFA Rules not processed for user `8334e75253f843a980b01c6f0cda6015`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:04:28.183006 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4da34ef3-5f64-4789-b84e-f241ad454665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:04:28.193952 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 699/1413] 10.222.0.49 () {58 vars in 1015 bytes} [Mon Jul 4 04:04:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:04:30.679450 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e819b-54c9-4c31-b7a3-714e2e75bcf1 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:30.680378 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e819b-54c9-4c31-b7a3-714e2e75bcf1 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:30.680378 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e819b-54c9-4c31-b7a3-714e2e75bcf1 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:30.682479 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 715/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 04:04:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:04:30.690554 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46792b59-3a43-4fac-8c93-ecd8e238e664 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:30.691130 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46792b59-3a43-4fac-8c93-ecd8e238e664 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:30.691239 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46792b59-3a43-4fac-8c93-ecd8e238e664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:30.710380 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-46792b59-3a43-4fac-8c93-ecd8e238e664 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:04:30.711578 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-46792b59-3a43-4fac-8c93-ecd8e238e664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:04:30.721023 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 700/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 04:04:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:04:30.764510 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e819b-54c9-4c31-b7a3-714e2e75bcf1 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:04:30.782781 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e819b-54c9-4c31-b7a3-714e2e75bcf1 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:04:30.790002 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b077dd-1b16-407e-9465-5ba851faabd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:04:30.790679 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b077dd-1b16-407e-9465-5ba851faabd2 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:30.790974 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b077dd-1b16-407e-9465-5ba851faabd2 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:30.791247 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b077dd-1b16-407e-9465-5ba851faabd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:30.799861 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b077dd-1b16-407e-9465-5ba851faabd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:04:30.801433 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b077dd-1b16-407e-9465-5ba851faabd2 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:04:30.811215 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 716/1416] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:04:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:04:31.695729 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bedbe5-6e9e-4278-8b24-c30276b5ae4e None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:31.696348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bedbe5-6e9e-4278-8b24-c30276b5ae4e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:31.696348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bedbe5-6e9e-4278-8b24-c30276b5ae4e None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:31.697676 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 701/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 04:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:04:31.706019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86547e-2a02-4d7f-b758-e7e7c09adac5 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:31.706554 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86547e-2a02-4d7f-b758-e7e7c09adac5 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:31.706697 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86547e-2a02-4d7f-b758-e7e7c09adac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:31.729672 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ac86547e-2a02-4d7f-b758-e7e7c09adac5 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:04:31.730929 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ac86547e-2a02-4d7f-b758-e7e7c09adac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:04:31.740181 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 717/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 04:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:04:31.895539 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bedbe5-6e9e-4278-8b24-c30276b5ae4e None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:04:31.912773 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bedbe5-6e9e-4278-8b24-c30276b5ae4e None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:04:31.919848 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee060ed1-cc55-46b6-a1ca-6042b41495c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:04:31.920484 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee060ed1-cc55-46b6-a1ca-6042b41495c8 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:31.920767 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee060ed1-cc55-46b6-a1ca-6042b41495c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:31.921045 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee060ed1-cc55-46b6-a1ca-6042b41495c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:31.929391 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee060ed1-cc55-46b6-a1ca-6042b41495c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:04:31.931050 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee060ed1-cc55-46b6-a1ca-6042b41495c8 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:04:31.941539 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 702/1419] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:04:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:04:32.823178 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660e8a0-5998-454f-bf9f-4f5d6846b754 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:32.824118 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660e8a0-5998-454f-bf9f-4f5d6846b754 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:32.824118 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660e8a0-5998-454f-bf9f-4f5d6846b754 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:32.826453 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 718/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 04:04:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:04:32.832680 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed916827-7f00-4fd7-9d1e-af805474163e None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:32.833138 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed916827-7f00-4fd7-9d1e-af805474163e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:32.833373 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed916827-7f00-4fd7-9d1e-af805474163e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:32.861633 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-ed916827-7f00-4fd7-9d1e-af805474163e None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:04:32.863256 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ed916827-7f00-4fd7-9d1e-af805474163e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:04:32.872657 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 703/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 04:04:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:04:33.022097 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660e8a0-5998-454f-bf9f-4f5d6846b754 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:04:33.039923 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660e8a0-5998-454f-bf9f-4f5d6846b754 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:04:33.045554 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46846f-c719-48b2-98a0-5e3f4f44fdf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:04:33.046192 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46846f-c719-48b2-98a0-5e3f4f44fdf5 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:33.046497 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46846f-c719-48b2-98a0-5e3f4f44fdf5 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:33.046771 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46846f-c719-48b2-98a0-5e3f4f44fdf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:33.055513 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b46846f-c719-48b2-98a0-5e3f4f44fdf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:04:33.057253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b46846f-c719-48b2-98a0-5e3f4f44fdf5 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:04:33.071635 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 719/1422] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:04:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:04:33.955434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b08605-d10a-43c3-aa8e-8c141387627c None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:33.956311 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b08605-d10a-43c3-aa8e-8c141387627c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:33.956311 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b08605-d10a-43c3-aa8e-8c141387627c None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:33.958562 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 704/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 04:04:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:04:33.964811 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06835661-52b1-483d-8aff-12efade64fcd None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:33.965356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06835661-52b1-483d-8aff-12efade64fcd None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:33.965447 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06835661-52b1-483d-8aff-12efade64fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:33.988349 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-06835661-52b1-483d-8aff-12efade64fcd None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:04:33.989577 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-06835661-52b1-483d-8aff-12efade64fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:04:33.999610 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 720/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 04:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:04:34.148479 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b08605-d10a-43c3-aa8e-8c141387627c None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:04:34.165031 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b08605-d10a-43c3-aa8e-8c141387627c None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:04:34.171456 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec78b84-93ba-4205-b5fa-09845eb5791a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:04:34.172135 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec78b84-93ba-4205-b5fa-09845eb5791a service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:34.172415 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec78b84-93ba-4205-b5fa-09845eb5791a service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:34.172699 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec78b84-93ba-4205-b5fa-09845eb5791a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:34.181465 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec78b84-93ba-4205-b5fa-09845eb5791a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:04:34.183122 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec78b84-93ba-4205-b5fa-09845eb5791a service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:04:34.192781 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 705/1425] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:04:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:04:35.039935 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76404eb1-a058-49e1-b87d-db67f2b5eb42 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:35.040773 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76404eb1-a058-49e1-b87d-db67f2b5eb42 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:35.040773 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76404eb1-a058-49e1-b87d-db67f2b5eb42 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:35.043146 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 721/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 04:04:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:04:35.049136 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a897c-5329-49a0-9e9f-b835d903c51c None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:35.049895 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a897c-5329-49a0-9e9f-b835d903c51c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:35.050127 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a897c-5329-49a0-9e9f-b835d903c51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:35.068518 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-253a897c-5329-49a0-9e9f-b835d903c51c None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:04:35.069728 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-253a897c-5329-49a0-9e9f-b835d903c51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:04:35.078728 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 706/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 04:04:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:04:35.236235 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76404eb1-a058-49e1-b87d-db67f2b5eb42 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:04:35.259129 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76404eb1-a058-49e1-b87d-db67f2b5eb42 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:04:35.265006 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592f44a-dcf9-4b5b-899e-32e19c1455f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:04:35.265651 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592f44a-dcf9-4b5b-899e-32e19c1455f3 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:35.265942 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592f44a-dcf9-4b5b-899e-32e19c1455f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:35.266259 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592f44a-dcf9-4b5b-899e-32e19c1455f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:35.275056 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3592f44a-dcf9-4b5b-899e-32e19c1455f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:04:35.276707 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3592f44a-dcf9-4b5b-899e-32e19c1455f3 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:04:35.286900 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 722/1428] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:04:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:04:36.095936 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc863b3-a8a4-409d-9cf6-fecd4e125b81 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:36.096538 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc863b3-a8a4-409d-9cf6-fecd4e125b81 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:36.096538 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc863b3-a8a4-409d-9cf6-fecd4e125b81 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:36.097977 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 707/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 04:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:04:36.103163 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e7f21-8b52-4e65-9326-2e20c0105b43 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:36.103623 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e7f21-8b52-4e65-9326-2e20c0105b43 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:36.103733 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e7f21-8b52-4e65-9326-2e20c0105b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:36.124120 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-dc7e7f21-8b52-4e65-9326-2e20c0105b43 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:04:36.125358 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-dc7e7f21-8b52-4e65-9326-2e20c0105b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:04:36.134556 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 723/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 04:04:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:04:36.286702 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc863b3-a8a4-409d-9cf6-fecd4e125b81 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:04:36.303395 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc863b3-a8a4-409d-9cf6-fecd4e125b81 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:04:36.309308 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f188ae3-5d6c-4c16-b423-077694b2a7d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:04:36.309948 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f188ae3-5d6c-4c16-b423-077694b2a7d6 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:36.310268 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f188ae3-5d6c-4c16-b423-077694b2a7d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:36.310552 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f188ae3-5d6c-4c16-b423-077694b2a7d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:36.318809 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f188ae3-5d6c-4c16-b423-077694b2a7d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:04:36.320432 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f188ae3-5d6c-4c16-b423-077694b2a7d6 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:04:36.329827 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 708/1431] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:04:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:04:37.142948 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae827f8-52fd-4baf-afb1-be4e03a241c1 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:37.144190 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae827f8-52fd-4baf-afb1-be4e03a241c1 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:37.144483 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae827f8-52fd-4baf-afb1-be4e03a241c1 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:37.145880 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 724/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 04:04:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:04:37.151270 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af78b3c-fe60-4a78-b13b-5ebad5336ee8 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:37.151740 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af78b3c-fe60-4a78-b13b-5ebad5336ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:37.151841 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af78b3c-fe60-4a78-b13b-5ebad5336ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:37.170578 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-0af78b3c-fe60-4a78-b13b-5ebad5336ee8 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:04:37.171767 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0af78b3c-fe60-4a78-b13b-5ebad5336ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:04:37.180574 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 709/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 04:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:04:37.335323 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae827f8-52fd-4baf-afb1-be4e03a241c1 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:04:37.356651 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae827f8-52fd-4baf-afb1-be4e03a241c1 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:04:37.364951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ead6a9-7003-4582-8456-456a5d973d6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:04:37.365599 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ead6a9-7003-4582-8456-456a5d973d6a service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:37.365893 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ead6a9-7003-4582-8456-456a5d973d6a service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:37.366189 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ead6a9-7003-4582-8456-456a5d973d6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:37.375194 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ead6a9-7003-4582-8456-456a5d973d6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:04:37.376821 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ead6a9-7003-4582-8456-456a5d973d6a service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:04:37.387319 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 725/1434] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:04:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:04:38.206998 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c072f-fb54-4b0b-a163-d0716b8cc276 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:38.207602 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c072f-fb54-4b0b-a163-d0716b8cc276 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:38.207602 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c072f-fb54-4b0b-a163-d0716b8cc276 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:38.208984 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 710/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 04:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 04:04:38.215119 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d733b-80dc-4afd-9513-1d493e492595 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:38.215869 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d733b-80dc-4afd-9513-1d493e492595 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:38.216058 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d733b-80dc-4afd-9513-1d493e492595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:38.236982 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ec3d733b-80dc-4afd-9513-1d493e492595 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:04:38.238146 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ec3d733b-80dc-4afd-9513-1d493e492595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:04:38.247623 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 726/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 04:04:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:04:38.398991 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c072f-fb54-4b0b-a163-d0716b8cc276 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:04:38.415465 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c072f-fb54-4b0b-a163-d0716b8cc276 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:04:38.421919 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29da9b1-4050-4fcc-9fb9-a8ad2bd85964 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:04:38.422604 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29da9b1-4050-4fcc-9fb9-a8ad2bd85964 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:38.422896 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29da9b1-4050-4fcc-9fb9-a8ad2bd85964 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:38.423173 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29da9b1-4050-4fcc-9fb9-a8ad2bd85964 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:38.432991 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29da9b1-4050-4fcc-9fb9-a8ad2bd85964 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:04:38.435532 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29da9b1-4050-4fcc-9fb9-a8ad2bd85964 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:04:38.447683 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 711/1437] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:04:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:04:39.236597 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b6814-36f2-4fb1-addb-1e8938aef9fa None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:39.237167 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b6814-36f2-4fb1-addb-1e8938aef9fa None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:39.237167 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b6814-36f2-4fb1-addb-1e8938aef9fa None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:39.238497 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 727/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 04:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:04:39.244437 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565aa84-0090-4472-a39a-927209bf9885 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:39.245444 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565aa84-0090-4472-a39a-927209bf9885 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:39.245719 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565aa84-0090-4472-a39a-927209bf9885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:39.267421 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-b565aa84-0090-4472-a39a-927209bf9885 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:04:39.269296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b565aa84-0090-4472-a39a-927209bf9885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:04:39.280730 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 712/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 04:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:04:39.433912 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b6814-36f2-4fb1-addb-1e8938aef9fa None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:04:39.450857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b6814-36f2-4fb1-addb-1e8938aef9fa None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:04:39.457644 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ce538-f022-40be-b847-e6bb3f434d8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:04:39.458317 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ce538-f022-40be-b847-e6bb3f434d8c service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:39.458607 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ce538-f022-40be-b847-e6bb3f434d8c service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:39.458884 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ce538-f022-40be-b847-e6bb3f434d8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:39.467494 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ce538-f022-40be-b847-e6bb3f434d8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:04:39.469080 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ce538-f022-40be-b847-e6bb3f434d8c service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:04:39.478759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 728/1440] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:04:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:04:41.373466 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a6e2f-1f75-4d0b-b534-a2a3829898c2 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:41.374440 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a6e2f-1f75-4d0b-b534-a2a3829898c2 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:41.374440 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a6e2f-1f75-4d0b-b534-a2a3829898c2 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:41.375677 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 713/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 04:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 04:04:41.381452 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94af37-2a3c-4e18-ae29-7942f0bccc28 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:41.381937 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94af37-2a3c-4e18-ae29-7942f0bccc28 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:41.382048 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94af37-2a3c-4e18-ae29-7942f0bccc28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:41.401976 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-5f94af37-2a3c-4e18-ae29-7942f0bccc28 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:04:41.403203 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-5f94af37-2a3c-4e18-ae29-7942f0bccc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:04:41.413353 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 729/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 04:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:04:41.451721 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a6e2f-1f75-4d0b-b534-a2a3829898c2 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:04:41.469687 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a6e2f-1f75-4d0b-b534-a2a3829898c2 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:04:41.474883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda047d5-1f76-47a4-832f-c4e7ffcb80fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:04:41.475527 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda047d5-1f76-47a4-832f-c4e7ffcb80fd service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:41.475813 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda047d5-1f76-47a4-832f-c4e7ffcb80fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:41.476095 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda047d5-1f76-47a4-832f-c4e7ffcb80fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:41.485861 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda047d5-1f76-47a4-832f-c4e7ffcb80fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:04:41.487394 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda047d5-1f76-47a4-832f-c4e7ffcb80fd service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:04:41.497192 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 714/1443] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:04:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:04:43.727323 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddbd70-2124-4a5b-bb00-1237751f18cd None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:43.727741 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddbd70-2124-4a5b-bb00-1237751f18cd None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:43.727961 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddbd70-2124-4a5b-bb00-1237751f18cd None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:43.729970 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 730/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 04:04:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:04:43.739391 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744bc5d-9ea9-4c91-89b2-bdab440a7c88 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:43.739821 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744bc5d-9ea9-4c91-89b2-bdab440a7c88 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:43.740214 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744bc5d-9ea9-4c91-89b2-bdab440a7c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:43.764266 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-2744bc5d-9ea9-4c91-89b2-bdab440a7c88 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:04:43.765475 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-2744bc5d-9ea9-4c91-89b2-bdab440a7c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:04:43.774501 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 715/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 04:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:04:43.816426 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddbd70-2124-4a5b-bb00-1237751f18cd None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:04:43.834607 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddbd70-2124-4a5b-bb00-1237751f18cd None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:04:43.838902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d683f-79fe-4c1f-a1e4-82bede0e5a9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:04:43.839550 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d683f-79fe-4c1f-a1e4-82bede0e5a9f service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:43.839836 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d683f-79fe-4c1f-a1e4-82bede0e5a9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:43.840091 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d683f-79fe-4c1f-a1e4-82bede0e5a9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:43.850452 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841d683f-79fe-4c1f-a1e4-82bede0e5a9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:04:43.851909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841d683f-79fe-4c1f-a1e4-82bede0e5a9f service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:04:43.861975 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 731/1446] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:04:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:04:46.179840 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcbac97-b4e6-4cc6-adad-0dcd07298c3b None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:46.180430 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcbac97-b4e6-4cc6-adad-0dcd07298c3b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:46.180430 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcbac97-b4e6-4cc6-adad-0dcd07298c3b None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:46.181775 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 716/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 04:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:04:46.188205 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c88af-7921-40f4-b1d1-ca7208991ba2 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:46.188956 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c88af-7921-40f4-b1d1-ca7208991ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:46.189090 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c88af-7921-40f4-b1d1-ca7208991ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:46.211946 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-616c88af-7921-40f4-b1d1-ca7208991ba2 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:04:46.213138 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-616c88af-7921-40f4-b1d1-ca7208991ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:04:46.221509 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 732/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 04:04:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:04:46.259317 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcbac97-b4e6-4cc6-adad-0dcd07298c3b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:04:46.273573 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcbac97-b4e6-4cc6-adad-0dcd07298c3b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:04:46.280218 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950f90b-38c4-4fca-bcd5-b6daf15de961 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:04:46.281059 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950f90b-38c4-4fca-bcd5-b6daf15de961 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:46.281344 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950f90b-38c4-4fca-bcd5-b6daf15de961 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:46.281667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950f90b-38c4-4fca-bcd5-b6daf15de961 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:46.297115 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6950f90b-38c4-4fca-bcd5-b6daf15de961 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:04:46.299173 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6950f90b-38c4-4fca-bcd5-b6daf15de961 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:04:46.309080 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 717/1449] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:04:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 04:04:48.448095 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba947c08-fcab-4c7d-ba67-38804b039f11 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:48.448938 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba947c08-fcab-4c7d-ba67-38804b039f11 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:48.448938 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba947c08-fcab-4c7d-ba67-38804b039f11 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:48.451184 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 733/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 04:04:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:04:48.456769 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37035770-bb13-4802-844d-7fe07dd9e8aa None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:48.457226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37035770-bb13-4802-844d-7fe07dd9e8aa None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:48.457331 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37035770-bb13-4802-844d-7fe07dd9e8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:48.475634 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-37035770-bb13-4802-844d-7fe07dd9e8aa None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:04:48.476838 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-37035770-bb13-4802-844d-7fe07dd9e8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:04:48.485458 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 718/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 04:04:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:04:48.527658 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba947c08-fcab-4c7d-ba67-38804b039f11 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:04:48.545623 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba947c08-fcab-4c7d-ba67-38804b039f11 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:04:48.549565 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e93dec-a9d8-4ddb-b5ff-91cd5ed08edc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:04:48.550291 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e93dec-a9d8-4ddb-b5ff-91cd5ed08edc service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:48.550577 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e93dec-a9d8-4ddb-b5ff-91cd5ed08edc service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:48.550860 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e93dec-a9d8-4ddb-b5ff-91cd5ed08edc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:48.560196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e93dec-a9d8-4ddb-b5ff-91cd5ed08edc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:04:48.561640 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e93dec-a9d8-4ddb-b5ff-91cd5ed08edc service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:04:48.571408 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 734/1452] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:04:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:04:50.722756 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee487bb-9a51-4742-9c0d-dc841bff84c1 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:50.723674 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee487bb-9a51-4742-9c0d-dc841bff84c1 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:50.723674 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee487bb-9a51-4742-9c0d-dc841bff84c1 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:50.725828 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 719/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 04:04:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:04:50.734773 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872dde6-9f7c-4626-8f9e-b6213d8ad09b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:50.735206 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872dde6-9f7c-4626-8f9e-b6213d8ad09b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:50.735376 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872dde6-9f7c-4626-8f9e-b6213d8ad09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:50.756374 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-d872dde6-9f7c-4626-8f9e-b6213d8ad09b None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:04:50.757572 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d872dde6-9f7c-4626-8f9e-b6213d8ad09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:04:50.766125 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 735/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 04:04:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:04:50.804421 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee487bb-9a51-4742-9c0d-dc841bff84c1 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:04:50.818561 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee487bb-9a51-4742-9c0d-dc841bff84c1 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:04:50.823544 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a0078-a135-419c-af98-168d8920d29b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:04:50.824227 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a0078-a135-419c-af98-168d8920d29b service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:50.824498 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a0078-a135-419c-af98-168d8920d29b service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:50.824800 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a0078-a135-419c-af98-168d8920d29b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:50.834700 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a0078-a135-419c-af98-168d8920d29b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:04:50.836172 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a0078-a135-419c-af98-168d8920d29b service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:04:50.846006 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 720/1455] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:04:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:04:52.907854 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540746b2-eedd-4fdd-817f-40eec1b88e8a None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:52.908458 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540746b2-eedd-4fdd-817f-40eec1b88e8a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:52.908458 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540746b2-eedd-4fdd-817f-40eec1b88e8a None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:52.909810 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 736/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 04:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:04:52.916273 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb570c2c-973a-47ec-a3c6-eba450ec1ca5 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:52.916744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb570c2c-973a-47ec-a3c6-eba450ec1ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:52.916851 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb570c2c-973a-47ec-a3c6-eba450ec1ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:52.938504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-bb570c2c-973a-47ec-a3c6-eba450ec1ca5 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:04:52.939701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-bb570c2c-973a-47ec-a3c6-eba450ec1ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:04:52.948675 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 721/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 04:04:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:04:52.995706 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540746b2-eedd-4fdd-817f-40eec1b88e8a None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:04:53.008528 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540746b2-eedd-4fdd-817f-40eec1b88e8a None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:04:53.012983 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b965b-6be9-439a-b761-20f0f14e92d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:04:53.013942 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b965b-6be9-439a-b761-20f0f14e92d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:53.014279 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b965b-6be9-439a-b761-20f0f14e92d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:53.014583 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b965b-6be9-439a-b761-20f0f14e92d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:53.023887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052b965b-6be9-439a-b761-20f0f14e92d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:04:53.025337 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052b965b-6be9-439a-b761-20f0f14e92d4 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:04:53.034656 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 737/1458] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:04:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:04:55.143149 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79e8d2-197c-4b49-a9ba-f856a91ff1ca None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:55.143843 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79e8d2-197c-4b49-a9ba-f856a91ff1ca None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:55.143843 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79e8d2-197c-4b49-a9ba-f856a91ff1ca None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:55.145154 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 722/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 04:04:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:04:55.151235 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a988b8-84d5-4420-8e2f-5d9d099e51d2 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:55.151679 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a988b8-84d5-4420-8e2f-5d9d099e51d2 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:55.151897 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a988b8-84d5-4420-8e2f-5d9d099e51d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:55.179222 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-24a988b8-84d5-4420-8e2f-5d9d099e51d2 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:04:55.180438 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-24a988b8-84d5-4420-8e2f-5d9d099e51d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:04:55.188463 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 738/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 04:04:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:04:55.229677 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79e8d2-197c-4b49-a9ba-f856a91ff1ca None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:04:55.244693 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79e8d2-197c-4b49-a9ba-f856a91ff1ca None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:04:55.249715 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2300b5c-b8f8-42e1-8dff-fe548c7faaa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:04:55.250419 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2300b5c-b8f8-42e1-8dff-fe548c7faaa7 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:55.250699 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2300b5c-b8f8-42e1-8dff-fe548c7faaa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:55.250971 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2300b5c-b8f8-42e1-8dff-fe548c7faaa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:55.261236 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2300b5c-b8f8-42e1-8dff-fe548c7faaa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:04:55.262744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2300b5c-b8f8-42e1-8dff-fe548c7faaa7 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:04:55.272726 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 723/1461] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:04:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:04:57.346081 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcac87-d909-4bde-81f6-94e2e7bf0f85 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:57.346962 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcac87-d909-4bde-81f6-94e2e7bf0f85 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:57.347122 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcac87-d909-4bde-81f6-94e2e7bf0f85 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:57.349550 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 739/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 04:04:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:04:57.355975 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158782c3-e16a-4cce-801d-a7bfc4dc22ca None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:57.356443 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158782c3-e16a-4cce-801d-a7bfc4dc22ca None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:57.356572 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158782c3-e16a-4cce-801d-a7bfc4dc22ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:57.365826 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=79 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:04:57.380626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-158782c3-e16a-4cce-801d-a7bfc4dc22ca None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:04:57.384274 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-158782c3-e16a-4cce-801d-a7bfc4dc22ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:04:57.397186 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 724/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 04:04:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:04:57.442950 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffcac87-d909-4bde-81f6-94e2e7bf0f85 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:04:57.452475 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=73 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:04:57.459524 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffcac87-d909-4bde-81f6-94e2e7bf0f85 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:04:57.463476 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17c139-14ba-4b05-840c-5f0a67a13660 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:04:57.464102 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17c139-14ba-4b05-840c-5f0a67a13660 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:57.464381 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17c139-14ba-4b05-840c-5f0a67a13660 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:57.464659 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17c139-14ba-4b05-840c-5f0a67a13660 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:57.473990 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e17c139-14ba-4b05-840c-5f0a67a13660 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:04:57.475464 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e17c139-14ba-4b05-840c-5f0a67a13660 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:04:57.484992 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 740/1464] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:04:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:04:59.507978 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061122be-055d-4b15-ab67-3169a9f4d23b None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:59.508549 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061122be-055d-4b15-ab67-3169a9f4d23b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:59.508549 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061122be-055d-4b15-ab67-3169a9f4d23b None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:59.509897 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 725/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 04:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:04:59.515392 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e248a6-4ff6-490d-8780-6513287fee76 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:59.515869 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e248a6-4ff6-490d-8780-6513287fee76 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:59.515990 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e248a6-4ff6-490d-8780-6513287fee76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:59.534510 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-d1e248a6-4ff6-490d-8780-6513287fee76 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:04:59.535710 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d1e248a6-4ff6-490d-8780-6513287fee76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:04:59.544938 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 741/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 04:04:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:04:59.583805 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061122be-055d-4b15-ab67-3169a9f4d23b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:04:59.600431 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061122be-055d-4b15-ab67-3169a9f4d23b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:04:59.607234 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc164037-f9ac-47d1-91fc-e4f6d7ca9af8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:04:59.608192 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc164037-f9ac-47d1-91fc-e4f6d7ca9af8 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:04:59.608536 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc164037-f9ac-47d1-91fc-e4f6d7ca9af8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:04:59.608884 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc164037-f9ac-47d1-91fc-e4f6d7ca9af8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:04:59.620077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc164037-f9ac-47d1-91fc-e4f6d7ca9af8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:04:59.621537 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc164037-f9ac-47d1-91fc-e4f6d7ca9af8 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:04:59.631710 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 726/1467] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:04:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:05:01.708132 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d880c0-d40a-4a83-bd7d-963c8c65dff6 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:05:01.709032 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d880c0-d40a-4a83-bd7d-963c8c65dff6 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:05:01.709032 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d880c0-d40a-4a83-bd7d-963c8c65dff6 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:05:01.711306 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 742/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 04:05:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:05:01.717838 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49dca7e-b5fe-4bdf-880d-4529d43c6788 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:05:01.718664 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49dca7e-b5fe-4bdf-880d-4529d43c6788 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:05:01.718907 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49dca7e-b5fe-4bdf-880d-4529d43c6788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:05:01.739080 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-b49dca7e-b5fe-4bdf-880d-4529d43c6788 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:05:01.740290 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b49dca7e-b5fe-4bdf-880d-4529d43c6788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:05:01.748597 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 727/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 04:05:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:05:01.788136 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d880c0-d40a-4a83-bd7d-963c8c65dff6 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:05:01.799722 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d880c0-d40a-4a83-bd7d-963c8c65dff6 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:05:01.803663 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416af4b9-261e-4bfd-93e8-be236607553e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:05:01.804372 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416af4b9-261e-4bfd-93e8-be236607553e service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:05:01.804711 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416af4b9-261e-4bfd-93e8-be236607553e service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:05:01.805020 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416af4b9-261e-4bfd-93e8-be236607553e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:05:01.815332 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416af4b9-261e-4bfd-93e8-be236607553e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:05:01.816860 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416af4b9-261e-4bfd-93e8-be236607553e service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:05:01.826879 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 743/1470] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:05:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:05:11.733460 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=11 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:05:11.822208 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=14 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:05:21.558434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f12dba-9a1e-432f-8e19-66ce3884a216 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:05:21.559011 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f12dba-9a1e-432f-8e19-66ce3884a216 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:05:21.559011 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f12dba-9a1e-432f-8e19-66ce3884a216 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:05:21.560418 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 728/1471] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:05:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:05:21.566695 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0b5b0-c349-4639-a86c-973a4f478e84 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:05:21.567134 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0b5b0-c349-4639-a86c-973a4f478e84 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:05:21.567250 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0b5b0-c349-4639-a86c-973a4f478e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:05:21.586866 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-dce0b5b0-c349-4639-a86c-973a4f478e84 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:05:21.588072 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-dce0b5b0-c349-4639-a86c-973a4f478e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:05:21.597534 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 744/1472] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:05:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:05:21.689608 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c96ba-40e0-40a5-9513-c7b1bf39c6b2 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:05:21.690024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c96ba-40e0-40a5-9513-c7b1bf39c6b2 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:05:21.690425 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c96ba-40e0-40a5-9513-c7b1bf39c6b2 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:05:21.691854 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 729/1473] 10.222.0.49 () {54 vars in 962 bytes} [Mon Jul 4 04:05:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:05:21.696809 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696fffa-79e6-4f64-ade7-497a87ee8aff None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:05:21.697099 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696fffa-79e6-4f64-ade7-497a87ee8aff None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:05:21.697384 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696fffa-79e6-4f64-ade7-497a87ee8aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:05:21.715986 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-2696fffa-79e6-4f64-ade7-497a87ee8aff None None] MFA Rules not processed for user `60e29ce1e3d64431bc7aa80d55787ae5`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:05:21.717164 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-2696fffa-79e6-4f64-ade7-497a87ee8aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:05:21.724187 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 745/1474] 10.222.0.49 () {58 vars in 1059 bytes} [Mon Jul 4 04:05:21 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:05:21.731662 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c96ba-40e0-40a5-9513-c7b1bf39c6b2 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:05:21.743463 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c96ba-40e0-40a5-9513-c7b1bf39c6b2 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:05:21.747510 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b2f34-dc66-4c0c-b81d-61a6151d734d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e29ce1e3d64431bc7aa80d55787ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:05:21.748150 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b2f34-dc66-4c0c-b81d-61a6151d734d service glance] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:05:21.748437 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b2f34-dc66-4c0c-b81d-61a6151d734d service glance] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:05:21.748721 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b2f34-dc66-4c0c-b81d-61a6151d734d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:05:21.758390 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b2f34-dc66-4c0c-b81d-61a6151d734d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:05:21.759843 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b2f34-dc66-4c0c-b81d-61a6151d734d service glance] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:05:21.769269 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 730/1475] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:05:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:05:23.887600 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086faea-9688-4622-9462-a927d3741d85 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:05:23.888485 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086faea-9688-4622-9462-a927d3741d85 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:05:23.888485 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086faea-9688-4622-9462-a927d3741d85 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:05:23.890806 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 746/1476] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:05:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:05:23.898404 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43c5be-990a-4e3b-b1ac-333267430384 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:05:23.898841 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43c5be-990a-4e3b-b1ac-333267430384 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:05:23.898981 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43c5be-990a-4e3b-b1ac-333267430384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:05:23.920610 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-fa43c5be-990a-4e3b-b1ac-333267430384 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:05:23.921829 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-fa43c5be-990a-4e3b-b1ac-333267430384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:05:23.931586 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 731/1477] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:05:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:05:23.963485 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086faea-9688-4622-9462-a927d3741d85 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:05:23.980243 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086faea-9688-4622-9462-a927d3741d85 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:05:23.985259 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c5928-e7c6-470c-80d8-e8a1b6226e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:05:23.985915 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c5928-e7c6-470c-80d8-e8a1b6226e80 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:05:23.986206 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c5928-e7c6-470c-80d8-e8a1b6226e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:05:23.986485 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c5928-e7c6-470c-80d8-e8a1b6226e80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:05:23.987323 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c5928-e7c6-470c-80d8-e8a1b6226e80 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:05:23.989122 dv-cinder-742162-5-smb devstack@keystone.service[80362]: WARNING py.warnings [None req-ee0c5928-e7c6-470c-80d8-e8a1b6226e80 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 04:05:23.989122 dv-cinder-742162-5-smb devstack@keystone.service[80362]: warnings.warn(msg) Jul 04 04:05:23.989122 dv-cinder-742162-5-smb devstack@keystone.service[80362]: Jul 04 04:05:23.990284 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c5928-e7c6-470c-80d8-e8a1b6226e80 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:05:24.010767 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 747/1478] 10.222.0.49 () {56 vars in 1108 bytes} [Mon Jul 4 04:05:23 2022] GET /identity/v3/projects => generated 2553 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:05:26.120738 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6708f-cbb6-47b0-b79e-883334992a56 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:05:26.121583 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6708f-cbb6-47b0-b79e-883334992a56 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:05:26.121583 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6708f-cbb6-47b0-b79e-883334992a56 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:05:26.123816 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 732/1479] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:05:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:05:26.132950 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ba81a-ba1e-4ccc-b3a5-ec352bbd8891 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:05:26.133380 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ba81a-ba1e-4ccc-b3a5-ec352bbd8891 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:05:26.133504 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ba81a-ba1e-4ccc-b3a5-ec352bbd8891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:05:26.156681 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-188ba81a-ba1e-4ccc-b3a5-ec352bbd8891 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:05:26.157900 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-188ba81a-ba1e-4ccc-b3a5-ec352bbd8891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:05:26.167507 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 748/1480] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:05:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:05:26.215938 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6708f-cbb6-47b0-b79e-883334992a56 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:05:26.233345 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6708f-cbb6-47b0-b79e-883334992a56 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:05:26.239449 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79643fcc-ec1d-4c35-a575-1de9e05850af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:05:26.240130 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79643fcc-ec1d-4c35-a575-1de9e05850af service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:05:26.240419 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79643fcc-ec1d-4c35-a575-1de9e05850af service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:05:26.240682 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79643fcc-ec1d-4c35-a575-1de9e05850af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:05:26.249577 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79643fcc-ec1d-4c35-a575-1de9e05850af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:05:26.251234 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79643fcc-ec1d-4c35-a575-1de9e05850af service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:05:26.261050 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 733/1481] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:05:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:05:28.466772 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea5243-faeb-4188-beac-7355d24ff23a None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:05:28.467689 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea5243-faeb-4188-beac-7355d24ff23a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:05:28.467689 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea5243-faeb-4188-beac-7355d24ff23a None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:05:28.469970 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 749/1482] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:05:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:05:28.475490 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e245360-9339-4398-aac5-950465eee0cd None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:05:28.475946 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e245360-9339-4398-aac5-950465eee0cd None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:05:28.476045 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e245360-9339-4398-aac5-950465eee0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:05:28.499940 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-8e245360-9339-4398-aac5-950465eee0cd None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:05:28.501780 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-8e245360-9339-4398-aac5-950465eee0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:05:28.511498 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 734/1483] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:05:28.549406 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea5243-faeb-4188-beac-7355d24ff23a None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:05:28.567055 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea5243-faeb-4188-beac-7355d24ff23a None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:05:28.571464 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863c66b-e2e0-4bb4-906b-d3af5f817519 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:05:28.572120 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863c66b-e2e0-4bb4-906b-d3af5f817519 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:05:28.572400 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863c66b-e2e0-4bb4-906b-d3af5f817519 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:05:28.572677 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863c66b-e2e0-4bb4-906b-d3af5f817519 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:05:28.582934 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863c66b-e2e0-4bb4-906b-d3af5f817519 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:05:28.584393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863c66b-e2e0-4bb4-906b-d3af5f817519 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:05:28.594651 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 750/1484] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:05:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:05:30.636892 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f466622-b6ff-4b96-84d1-0e000748b3d2 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:05:30.637469 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f466622-b6ff-4b96-84d1-0e000748b3d2 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:05:30.637469 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f466622-b6ff-4b96-84d1-0e000748b3d2 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:05:30.638876 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 735/1485] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:05:30.645266 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7bd60-a03f-439b-9ca8-49816703df35 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:05:30.646000 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7bd60-a03f-439b-9ca8-49816703df35 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:05:30.646318 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7bd60-a03f-439b-9ca8-49816703df35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:05:30.677208 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-e6e7bd60-a03f-439b-9ca8-49816703df35 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:05:30.678470 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e6e7bd60-a03f-439b-9ca8-49816703df35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:05:30.686958 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 751/1486] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:05:30.728067 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f466622-b6ff-4b96-84d1-0e000748b3d2 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:05:30.743373 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f466622-b6ff-4b96-84d1-0e000748b3d2 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:05:30.749468 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778c611-cb81-47fa-8e14-1f97114222ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:05:30.750541 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778c611-cb81-47fa-8e14-1f97114222ca service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:05:30.751026 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778c611-cb81-47fa-8e14-1f97114222ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:05:30.751493 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778c611-cb81-47fa-8e14-1f97114222ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:05:30.761759 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f778c611-cb81-47fa-8e14-1f97114222ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:05:30.763297 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f778c611-cb81-47fa-8e14-1f97114222ca service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:05:30.773403 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 736/1487] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:05:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:05:32.886581 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521997e4-e0a0-450c-91b3-30455a4f4020 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:05:32.887148 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521997e4-e0a0-450c-91b3-30455a4f4020 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:05:32.887148 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521997e4-e0a0-450c-91b3-30455a4f4020 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:05:32.889323 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 752/1488] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:05:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:05:32.897234 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ed2d3-aa56-40ec-af06-0814a7bd3eb1 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:05:32.897652 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ed2d3-aa56-40ec-af06-0814a7bd3eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:05:32.897840 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ed2d3-aa56-40ec-af06-0814a7bd3eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:05:32.922384 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-1b8ed2d3-aa56-40ec-af06-0814a7bd3eb1 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:05:32.923604 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1b8ed2d3-aa56-40ec-af06-0814a7bd3eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:05:32.932470 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 737/1489] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:05:32.973321 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521997e4-e0a0-450c-91b3-30455a4f4020 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:05:32.985377 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521997e4-e0a0-450c-91b3-30455a4f4020 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:05:32.989618 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b0090-b8af-4893-9f38-bb499517fd88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:05:32.990298 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b0090-b8af-4893-9f38-bb499517fd88 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:05:32.990586 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b0090-b8af-4893-9f38-bb499517fd88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:05:32.990866 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b0090-b8af-4893-9f38-bb499517fd88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:05:33.000189 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b0090-b8af-4893-9f38-bb499517fd88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:05:33.001644 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b0090-b8af-4893-9f38-bb499517fd88 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:05:33.010996 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 753/1490] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:05:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:05:35.216168 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d775411-3f98-4c8a-8cea-05afcbd73896 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:05:35.216767 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d775411-3f98-4c8a-8cea-05afcbd73896 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:05:35.216767 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d775411-3f98-4c8a-8cea-05afcbd73896 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:05:35.218085 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 738/1491] 10.222.0.49 () {54 vars in 926 bytes} [Mon Jul 4 04:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:05:35.225896 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251ef3f-ec6f-4306-8059-a5b84b2e36c8 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:05:35.226389 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251ef3f-ec6f-4306-8059-a5b84b2e36c8 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:05:35.226389 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251ef3f-ec6f-4306-8059-a5b84b2e36c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:05:35.254868 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-0251ef3f-ec6f-4306-8059-a5b84b2e36c8 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:05:35.256103 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0251ef3f-ec6f-4306-8059-a5b84b2e36c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:05:35.265206 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 754/1492] 10.222.0.49 () {58 vars in 1023 bytes} [Mon Jul 4 04:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:05:35.303506 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d775411-3f98-4c8a-8cea-05afcbd73896 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:05:35.316076 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d775411-3f98-4c8a-8cea-05afcbd73896 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:05:35.320015 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444ce12-4161-4ea3-b3f1-04b5e4367e44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:05:35.320655 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444ce12-4161-4ea3-b3f1-04b5e4367e44 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:05:35.320948 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444ce12-4161-4ea3-b3f1-04b5e4367e44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:05:35.321223 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444ce12-4161-4ea3-b3f1-04b5e4367e44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:05:35.330832 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444ce12-4161-4ea3-b3f1-04b5e4367e44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:05:35.332290 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444ce12-4161-4ea3-b3f1-04b5e4367e44 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:05:35.341883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 739/1493] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:05:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:05:45.246724 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=33 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:05:45.337706 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=33 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:07:09.246655 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3841511-b5b0-4842-a169-e6d2ff402643 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:07:09.247540 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3841511-b5b0-4842-a169-e6d2ff402643 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:07:09.247540 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3841511-b5b0-4842-a169-e6d2ff402643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:07:09.268295 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-b3841511-b5b0-4842-a169-e6d2ff402643 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:07:09.269478 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b3841511-b5b0-4842-a169-e6d2ff402643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:07:09.278722 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 755/1494] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:07:09.286795 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46211a83-ab88-4aa3-8046-9090f73cd617 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:07:09.287318 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46211a83-ab88-4aa3-8046-9090f73cd617 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:07:09.287318 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46211a83-ab88-4aa3-8046-9090f73cd617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:07:09.306373 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-46211a83-ab88-4aa3-8046-9090f73cd617 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:07:09.307570 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-46211a83-ab88-4aa3-8046-9090f73cd617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:07:09.317025 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 740/1495] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:07:09.322308 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3841511-b5b0-4842-a169-e6d2ff402643 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:07:09.335238 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3841511-b5b0-4842-a169-e6d2ff402643 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:07:09.341162 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332b3d3-33d4-4bb9-8271-846c76570b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:07:09.341830 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332b3d3-33d4-4bb9-8271-846c76570b61 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:07:09.342088 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332b3d3-33d4-4bb9-8271-846c76570b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:07:09.342404 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332b3d3-33d4-4bb9-8271-846c76570b61 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:07:09.343149 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7332b3d3-33d4-4bb9-8271-846c76570b61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:07:09.343467 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7332b3d3-33d4-4bb9-8271-846c76570b61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:07:09.344541 dv-cinder-742162-5-smb devstack@keystone.service[80362]: WARNING py.warnings [None req-7332b3d3-33d4-4bb9-8271-846c76570b61 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 04:07:09.344541 dv-cinder-742162-5-smb devstack@keystone.service[80362]: warnings.warn(msg) Jul 04 04:07:09.344541 dv-cinder-742162-5-smb devstack@keystone.service[80362]: Jul 04 04:07:09.345477 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7332b3d3-33d4-4bb9-8271-846c76570b61 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:07:09.357988 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 756/1496] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:07:09.366281 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46211a83-ab88-4aa3-8046-9090f73cd617 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:07:09.376209 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46211a83-ab88-4aa3-8046-9090f73cd617 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:07:09.382144 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd414a-b63a-4f3f-87bd-50fa3b4a784f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:07:09.382823 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd414a-b63a-4f3f-87bd-50fa3b4a784f admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:07:09.383105 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd414a-b63a-4f3f-87bd-50fa3b4a784f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:07:09.383377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd414a-b63a-4f3f-87bd-50fa3b4a784f admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:07:09.384076 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd414a-b63a-4f3f-87bd-50fa3b4a784f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:07:09.385880 dv-cinder-742162-5-smb devstack@keystone.service[80363]: WARNING py.warnings [None req-adbd414a-b63a-4f3f-87bd-50fa3b4a784f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 04:07:09.385880 dv-cinder-742162-5-smb devstack@keystone.service[80363]: warnings.warn(msg) Jul 04 04:07:09.385880 dv-cinder-742162-5-smb devstack@keystone.service[80363]: Jul 04 04:07:09.387106 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd414a-b63a-4f3f-87bd-50fa3b4a784f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:07:09.428048 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 741/1497] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:07:09 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:07:09.432345 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332b3d3-33d4-4bb9-8271-846c76570b61 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:07:09.443107 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332b3d3-33d4-4bb9-8271-846c76570b61 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:07:09.510727 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8547a61b-dcbf-47c8-8669-fc387411435c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:07:09.511566 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547a61b-dcbf-47c8-8669-fc387411435c admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:07:09.511931 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547a61b-dcbf-47c8-8669-fc387411435c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:07:09.512282 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547a61b-dcbf-47c8-8669-fc387411435c admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:07:09.513272 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8547a61b-dcbf-47c8-8669-fc387411435c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:07:09.514754 dv-cinder-742162-5-smb devstack@keystone.service[80362]: WARNING py.warnings [None req-8547a61b-dcbf-47c8-8669-fc387411435c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 04:07:09.514754 dv-cinder-742162-5-smb devstack@keystone.service[80362]: warnings.warn(msg) Jul 04 04:07:09.514754 dv-cinder-742162-5-smb devstack@keystone.service[80362]: Jul 04 04:07:09.516474 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8547a61b-dcbf-47c8-8669-fc387411435c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:07:09.542505 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 757/1498] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:07:09 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:07:09.546752 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd414a-b63a-4f3f-87bd-50fa3b4a784f admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:07:09.557539 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd414a-b63a-4f3f-87bd-50fa3b4a784f admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:07:09.562515 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ad63a-57c8-448a-a96c-6186a9d89304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:07:09.563219 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ad63a-57c8-448a-a96c-6186a9d89304 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:07:09.563547 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ad63a-57c8-448a-a96c-6186a9d89304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:07:09.563832 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ad63a-57c8-448a-a96c-6186a9d89304 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:07:09.564576 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ad63a-57c8-448a-a96c-6186a9d89304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:07:09.565636 dv-cinder-742162-5-smb devstack@keystone.service[80363]: WARNING py.warnings [None req-842ad63a-57c8-448a-a96c-6186a9d89304 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 04:07:09.565636 dv-cinder-742162-5-smb devstack@keystone.service[80363]: warnings.warn(msg) Jul 04 04:07:09.565636 dv-cinder-742162-5-smb devstack@keystone.service[80363]: Jul 04 04:07:09.566562 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ad63a-57c8-448a-a96c-6186a9d89304 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:07:09.579526 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 742/1499] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:07:09.583664 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8547a61b-dcbf-47c8-8669-fc387411435c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:07:09.594273 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8547a61b-dcbf-47c8-8669-fc387411435c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:07:09.599912 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ccb92e-fa52-4fe8-b0a4-623cca33f156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:07:09.600602 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccb92e-fa52-4fe8-b0a4-623cca33f156 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:07:09.600894 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccb92e-fa52-4fe8-b0a4-623cca33f156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:07:09.601164 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccb92e-fa52-4fe8-b0a4-623cca33f156 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:07:09.601902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ccb92e-fa52-4fe8-b0a4-623cca33f156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:07:09.602979 dv-cinder-742162-5-smb devstack@keystone.service[80362]: WARNING py.warnings [None req-d9ccb92e-fa52-4fe8-b0a4-623cca33f156 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 04:07:09.602979 dv-cinder-742162-5-smb devstack@keystone.service[80362]: warnings.warn(msg) Jul 04 04:07:09.602979 dv-cinder-742162-5-smb devstack@keystone.service[80362]: Jul 04 04:07:09.603853 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ccb92e-fa52-4fe8-b0a4-623cca33f156 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:07:09.617530 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 758/1500] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:07:09.621595 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ad63a-57c8-448a-a96c-6186a9d89304 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:07:09.632048 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ad63a-57c8-448a-a96c-6186a9d89304 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:07:09.637149 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c03b3-1338-484d-b5ff-610678f95f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:07:09.638037 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c03b3-1338-484d-b5ff-610678f95f52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:07:09.638356 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c03b3-1338-484d-b5ff-610678f95f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:07:09.638639 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c03b3-1338-484d-b5ff-610678f95f52 admin admin] PATH_INFO: `/v3/projects/7ca1fd895ce24ebab4cd8845441bd330/users/9e3f6661a456424ea7c84f2e7b5e73bd/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:07:09.653968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c03b3-1338-484d-b5ff-610678f95f52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ca1fd895ce24ebab4cd8845441bd330, user_id=9e3f6661a456424ea7c84f2e7b5e73bd, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:07:09.655066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: WARNING py.warnings [None req-1a4c03b3-1338-484d-b5ff-610678f95f52 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 04:07:09.655066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: warnings.warn(msg) Jul 04 04:07:09.655066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: Jul 04 04:07:09.657105 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c03b3-1338-484d-b5ff-610678f95f52 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:07:09.673011 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 743/1501] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:07:09 2022] PUT /identity/v3/projects/7ca1fd895ce24ebab4cd8845441bd330/users/9e3f6661a456424ea7c84f2e7b5e73bd/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:07:09.686084 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a28a3-5e32-45de-9f43-babdb34cee31 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:07:09.686483 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a28a3-5e32-45de-9f43-babdb34cee31 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:07:09.686899 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a28a3-5e32-45de-9f43-babdb34cee31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:07:09.713859 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-9a4a28a3-5e32-45de-9f43-babdb34cee31 None None] MFA Rules not processed for user `9e3f6661a456424ea7c84f2e7b5e73bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:07:09.715115 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9a4a28a3-5e32-45de-9f43-babdb34cee31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:07:09.790501 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 759/1502] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:07:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:07:09.803978 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02c4b1-9d6d-4a1a-b309-189e3b1cb69d None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:07:09.804489 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02c4b1-9d6d-4a1a-b309-189e3b1cb69d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:07:09.804811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02c4b1-9d6d-4a1a-b309-189e3b1cb69d None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:07:09.806563 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 744/1503] 10.222.0.49 () {54 vars in 963 bytes} [Mon Jul 4 04:07:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:07:09.811710 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a7730-c857-4ba9-8fff-dac636144ccd None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:07:09.812001 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a7730-c857-4ba9-8fff-dac636144ccd None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:07:09.812277 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a7730-c857-4ba9-8fff-dac636144ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:07:09.831223 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-3a9a7730-c857-4ba9-8fff-dac636144ccd None None] MFA Rules not processed for user `9d20ab1d200447c098d32ebfa130c5de`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:07:09.832413 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3a9a7730-c857-4ba9-8fff-dac636144ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:07:09.877133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:07:09.886291 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 760/1504] 10.222.0.49 () {58 vars in 1060 bytes} [Mon Jul 4 04:07:09 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:07:09.893918 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02c4b1-9d6d-4a1a-b309-189e3b1cb69d None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:07:09.905566 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02c4b1-9d6d-4a1a-b309-189e3b1cb69d None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:07:09.909181 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4eb122-320b-4f62-b01a-b6f44c3cd2be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:07:09.909820 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4eb122-320b-4f62-b01a-b6f44c3cd2be service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:07:09.910102 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4eb122-320b-4f62-b01a-b6f44c3cd2be service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:07:09.910413 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4eb122-320b-4f62-b01a-b6f44c3cd2be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:07:09.918845 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4eb122-320b-4f62-b01a-b6f44c3cd2be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:07:09.920300 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4eb122-320b-4f62-b01a-b6f44c3cd2be service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:07:09.929832 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 745/1505] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:07:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:07:09.977449 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686a064-7221-4685-88d9-b9667bb5a20b None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:07:09.977753 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686a064-7221-4685-88d9-b9667bb5a20b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:07:09.978041 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686a064-7221-4685-88d9-b9667bb5a20b None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:07:09.979406 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 761/1506] 10.222.0.49 () {52 vars in 829 bytes} [Mon Jul 4 04:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:07:09.983230 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4eb122-320b-4f62-b01a-b6f44c3cd2be service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:07:10.050489 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4eb122-320b-4f62-b01a-b6f44c3cd2be service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:07:10.056365 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94590fc0-862a-4711-9a2e-c0e29a6608f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:07:10.057285 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94590fc0-862a-4711-9a2e-c0e29a6608f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:07:10.057573 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94590fc0-862a-4711-9a2e-c0e29a6608f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:07:10.057860 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94590fc0-862a-4711-9a2e-c0e29a6608f7 admin admin] PATH_INFO: `/v3/users/9e3f6661a456424ea7c84f2e7b5e73bd` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:07:10.059204 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94590fc0-862a-4711-9a2e-c0e29a6608f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e3f6661a456424ea7c84f2e7b5e73bd)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:07:10.060306 dv-cinder-742162-5-smb devstack@keystone.service[80363]: WARNING py.warnings [None req-94590fc0-862a-4711-9a2e-c0e29a6608f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 04:07:10.060306 dv-cinder-742162-5-smb devstack@keystone.service[80363]: warnings.warn(msg) Jul 04 04:07:10.060306 dv-cinder-742162-5-smb devstack@keystone.service[80363]: Jul 04 04:07:10.061554 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94590fc0-862a-4711-9a2e-c0e29a6608f7 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:07:10.130469 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-94590fc0-862a-4711-9a2e-c0e29a6608f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e3f6661a456424ea7c84f2e7b5e73bd'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:07:10.131227 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-94590fc0-862a-4711-9a2e-c0e29a6608f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e3f6661a456424ea7c84f2e7b5e73bd'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:07:10.143178 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-94590fc0-862a-4711-9a2e-c0e29a6608f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e3f6661a456424ea7c84f2e7b5e73bd'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:07:10.161613 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-94590fc0-862a-4711-9a2e-c0e29a6608f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e3f6661a456424ea7c84f2e7b5e73bd'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:07:10.162375 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-94590fc0-862a-4711-9a2e-c0e29a6608f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e3f6661a456424ea7c84f2e7b5e73bd'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:07:10.170989 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:07:10.182274 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 746/1507] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:07:09 2022] DELETE /identity/v3/users/9e3f6661a456424ea7c84f2e7b5e73bd => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:07:10.186879 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0a0bc-9705-4d4b-9419-2d89ea755128 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:07:10.187176 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0a0bc-9705-4d4b-9419-2d89ea755128 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:07:10.187458 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0a0bc-9705-4d4b-9419-2d89ea755128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:07:10.204985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-39b0a0bc-9705-4d4b-9419-2d89ea755128 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:07:10.206185 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-39b0a0bc-9705-4d4b-9419-2d89ea755128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:07:10.266371 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 762/1508] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:07:10.276175 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94590fc0-862a-4711-9a2e-c0e29a6608f7 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:07:10.277684 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-94590fc0-862a-4711-9a2e-c0e29a6608f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:07:10.340203 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94590fc0-862a-4711-9a2e-c0e29a6608f7 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:07:10.344900 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8542b96-f6c7-4848-b6bc-7aced4b79dfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:07:10.345576 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8542b96-f6c7-4848-b6bc-7aced4b79dfe service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:07:10.345860 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8542b96-f6c7-4848-b6bc-7aced4b79dfe service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:07:10.346134 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8542b96-f6c7-4848-b6bc-7aced4b79dfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:07:10.356314 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8542b96-f6c7-4848-b6bc-7aced4b79dfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:07:10.357780 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8542b96-f6c7-4848-b6bc-7aced4b79dfe service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:07:10.367429 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 747/1509] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:07:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:07:10.697089 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0a0bc-9705-4d4b-9419-2d89ea755128 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:07:10.698688 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-39b0a0bc-9705-4d4b-9419-2d89ea755128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:07:10.711334 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0a0bc-9705-4d4b-9419-2d89ea755128 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:07:10.716094 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d9171-8003-41a0-8ecc-27df0172f720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:07:10.717383 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d9171-8003-41a0-8ecc-27df0172f720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:07:10.717782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d9171-8003-41a0-8ecc-27df0172f720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:07:10.718253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d9171-8003-41a0-8ecc-27df0172f720 admin admin] PATH_INFO: `/v3/projects/7ca1fd895ce24ebab4cd8845441bd330` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:07:10.719535 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d9171-8003-41a0-8ecc-27df0172f720 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ca1fd895ce24ebab4cd8845441bd330)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:07:10.720651 dv-cinder-742162-5-smb devstack@keystone.service[80362]: WARNING py.warnings [None req-287d9171-8003-41a0-8ecc-27df0172f720 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 04:07:10.720651 dv-cinder-742162-5-smb devstack@keystone.service[80362]: warnings.warn(msg) Jul 04 04:07:10.720651 dv-cinder-742162-5-smb devstack@keystone.service[80362]: Jul 04 04:07:10.722064 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d9171-8003-41a0-8ecc-27df0172f720 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:07:10.796412 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-287d9171-8003-41a0-8ecc-27df0172f720 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ca1fd895ce24ebab4cd8845441bd330', 'request_id': 'req-287d9171-8003-41a0-8ecc-27df0172f720'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:07:10.810876 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-287d9171-8003-41a0-8ecc-27df0172f720 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ca1fd895ce24ebab4cd8845441bd330', 'request_id': 'req-287d9171-8003-41a0-8ecc-27df0172f720'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:07:10.818244 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-287d9171-8003-41a0-8ecc-27df0172f720 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ca1fd895ce24ebab4cd8845441bd330', 'request_id': 'req-287d9171-8003-41a0-8ecc-27df0172f720'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:07:10.840383 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-287d9171-8003-41a0-8ecc-27df0172f720 admin admin] The token cache is being invalidate because project 7ca1fd895ce24ebab4cd8845441bd330 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:07:10.840875 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-287d9171-8003-41a0-8ecc-27df0172f720 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:07:10.841973 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-287d9171-8003-41a0-8ecc-27df0172f720 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:07:10.844789 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 763/1510] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:07:10 2022] DELETE /identity/v3/projects/7ca1fd895ce24ebab4cd8845441bd330 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:07:20.363272 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=29 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:07:20.834678 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:08:58.401242 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722d29d-92eb-43a4-baf0-907467d73618 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:08:58.402207 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722d29d-92eb-43a4-baf0-907467d73618 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:08:58.402207 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722d29d-92eb-43a4-baf0-907467d73618 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:08:58.404556 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 748/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 04:08:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:08:58.409593 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b825b-2ecc-4ae8-b434-c09966303661 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:08:58.410057 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b825b-2ecc-4ae8-b434-c09966303661 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:08:58.410176 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b825b-2ecc-4ae8-b434-c09966303661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:08:58.429848 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-564b825b-2ecc-4ae8-b434-c09966303661 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:08:58.431089 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-564b825b-2ecc-4ae8-b434-c09966303661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:08:58.494454 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 764/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 04:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:08:58.651784 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5722d29d-92eb-43a4-baf0-907467d73618 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:08:58.654274 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5722d29d-92eb-43a4-baf0-907467d73618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:08:58.735388 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5722d29d-92eb-43a4-baf0-907467d73618 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:08:58.741176 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67993a0-8785-4e9b-b298-75c9dec2eeda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:08:58.741845 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67993a0-8785-4e9b-b298-75c9dec2eeda service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:08:58.742134 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67993a0-8785-4e9b-b298-75c9dec2eeda service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:08:58.742451 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67993a0-8785-4e9b-b298-75c9dec2eeda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:08:58.751089 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67993a0-8785-4e9b-b298-75c9dec2eeda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:08:58.752723 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67993a0-8785-4e9b-b298-75c9dec2eeda service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:08:58.761976 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 749/1513] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:08:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:08:59.581204 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89c980-5e26-4df3-b037-9299af209bf1 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:08:59.582130 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89c980-5e26-4df3-b037-9299af209bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:08:59.582130 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89c980-5e26-4df3-b037-9299af209bf1 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:08:59.584469 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 765/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 04:08:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:08:59.589624 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847dbad7-b042-4b46-9623-ae80e2ba777b None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:08:59.590068 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847dbad7-b042-4b46-9623-ae80e2ba777b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:08:59.590299 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847dbad7-b042-4b46-9623-ae80e2ba777b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:08:59.613215 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-847dbad7-b042-4b46-9623-ae80e2ba777b None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:08:59.614474 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-847dbad7-b042-4b46-9623-ae80e2ba777b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:08:59.623976 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 750/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 04:08:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:08:59.781258 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89c980-5e26-4df3-b037-9299af209bf1 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:08:59.802941 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89c980-5e26-4df3-b037-9299af209bf1 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:08:59.810207 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1eb28-e3ca-402f-9701-738c6e9ca4af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:08:59.810875 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1eb28-e3ca-402f-9701-738c6e9ca4af service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:08:59.811163 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1eb28-e3ca-402f-9701-738c6e9ca4af service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:08:59.811445 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1eb28-e3ca-402f-9701-738c6e9ca4af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:08:59.820783 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab1eb28-e3ca-402f-9701-738c6e9ca4af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:08:59.822455 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab1eb28-e3ca-402f-9701-738c6e9ca4af service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:08:59.832821 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 766/1516] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:08:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:09:00.461900 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63572703-dd54-4242-81f1-c02ff6024c30 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:09:00.462193 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63572703-dd54-4242-81f1-c02ff6024c30 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:09:00.462529 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63572703-dd54-4242-81f1-c02ff6024c30 None None] PATH_INFO: `/v3` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:09:00.464265 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 751/1517] 10.222.0.43 () {54 vars in 925 bytes} [Mon Jul 4 04:09:00 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:09:00.473892 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf6c38-199a-4bf9-b00f-2f040ad770e2 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:09:00.474253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf6c38-199a-4bf9-b00f-2f040ad770e2 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:09:00.474546 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf6c38-199a-4bf9-b00f-2f040ad770e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:09:00.494324 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-7acf6c38-199a-4bf9-b00f-2f040ad770e2 None None] MFA Rules not processed for user `c2a18591461343c3a0a1b0e317734ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:09:00.495556 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7acf6c38-199a-4bf9-b00f-2f040ad770e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:09:00.569246 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 767/1518] 10.222.0.43 () {58 vars in 1015 bytes} [Mon Jul 4 04:09:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:09:09.604913 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=37 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:09:09.908677 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2490bb4-222d-4d28-8fc8-b02a6072b2f7 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:09:09.908970 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2490bb4-222d-4d28-8fc8-b02a6072b2f7 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:09:09.909286 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2490bb4-222d-4d28-8fc8-b02a6072b2f7 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:09:09.910781 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 752/1519] 10.222.0.49 () {54 vars in 960 bytes} [Mon Jul 4 04:09:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:09:09.915973 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba82fee-9431-407d-a288-fa8a30b3dafb None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:09:09.916471 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba82fee-9431-407d-a288-fa8a30b3dafb None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:09:09.916570 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba82fee-9431-407d-a288-fa8a30b3dafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:09:09.938345 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-fba82fee-9431-407d-a288-fa8a30b3dafb None None] MFA Rules not processed for user `c2a18591461343c3a0a1b0e317734ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:09:09.939584 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-fba82fee-9431-407d-a288-fa8a30b3dafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:09:09.951575 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 768/1520] 10.222.0.49 () {58 vars in 1057 bytes} [Mon Jul 4 04:09:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:09:09.959838 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2490bb4-222d-4d28-8fc8-b02a6072b2f7 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:09:09.978895 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2490bb4-222d-4d28-8fc8-b02a6072b2f7 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:09:09.984665 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae5b9e-1821-4c18-b844-802821ebe108 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a18591461343c3a0a1b0e317734ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:09:09.985330 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae5b9e-1821-4c18-b844-802821ebe108 service placement] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:09:09.985703 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae5b9e-1821-4c18-b844-802821ebe108 service placement] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:09:09.985920 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae5b9e-1821-4c18-b844-802821ebe108 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:09:09.994449 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae5b9e-1821-4c18-b844-802821ebe108 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:09:09.996059 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae5b9e-1821-4c18-b844-802821ebe108 service placement] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:09:10.006144 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 753/1521] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:09:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:09:11.062224 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01810bb6-24ab-4231-b968-b1d0ad26c547 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:09:11.063044 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01810bb6-24ab-4231-b968-b1d0ad26c547 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:09:11.063044 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01810bb6-24ab-4231-b968-b1d0ad26c547 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:09:11.064466 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 769/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 04:09:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:09:11.069595 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f8a04-6166-4cef-93f5-707596c4b45d None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:09:11.070050 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f8a04-6166-4cef-93f5-707596c4b45d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:09:11.070194 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f8a04-6166-4cef-93f5-707596c4b45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:09:11.088802 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-b29f8a04-6166-4cef-93f5-707596c4b45d None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:09:11.090020 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b29f8a04-6166-4cef-93f5-707596c4b45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:09:11.098553 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 754/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 04:09:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:09:11.254945 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01810bb6-24ab-4231-b968-b1d0ad26c547 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:09:11.271338 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01810bb6-24ab-4231-b968-b1d0ad26c547 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:09:11.277248 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78901fcd-4b66-4f5b-9422-b4c6e75775af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:09:11.277890 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78901fcd-4b66-4f5b-9422-b4c6e75775af service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:09:11.278188 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78901fcd-4b66-4f5b-9422-b4c6e75775af service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:09:11.278503 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78901fcd-4b66-4f5b-9422-b4c6e75775af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:09:11.287096 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78901fcd-4b66-4f5b-9422-b4c6e75775af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:09:11.288707 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78901fcd-4b66-4f5b-9422-b4c6e75775af service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:09:11.298305 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 770/1524] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:09:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:09:12.119664 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc62b7-3fdc-40d5-b9fa-b9506d892e5b None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:09:12.120257 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc62b7-3fdc-40d5-b9fa-b9506d892e5b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:09:12.120257 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc62b7-3fdc-40d5-b9fa-b9506d892e5b None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:09:12.122898 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 755/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 4 04:09:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:09:12.129048 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d19e2-72f2-46f5-b4c9-cfc087b2b908 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:09:12.129446 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d19e2-72f2-46f5-b4c9-cfc087b2b908 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:09:12.129662 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d19e2-72f2-46f5-b4c9-cfc087b2b908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:09:12.150412 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-dd2d19e2-72f2-46f5-b4c9-cfc087b2b908 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:09:12.151637 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-dd2d19e2-72f2-46f5-b4c9-cfc087b2b908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:09:12.163434 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 771/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 4 04:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:09:12.318102 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc62b7-3fdc-40d5-b9fa-b9506d892e5b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:09:12.339050 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc62b7-3fdc-40d5-b9fa-b9506d892e5b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:09:12.345227 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7db754-3c02-4550-9ac8-b2a394f3e969 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:09:12.345875 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7db754-3c02-4550-9ac8-b2a394f3e969 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:09:12.346185 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7db754-3c02-4550-9ac8-b2a394f3e969 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:09:12.346474 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7db754-3c02-4550-9ac8-b2a394f3e969 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:09:12.355404 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7db754-3c02-4550-9ac8-b2a394f3e969 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:09:12.357018 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7db754-3c02-4550-9ac8-b2a394f3e969 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:09:12.367262 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 756/1527] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:09:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:09:16.160904 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16467d59-c101-4012-b2f7-95968323a520 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:09:16.161847 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16467d59-c101-4012-b2f7-95968323a520 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:09:16.162109 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16467d59-c101-4012-b2f7-95968323a520 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:09:16.163833 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 772/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 04:09:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:09:16.170004 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ffa7c-3a2b-4bcd-ae14-6880137886a5 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:09:16.170004 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ffa7c-3a2b-4bcd-ae14-6880137886a5 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:09:16.170004 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ffa7c-3a2b-4bcd-ae14-6880137886a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:09:16.188854 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-8d1ffa7c-3a2b-4bcd-ae14-6880137886a5 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:09:16.190088 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-8d1ffa7c-3a2b-4bcd-ae14-6880137886a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:09:16.198525 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 757/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 04:09:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:09:16.274860 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16467d59-c101-4012-b2f7-95968323a520 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:09:16.276695 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-16467d59-c101-4012-b2f7-95968323a520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:09:16.335399 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16467d59-c101-4012-b2f7-95968323a520 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:09:16.339703 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e7aba-f6c5-4f94-ac06-5e9bdea0d627 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:09:16.340344 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e7aba-f6c5-4f94-ac06-5e9bdea0d627 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:09:16.340629 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e7aba-f6c5-4f94-ac06-5e9bdea0d627 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:09:16.340901 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e7aba-f6c5-4f94-ac06-5e9bdea0d627 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:09:16.350592 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e7aba-f6c5-4f94-ac06-5e9bdea0d627 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:09:16.352037 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e7aba-f6c5-4f94-ac06-5e9bdea0d627 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:09:16.356980 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:09:16.361809 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 773/1530] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:09:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 04:09:18.399864 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2352885-b59e-45a7-9a52-21818a186ea2 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:09:18.400715 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2352885-b59e-45a7-9a52-21818a186ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:09:18.400715 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2352885-b59e-45a7-9a52-21818a186ea2 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:09:18.403079 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 758/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 04:09:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:09:18.408433 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea5b12-c1c0-464b-9d37-cca3630cfdbf None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:09:18.408901 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea5b12-c1c0-464b-9d37-cca3630cfdbf None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:09:18.409012 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea5b12-c1c0-464b-9d37-cca3630cfdbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:09:18.430849 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-29ea5b12-c1c0-464b-9d37-cca3630cfdbf None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:09:18.432683 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-29ea5b12-c1c0-464b-9d37-cca3630cfdbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:09:18.446693 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 774/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 04:09:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:09:18.486703 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2352885-b59e-45a7-9a52-21818a186ea2 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:09:18.501184 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2352885-b59e-45a7-9a52-21818a186ea2 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:09:18.506210 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a33f7-ca8b-4e97-b104-6c4c0796baf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:09:18.506868 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a33f7-ca8b-4e97-b104-6c4c0796baf9 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:09:18.507149 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a33f7-ca8b-4e97-b104-6c4c0796baf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:09:18.507425 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a33f7-ca8b-4e97-b104-6c4c0796baf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:09:18.517698 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a33f7-ca8b-4e97-b104-6c4c0796baf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:09:18.519192 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a33f7-ca8b-4e97-b104-6c4c0796baf9 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:09:18.528715 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 759/1533] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:09:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:09:21.997051 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f29c7-b67f-4fb2-9b4e-33dd1ea1e1f7 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:09:21.997594 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f29c7-b67f-4fb2-9b4e-33dd1ea1e1f7 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:09:21.997594 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f29c7-b67f-4fb2-9b4e-33dd1ea1e1f7 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:09:21.999044 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 775/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 04:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:09:22.004532 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c1035-d4eb-483e-a046-661b759eb11a None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:09:22.004958 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c1035-d4eb-483e-a046-661b759eb11a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:09:22.005099 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c1035-d4eb-483e-a046-661b759eb11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:09:22.025345 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-9d3c1035-d4eb-483e-a046-661b759eb11a None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:09:22.026616 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9d3c1035-d4eb-483e-a046-661b759eb11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:09:22.036698 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 760/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 04:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:09:22.336996 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f29c7-b67f-4fb2-9b4e-33dd1ea1e1f7 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:09:22.340110 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-2f3f29c7-b67f-4fb2-9b4e-33dd1ea1e1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:09:22.409454 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f29c7-b67f-4fb2-9b4e-33dd1ea1e1f7 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:09:22.413755 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0387743-e98a-49ce-b318-1be1e14cc1bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:09:22.414574 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0387743-e98a-49ce-b318-1be1e14cc1bc service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:09:22.414985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0387743-e98a-49ce-b318-1be1e14cc1bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:09:22.415368 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0387743-e98a-49ce-b318-1be1e14cc1bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:09:22.427298 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0387743-e98a-49ce-b318-1be1e14cc1bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:09:22.429723 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0387743-e98a-49ce-b318-1be1e14cc1bc service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:09:22.442651 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 776/1536] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:09:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:09:24.497656 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ea2e6-edab-444b-8108-9f78a96a9f4a None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:09:24.498294 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ea2e6-edab-444b-8108-9f78a96a9f4a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:09:24.498294 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ea2e6-edab-444b-8108-9f78a96a9f4a None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:09:24.499674 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 761/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 4 04:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:09:24.506012 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c83c82-a2c0-4741-a546-0015fba59584 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:09:24.506805 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c83c82-a2c0-4741-a546-0015fba59584 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:09:24.506978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c83c82-a2c0-4741-a546-0015fba59584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:09:24.529924 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-52c83c82-a2c0-4741-a546-0015fba59584 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:09:24.531237 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-52c83c82-a2c0-4741-a546-0015fba59584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:09:24.540633 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 777/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 4 04:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:09:24.840645 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ea2e6-edab-444b-8108-9f78a96a9f4a None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:09:24.843636 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c32ea2e6-edab-444b-8108-9f78a96a9f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:09:24.857731 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ea2e6-edab-444b-8108-9f78a96a9f4a None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:09:24.861505 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfec6fa-6f68-41d0-b240-47125abbe798 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:09:24.862146 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfec6fa-6f68-41d0-b240-47125abbe798 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:09:24.862472 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfec6fa-6f68-41d0-b240-47125abbe798 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:09:24.862752 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfec6fa-6f68-41d0-b240-47125abbe798 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:09:24.871889 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfec6fa-6f68-41d0-b240-47125abbe798 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:09:24.873342 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfec6fa-6f68-41d0-b240-47125abbe798 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:09:24.882657 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 762/1539] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:09:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:09:34.524491 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=32 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:09:34.878770 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=33 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:03.020505 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad537526-888f-4f03-94e4-460fdf4a3bfe None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:03.021138 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad537526-888f-4f03-94e4-460fdf4a3bfe None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:03.021138 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad537526-888f-4f03-94e4-460fdf4a3bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:03.049846 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ad537526-888f-4f03-94e4-460fdf4a3bfe None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:03.051502 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ad537526-888f-4f03-94e4-460fdf4a3bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:03.065199 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 778/1540] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:03.074107 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c429c46-b087-4642-9e5f-598bc7e37833 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:03.074730 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c429c46-b087-4642-9e5f-598bc7e37833 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:03.074730 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c429c46-b087-4642-9e5f-598bc7e37833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:03.106664 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-9c429c46-b087-4642-9e5f-598bc7e37833 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:03.108334 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9c429c46-b087-4642-9e5f-598bc7e37833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:03.118026 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 763/1541] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:03.123527 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad537526-888f-4f03-94e4-460fdf4a3bfe None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:03.140102 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad537526-888f-4f03-94e4-460fdf4a3bfe None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:03.148059 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721de64-0a6c-44ed-bb04-5883d776ec8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:03.149198 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721de64-0a6c-44ed-bb04-5883d776ec8c admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:03.149725 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721de64-0a6c-44ed-bb04-5883d776ec8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:03.150291 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721de64-0a6c-44ed-bb04-5883d776ec8c admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:03.151396 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c721de64-0a6c-44ed-bb04-5883d776ec8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:11:03.151976 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c721de64-0a6c-44ed-bb04-5883d776ec8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:03.156805 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c721de64-0a6c-44ed-bb04-5883d776ec8c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:03.172406 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 779/1542] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:11:03.187779 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c429c46-b087-4642-9e5f-598bc7e37833 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:03.203074 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c429c46-b087-4642-9e5f-598bc7e37833 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:03.211987 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15fa87-fc84-4f21-b0b1-d9f2fd880416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:03.212689 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15fa87-fc84-4f21-b0b1-d9f2fd880416 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:03.212976 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15fa87-fc84-4f21-b0b1-d9f2fd880416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:03.213256 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15fa87-fc84-4f21-b0b1-d9f2fd880416 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:03.214037 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15fa87-fc84-4f21-b0b1-d9f2fd880416 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:03.216040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15fa87-fc84-4f21-b0b1-d9f2fd880416 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:03.264340 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 764/1543] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:11:03 2022] POST /identity/v3/projects => generated 371 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:03.268339 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721de64-0a6c-44ed-bb04-5883d776ec8c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:03.284015 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721de64-0a6c-44ed-bb04-5883d776ec8c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:03.346853 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05682f-7c66-47df-a1de-ddbfb936fb7d None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:03.347778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05682f-7c66-47df-a1de-ddbfb936fb7d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:03.348307 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05682f-7c66-47df-a1de-ddbfb936fb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:03.365664 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212956a3-ca4f-4fab-890d-a9f4e0d2e2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:03.366843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212956a3-ca4f-4fab-890d-a9f4e0d2e2ab admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:03.367152 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212956a3-ca4f-4fab-890d-a9f4e0d2e2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:03.367422 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212956a3-ca4f-4fab-890d-a9f4e0d2e2ab admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:03.368156 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212956a3-ca4f-4fab-890d-a9f4e0d2e2ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:03.372462 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-5d05682f-7c66-47df-a1de-ddbfb936fb7d None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:03.374477 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5d05682f-7c66-47df-a1de-ddbfb936fb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:03.376723 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212956a3-ca4f-4fab-890d-a9f4e0d2e2ab admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:03.389731 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 765/1544] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:03.403537 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3e09e-7669-43e2-96bd-667f5f696d33 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:03.404606 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3e09e-7669-43e2-96bd-667f5f696d33 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:03.405122 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3e09e-7669-43e2-96bd-667f5f696d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:03.413872 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 780/1545] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:11:03 2022] POST /identity/v3/users => generated 286 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:03.422186 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212956a3-ca4f-4fab-890d-a9f4e0d2e2ab admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:03.436395 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-eab3e09e-7669-43e2-96bd-667f5f696d33 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:03.437992 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-eab3e09e-7669-43e2-96bd-667f5f696d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:03.444079 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212956a3-ca4f-4fab-890d-a9f4e0d2e2ab admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:03.453199 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca260f-7ee7-4cc4-9601-e7ee75d9c31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:03.453940 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca260f-7ee7-4cc4-9601-e7ee75d9c31e admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:03.454215 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 766/1546] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:03.454354 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca260f-7ee7-4cc4-9601-e7ee75d9c31e admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:03.454565 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca260f-7ee7-4cc4-9601-e7ee75d9c31e admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:03.459343 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca260f-7ee7-4cc4-9601-e7ee75d9c31e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:03.459343 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca260f-7ee7-4cc4-9601-e7ee75d9c31e admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:03.461090 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3e09e-7669-43e2-96bd-667f5f696d33 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:03.471894 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3e09e-7669-43e2-96bd-667f5f696d33 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:03.484340 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c90441-c7dc-4ff7-83b7-75e7b59953d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:03.485377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c90441-c7dc-4ff7-83b7-75e7b59953d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:03.485914 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c90441-c7dc-4ff7-83b7-75e7b59953d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:03.486440 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c90441-c7dc-4ff7-83b7-75e7b59953d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:03.487434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c90441-c7dc-4ff7-83b7-75e7b59953d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:11:03.487975 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c90441-c7dc-4ff7-83b7-75e7b59953d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:03.489321 dv-cinder-742162-5-smb devstack@keystone.service[80363]: WARNING py.warnings [None req-45c90441-c7dc-4ff7-83b7-75e7b59953d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 04:11:03.489321 dv-cinder-742162-5-smb devstack@keystone.service[80363]: warnings.warn(msg) Jul 04 04:11:03.489321 dv-cinder-742162-5-smb devstack@keystone.service[80363]: Jul 04 04:11:03.490881 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c90441-c7dc-4ff7-83b7-75e7b59953d1 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:03.494607 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 781/1547] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 04:11:03.495765 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad26a7-6118-4ef1-b1f8-3b2450bc174c None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:03.496067 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad26a7-6118-4ef1-b1f8-3b2450bc174c None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:03.496353 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad26a7-6118-4ef1-b1f8-3b2450bc174c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:03.506912 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 767/1548] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:11:03.508079 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c90441-c7dc-4ff7-83b7-75e7b59953d1 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:03.522939 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c90441-c7dc-4ff7-83b7-75e7b59953d1 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:03.532738 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb6815-b324-448b-a2ad-bb18947e1256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:03.534024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb6815-b324-448b-a2ad-bb18947e1256 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:03.534563 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb6815-b324-448b-a2ad-bb18947e1256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:03.535055 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb6815-b324-448b-a2ad-bb18947e1256 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:03.536022 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb6815-b324-448b-a2ad-bb18947e1256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:03.537988 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb6815-b324-448b-a2ad-bb18947e1256 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:03.550142 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 768/1549] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:03.551854 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1c81f-407f-4eca-8aef-f485aa91fcb2 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:03.552351 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1c81f-407f-4eca-8aef-f485aa91fcb2 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:03.552832 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1c81f-407f-4eca-8aef-f485aa91fcb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:03.558667 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-87ad26a7-6118-4ef1-b1f8-3b2450bc174c None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:03.559920 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-87ad26a7-6118-4ef1-b1f8-3b2450bc174c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:03.576188 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-26c1c81f-407f-4eca-8aef-f485aa91fcb2 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:03.577380 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-26c1c81f-407f-4eca-8aef-f485aa91fcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:03.579723 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 782/1550] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:03.580558 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad26a7-6118-4ef1-b1f8-3b2450bc174c None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:03.601778 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad26a7-6118-4ef1-b1f8-3b2450bc174c None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:03.606966 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 769/1551] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:03.607866 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1c81f-407f-4eca-8aef-f485aa91fcb2 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:03.616312 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386d9c5-d53c-4461-9779-12f89993f6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:03.616996 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386d9c5-d53c-4461-9779-12f89993f6c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:03.617288 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386d9c5-d53c-4461-9779-12f89993f6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:03.617573 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386d9c5-d53c-4461-9779-12f89993f6c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:03.619671 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0386d9c5-d53c-4461-9779-12f89993f6c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:03.621666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: WARNING py.warnings [None req-0386d9c5-d53c-4461-9779-12f89993f6c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 04:11:03.621666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: warnings.warn(msg) Jul 04 04:11:03.621666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: Jul 04 04:11:03.623538 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0386d9c5-d53c-4461-9779-12f89993f6c5 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:03.625269 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1c81f-407f-4eca-8aef-f485aa91fcb2 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:03.633742 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832c4e9-835d-46c6-ae3b-e22ee542647c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:03.634801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832c4e9-835d-46c6-ae3b-e22ee542647c admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:03.635093 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832c4e9-835d-46c6-ae3b-e22ee542647c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:03.635431 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832c4e9-835d-46c6-ae3b-e22ee542647c admin admin] PATH_INFO: `/v3/projects/5210a0c2351e4c3190dba6677cbb1af9/users/3b120e8522b54a38a2f140c56cca554b/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:03.652560 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832c4e9-835d-46c6-ae3b-e22ee542647c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5210a0c2351e4c3190dba6677cbb1af9, user_id=3b120e8522b54a38a2f140c56cca554b, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:03.656034 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832c4e9-835d-46c6-ae3b-e22ee542647c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:03.663159 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 783/1552] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:11:03 2022] POST /identity/v3/projects => generated 373 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:03.664858 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab00b3-c9aa-4c69-9679-9e49b560769d None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:03.665156 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab00b3-c9aa-4c69-9679-9e49b560769d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:03.665448 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab00b3-c9aa-4c69-9679-9e49b560769d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:03.670229 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 770/1553] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:03 2022] PUT /identity/v3/projects/5210a0c2351e4c3190dba6677cbb1af9/users/3b120e8522b54a38a2f140c56cca554b/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:03.671477 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92020afe-dd8c-4e9e-9e1a-9be2924bd0f3 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:03.671771 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92020afe-dd8c-4e9e-9e1a-9be2924bd0f3 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:03.672054 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92020afe-dd8c-4e9e-9e1a-9be2924bd0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:03.692013 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-f3ab00b3-c9aa-4c69-9679-9e49b560769d None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:03.693309 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f3ab00b3-c9aa-4c69-9679-9e49b560769d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:03.699790 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-92020afe-dd8c-4e9e-9e1a-9be2924bd0f3 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:03.701319 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-92020afe-dd8c-4e9e-9e1a-9be2924bd0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:03.753464 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 784/1554] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:03.755228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2505b5-0009-4589-b579-e00e1ef8a8c7 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:03.755736 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2505b5-0009-4589-b579-e00e1ef8a8c7 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:03.756207 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2505b5-0009-4589-b579-e00e1ef8a8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:03.761333 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 771/1555] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:03.762763 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b1bb2-ab4b-46ef-9d60-e4913350e6ac None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:03.763096 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b1bb2-ab4b-46ef-9d60-e4913350e6ac None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:03.763375 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b1bb2-ab4b-46ef-9d60-e4913350e6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:03.777215 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ba2505b5-0009-4589-b579-e00e1ef8a8c7 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:03.778396 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ba2505b5-0009-4589-b579-e00e1ef8a8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:03.781592 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-3b2b1bb2-ab4b-46ef-9d60-e4913350e6ac None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:03.782853 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3b2b1bb2-ab4b-46ef-9d60-e4913350e6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:03.786286 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 785/1556] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:03.787510 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e1909-ae6d-448c-ab35-4af53c2951e2 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:03.787802 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e1909-ae6d-448c-ab35-4af53c2951e2 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:03.788083 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e1909-ae6d-448c-ab35-4af53c2951e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:03.791228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 772/1557] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:03.792070 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b1bb2-ab4b-46ef-9d60-e4913350e6ac None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:03.801413 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b1bb2-ab4b-46ef-9d60-e4913350e6ac None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:03.806595 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176233a3-2b06-43ad-9f9f-427574da625e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:03.807322 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176233a3-2b06-43ad-9f9f-427574da625e admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:03.807609 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176233a3-2b06-43ad-9f9f-427574da625e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:03.807895 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176233a3-2b06-43ad-9f9f-427574da625e admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:03.808591 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176233a3-2b06-43ad-9f9f-427574da625e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:03.809638 dv-cinder-742162-5-smb devstack@keystone.service[80363]: WARNING py.warnings [None req-176233a3-2b06-43ad-9f9f-427574da625e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 04:11:03.809638 dv-cinder-742162-5-smb devstack@keystone.service[80363]: warnings.warn(msg) Jul 04 04:11:03.809638 dv-cinder-742162-5-smb devstack@keystone.service[80363]: Jul 04 04:11:03.809926 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-c14e1909-ae6d-448c-ab35-4af53c2951e2 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:03.810893 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176233a3-2b06-43ad-9f9f-427574da625e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:03.811055 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c14e1909-ae6d-448c-ab35-4af53c2951e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:03.820262 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 786/1558] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:03.821641 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac1b44-c28d-4e3b-8cc2-140c7a124a28 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:03.821935 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac1b44-c28d-4e3b-8cc2-140c7a124a28 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:03.822277 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac1b44-c28d-4e3b-8cc2-140c7a124a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:03.836915 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 773/1559] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:11:03 2022] POST /identity/v3/users => generated 287 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:03.838236 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72318ad9-dda1-4c84-9c4a-2510ceeab6ab None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:03.838661 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72318ad9-dda1-4c84-9c4a-2510ceeab6ab None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:03.838947 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72318ad9-dda1-4c84-9c4a-2510ceeab6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:03.851353 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-96ac1b44-c28d-4e3b-8cc2-140c7a124a28 None None] MFA Rules not processed for user `3b120e8522b54a38a2f140c56cca554b`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:03.852566 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-96ac1b44-c28d-4e3b-8cc2-140c7a124a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:03.857815 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:03.858115 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-72318ad9-dda1-4c84-9c4a-2510ceeab6ab None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:03.859376 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-72318ad9-dda1-4c84-9c4a-2510ceeab6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:03.869249 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 774/1560] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:03.870581 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bb367-569a-4f65-8c5c-396bd7261303 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:03.870869 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bb367-569a-4f65-8c5c-396bd7261303 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:03.871149 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bb367-569a-4f65-8c5c-396bd7261303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:03.891335 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-0f0bb367-569a-4f65-8c5c-396bd7261303 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:03.892527 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0f0bb367-569a-4f65-8c5c-396bd7261303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:03.904355 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 775/1561] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:03.904355 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0bb367-569a-4f65-8c5c-396bd7261303 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:03.910874 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0bb367-569a-4f65-8c5c-396bd7261303 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:03.915802 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119e147-bdea-4ec3-b3b9-dd06ba483756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:03.916585 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119e147-bdea-4ec3-b3b9-dd06ba483756 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:03.916967 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119e147-bdea-4ec3-b3b9-dd06ba483756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:03.917253 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119e147-bdea-4ec3-b3b9-dd06ba483756 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:03.918022 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119e147-bdea-4ec3-b3b9-dd06ba483756 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:11:03.918425 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119e147-bdea-4ec3-b3b9-dd06ba483756 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:03.920476 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119e147-bdea-4ec3-b3b9-dd06ba483756 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:03.921682 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 787/1562] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:03.922634 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac1b44-c28d-4e3b-8cc2-140c7a124a28 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:03.941769 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 776/1563] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:11:03.941769 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2afd7e-2b02-4464-8253-0110e3207374 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:03.941769 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2afd7e-2b02-4464-8253-0110e3207374 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:03.941769 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2afd7e-2b02-4464-8253-0110e3207374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:03.942240 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac1b44-c28d-4e3b-8cc2-140c7a124a28 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:03.944167 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5eb3a5-76d1-4eae-9b24-8f1bd5c2e162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:03.944809 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5eb3a5-76d1-4eae-9b24-8f1bd5c2e162 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:03.945130 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5eb3a5-76d1-4eae-9b24-8f1bd5c2e162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:03.945410 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5eb3a5-76d1-4eae-9b24-8f1bd5c2e162 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:03.946131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5eb3a5-76d1-4eae-9b24-8f1bd5c2e162 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:11:03.946482 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5eb3a5-76d1-4eae-9b24-8f1bd5c2e162 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:03.948213 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5eb3a5-76d1-4eae-9b24-8f1bd5c2e162 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:03.958716 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-2e2afd7e-2b02-4464-8253-0110e3207374 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:03.960174 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-2e2afd7e-2b02-4464-8253-0110e3207374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:03.968167 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 788/1564] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:11:03.968167 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d7484-0ddd-4c2a-a3ba-cdfe103dde69 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:03.968167 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d7484-0ddd-4c2a-a3ba-cdfe103dde69 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:03.968167 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d7484-0ddd-4c2a-a3ba-cdfe103dde69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:03.980785 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 777/1565] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:03.984706 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2afd7e-2b02-4464-8253-0110e3207374 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:03.984901 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-bc7d7484-0ddd-4c2a-a3ba-cdfe103dde69 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:03.985788 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-bc7d7484-0ddd-4c2a-a3ba-cdfe103dde69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:03.994884 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 789/1566] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:03.995977 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2afd7e-2b02-4464-8253-0110e3207374 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:03.996338 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437d801-abf0-41df-939f-07e0c8334388 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:03.996768 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437d801-abf0-41df-939f-07e0c8334388 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:03.997051 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437d801-abf0-41df-939f-07e0c8334388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:04.002089 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2888ed-2aa9-4f59-a0a8-e9cbe5200b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:04.002791 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2888ed-2aa9-4f59-a0a8-e9cbe5200b1f admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:04.003278 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2888ed-2aa9-4f59-a0a8-e9cbe5200b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:04.003571 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2888ed-2aa9-4f59-a0a8-e9cbe5200b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:04.005197 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2888ed-2aa9-4f59-a0a8-e9cbe5200b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:04.006899 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2888ed-2aa9-4f59-a0a8-e9cbe5200b1f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:04.008381 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:04.014947 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-d437d801-abf0-41df-939f-07e0c8334388 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:04.016131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d437d801-abf0-41df-939f-07e0c8334388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:04.019530 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 778/1567] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:04.020245 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2888ed-2aa9-4f59-a0a8-e9cbe5200b1f admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:04.026903 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 790/1568] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:04.027756 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437d801-abf0-41df-939f-07e0c8334388 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:04.030521 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2888ed-2aa9-4f59-a0a8-e9cbe5200b1f admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:04.035318 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49e262-552b-4f83-bbe0-b70760b18a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:04.035968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49e262-552b-4f83-bbe0-b70760b18a9a admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:04.036249 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49e262-552b-4f83-bbe0-b70760b18a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:04.036526 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49e262-552b-4f83-bbe0-b70760b18a9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:04.037081 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437d801-abf0-41df-939f-07e0c8334388 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:04.037273 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49e262-552b-4f83-bbe0-b70760b18a9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:11:04.037582 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49e262-552b-4f83-bbe0-b70760b18a9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:04.039264 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49e262-552b-4f83-bbe0-b70760b18a9a admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:04.041830 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e90a6-ede4-4d1d-9ba9-81c2db88ba81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:04.042571 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e90a6-ede4-4d1d-9ba9-81c2db88ba81 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:04.042856 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e90a6-ede4-4d1d-9ba9-81c2db88ba81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:04.043131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e90a6-ede4-4d1d-9ba9-81c2db88ba81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:04.043823 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326e90a6-ede4-4d1d-9ba9-81c2db88ba81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:04.045715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326e90a6-ede4-4d1d-9ba9-81c2db88ba81 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:04.059089 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 779/1569] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:11:04.059089 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30631c-44dc-4c92-af0e-061d0996beaf None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:04.059089 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30631c-44dc-4c92-af0e-061d0996beaf None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:04.059089 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30631c-44dc-4c92-af0e-061d0996beaf None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:04.059089 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 780/1570] 10.222.0.49 () {54 vars in 961 bytes} [Mon Jul 4 04:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:11:04.059089 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30631c-44dc-4c92-af0e-061d0996beaf None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:04.069345 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30631c-44dc-4c92-af0e-061d0996beaf None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:04.076483 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 791/1571] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:11:04 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:04.076636 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e660d-9bad-4c84-92d5-f17d0c999855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:04.077112 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e90a6-ede4-4d1d-9ba9-81c2db88ba81 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:04.077216 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e660d-9bad-4c84-92d5-f17d0c999855 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:04.077216 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e660d-9bad-4c84-92d5-f17d0c999855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:04.077216 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e660d-9bad-4c84-92d5-f17d0c999855 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:04.077216 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e660d-9bad-4c84-92d5-f17d0c999855 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:04.077645 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e660d-9bad-4c84-92d5-f17d0c999855 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:04.104148 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 781/1572] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:11:04 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:04.104148 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e660d-9bad-4c84-92d5-f17d0c999855 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:04.137553 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e90a6-ede4-4d1d-9ba9-81c2db88ba81 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:04.166380 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e660d-9bad-4c84-92d5-f17d0c999855 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:04.171193 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65295854-690f-4e7c-a0d1-7760b7192030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:04.171881 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65295854-690f-4e7c-a0d1-7760b7192030 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:04.172188 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65295854-690f-4e7c-a0d1-7760b7192030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:04.172471 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65295854-690f-4e7c-a0d1-7760b7192030 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:04.173297 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65295854-690f-4e7c-a0d1-7760b7192030 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:11:04.173617 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65295854-690f-4e7c-a0d1-7760b7192030 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:04.175328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65295854-690f-4e7c-a0d1-7760b7192030 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:04.187333 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 782/1573] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:11:04.188435 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65295854-690f-4e7c-a0d1-7760b7192030 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:04.197299 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08f126-bb3e-41be-ac5f-0df52bba9409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:04.198043 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08f126-bb3e-41be-ac5f-0df52bba9409 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:04.198379 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08f126-bb3e-41be-ac5f-0df52bba9409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:04.198662 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08f126-bb3e-41be-ac5f-0df52bba9409 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:04.199402 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a08f126-bb3e-41be-ac5f-0df52bba9409 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:11:04.199714 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a08f126-bb3e-41be-ac5f-0df52bba9409 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:04.201388 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a08f126-bb3e-41be-ac5f-0df52bba9409 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:04.202130 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65295854-690f-4e7c-a0d1-7760b7192030 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:04.206758 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ac737-6ff4-456c-9453-029ac5053d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:04.207402 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ac737-6ff4-456c-9453-029ac5053d6d admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:04.207686 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ac737-6ff4-456c-9453-029ac5053d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:04.207968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ac737-6ff4-456c-9453-029ac5053d6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:04.208683 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ac737-6ff4-456c-9453-029ac5053d6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:04.210014 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:04.210297 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ac737-6ff4-456c-9453-029ac5053d6d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:04.214986 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 792/1574] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:11:04.215961 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08f126-bb3e-41be-ac5f-0df52bba9409 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:04.227076 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08f126-bb3e-41be-ac5f-0df52bba9409 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:04.228107 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 783/1575] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:04.228904 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ac737-6ff4-456c-9453-029ac5053d6d admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:04.232131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f97a4-4ca1-4779-bc64-73335c415cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:04.232784 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f97a4-4ca1-4779-bc64-73335c415cbd admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:04.233073 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f97a4-4ca1-4779-bc64-73335c415cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:04.233385 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f97a4-4ca1-4779-bc64-73335c415cbd admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:04.234187 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f97a4-4ca1-4779-bc64-73335c415cbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:11:04.234505 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f97a4-4ca1-4779-bc64-73335c415cbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:04.236119 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f97a4-4ca1-4779-bc64-73335c415cbd admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:04.238813 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ac737-6ff4-456c-9453-029ac5053d6d admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:04.243023 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d23759-5e35-45c8-8f75-5459572c7891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:04.243965 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d23759-5e35-45c8-8f75-5459572c7891 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:04.244254 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d23759-5e35-45c8-8f75-5459572c7891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:04.244537 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d23759-5e35-45c8-8f75-5459572c7891 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:04.245294 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d23759-5e35-45c8-8f75-5459572c7891 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:04.247296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d23759-5e35-45c8-8f75-5459572c7891 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:04.249082 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 793/1576] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:11:04.250111 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c9d72-1728-4d92-a9e6-1c80bce88cad None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:04.250426 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c9d72-1728-4d92-a9e6-1c80bce88cad None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:04.250711 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c9d72-1728-4d92-a9e6-1c80bce88cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:04.273079 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-568c9d72-1728-4d92-a9e6-1c80bce88cad None None] MFA Rules not processed for user `8334e75253f843a980b01c6f0cda6015`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:04.274325 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-568c9d72-1728-4d92-a9e6-1c80bce88cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:04.275446 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 784/1577] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:11:04 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:04.276480 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d23759-5e35-45c8-8f75-5459572c7891 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:04.339033 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d23759-5e35-45c8-8f75-5459572c7891 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:04.342347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 794/1578] 10.222.0.49 () {58 vars in 1058 bytes} [Mon Jul 4 04:11:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:04.343223 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568c9d72-1728-4d92-a9e6-1c80bce88cad None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:04.348230 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506d366-2d93-43a2-b1a3-c096e5ac9c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:04.349662 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506d366-2d93-43a2-b1a3-c096e5ac9c46 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:04.349961 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506d366-2d93-43a2-b1a3-c096e5ac9c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:04.350277 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506d366-2d93-43a2-b1a3-c096e5ac9c46 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:04.350977 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506d366-2d93-43a2-b1a3-c096e5ac9c46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:04.352856 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568c9d72-1728-4d92-a9e6-1c80bce88cad None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:04.352983 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506d366-2d93-43a2-b1a3-c096e5ac9c46 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:04.357390 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b4ed6-2922-455f-bdef-21a177a71d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:04.358040 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b4ed6-2922-455f-bdef-21a177a71d95 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:04.358368 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b4ed6-2922-455f-bdef-21a177a71d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:04.358667 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b4ed6-2922-455f-bdef-21a177a71d95 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:04.359355 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b4ed6-2922-455f-bdef-21a177a71d95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:04.361643 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b4ed6-2922-455f-bdef-21a177a71d95 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:04.374096 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 785/1579] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:11:04 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:04.375224 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506d366-2d93-43a2-b1a3-c096e5ac9c46 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:04.384695 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 795/1580] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:11:04 2022] POST /identity/v3/users => generated 289 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:04.385219 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506d366-2d93-43a2-b1a3-c096e5ac9c46 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:04.388406 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b4ed6-2922-455f-bdef-21a177a71d95 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:04.390112 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded9160-93d3-4612-8a67-094099f7f159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:04.390864 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded9160-93d3-4612-8a67-094099f7f159 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:04.391227 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded9160-93d3-4612-8a67-094099f7f159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:04.391577 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded9160-93d3-4612-8a67-094099f7f159 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:04.392337 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded9160-93d3-4612-8a67-094099f7f159 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:04.394351 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded9160-93d3-4612-8a67-094099f7f159 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:04.397690 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b4ed6-2922-455f-bdef-21a177a71d95 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:04.402349 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31953a-1b6f-4c70-ac92-d21aac292f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:04.402999 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31953a-1b6f-4c70-ac92-d21aac292f0a admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:04.403280 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31953a-1b6f-4c70-ac92-d21aac292f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:04.403556 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31953a-1b6f-4c70-ac92-d21aac292f0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:04.404238 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31953a-1b6f-4c70-ac92-d21aac292f0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:04.404847 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:04.406191 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31953a-1b6f-4c70-ac92-d21aac292f0a admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:04.427022 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 786/1581] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:11:04 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:04.428026 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded9160-93d3-4612-8a67-094099f7f159 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:04.442785 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 796/1582] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:11:04 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:04.442785 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31953a-1b6f-4c70-ac92-d21aac292f0a admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:04.499467 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded9160-93d3-4612-8a67-094099f7f159 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:04.503714 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31953a-1b6f-4c70-ac92-d21aac292f0a admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:04.504201 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ecba1-6502-49b1-96d8-032c214f2e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:04.505156 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ecba1-6502-49b1-96d8-032c214f2e94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:04.505390 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ecba1-6502-49b1-96d8-032c214f2e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:04.505669 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ecba1-6502-49b1-96d8-032c214f2e94 admin admin] PATH_INFO: `/v3/projects/1a42a994d2ae4cbebd6e2c2c8cab4800/users/7e5e63f04e504da6a20dd020d1b241eb/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:04.508508 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b41a56-dda0-40c7-aa75-e7c9a2f9c11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:04.509172 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b41a56-dda0-40c7-aa75-e7c9a2f9c11e admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:04.509463 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b41a56-dda0-40c7-aa75-e7c9a2f9c11e admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:04.509747 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b41a56-dda0-40c7-aa75-e7c9a2f9c11e admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:04.510528 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b41a56-dda0-40c7-aa75-e7c9a2f9c11e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:04.512520 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b41a56-dda0-40c7-aa75-e7c9a2f9c11e admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:04.520879 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5ecba1-6502-49b1-96d8-032c214f2e94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a42a994d2ae4cbebd6e2c2c8cab4800, user_id=7e5e63f04e504da6a20dd020d1b241eb, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:04.523608 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5ecba1-6502-49b1-96d8-032c214f2e94 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:04.538801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 787/1583] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:04 2022] PUT /identity/v3/projects/1a42a994d2ae4cbebd6e2c2c8cab4800/users/7e5e63f04e504da6a20dd020d1b241eb/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:04.539830 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ecba1-6502-49b1-96d8-032c214f2e94 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:04.539991 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 797/1584] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:11:04 2022] POST /identity/v3/projects => generated 393 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:04.543885 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b41a56-dda0-40c7-aa75-e7c9a2f9c11e admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:04.575286 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:04.606243 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ecba1-6502-49b1-96d8-032c214f2e94 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:04.623021 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b41a56-dda0-40c7-aa75-e7c9a2f9c11e admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:04.628477 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e814a-99d5-4b18-a593-6aa1a2688f2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:04.629214 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e814a-99d5-4b18-a593-6aa1a2688f2a service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:04.629498 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e814a-99d5-4b18-a593-6aa1a2688f2a service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:04.629771 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e814a-99d5-4b18-a593-6aa1a2688f2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:04.666239 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720acfaa-1162-46ad-89b8-78cab9872fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:04.666983 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720acfaa-1162-46ad-89b8-78cab9872fec admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:04.667280 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720acfaa-1162-46ad-89b8-78cab9872fec admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:04.667565 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720acfaa-1162-46ad-89b8-78cab9872fec admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:04.668266 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720acfaa-1162-46ad-89b8-78cab9872fec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:04.670288 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720acfaa-1162-46ad-89b8-78cab9872fec admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:04.687833 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e814a-99d5-4b18-a593-6aa1a2688f2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:04.689439 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e814a-99d5-4b18-a593-6aa1a2688f2a service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:04.694339 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 788/1585] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:11:04 2022] POST /identity/v3/users => generated 292 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:04.694339 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720acfaa-1162-46ad-89b8-78cab9872fec admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:04.698819 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 798/1586] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:04.699585 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e814a-99d5-4b18-a593-6aa1a2688f2a service nova] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:04.702941 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720acfaa-1162-46ad-89b8-78cab9872fec admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:04.708129 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b6fddc-2b02-49ed-a497-7cd4b3861881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:04.708826 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6fddc-2b02-49ed-a497-7cd4b3861881 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:04.709087 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e814a-99d5-4b18-a593-6aa1a2688f2a service nova] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:04.709364 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6fddc-2b02-49ed-a497-7cd4b3861881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:04.709653 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6fddc-2b02-49ed-a497-7cd4b3861881 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:04.710432 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b6fddc-2b02-49ed-a497-7cd4b3861881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:04.712098 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b6fddc-2b02-49ed-a497-7cd4b3861881 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:04.713872 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68aa69-1aa1-40a1-8869-8f17d06e4926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:04.714543 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68aa69-1aa1-40a1-8869-8f17d06e4926 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:04.714676 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:04.714828 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68aa69-1aa1-40a1-8869-8f17d06e4926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:04.715105 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68aa69-1aa1-40a1-8869-8f17d06e4926 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:04.715884 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68aa69-1aa1-40a1-8869-8f17d06e4926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:04.717851 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68aa69-1aa1-40a1-8869-8f17d06e4926 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:04.727727 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 789/1587] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:04.728752 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b6fddc-2b02-49ed-a497-7cd4b3861881 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:04.728890 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 799/1588] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:04.731643 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68aa69-1aa1-40a1-8869-8f17d06e4926 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:04.738855 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b6fddc-2b02-49ed-a497-7cd4b3861881 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:04.744513 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68aa69-1aa1-40a1-8869-8f17d06e4926 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:04.744646 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2576f-f761-41a5-b6d5-7c214a374938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:04.745214 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2576f-f761-41a5-b6d5-7c214a374938 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:04.745507 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2576f-f761-41a5-b6d5-7c214a374938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:04.745797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2576f-f761-41a5-b6d5-7c214a374938 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:04.746521 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c2576f-f761-41a5-b6d5-7c214a374938 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:04.748455 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c2576f-f761-41a5-b6d5-7c214a374938 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:04.751223 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a036871-7241-4d4c-827b-385fe2037420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:04.752053 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a036871-7241-4d4c-827b-385fe2037420 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:04.752496 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a036871-7241-4d4c-827b-385fe2037420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:04.752929 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a036871-7241-4d4c-827b-385fe2037420 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:04.753789 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a036871-7241-4d4c-827b-385fe2037420 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:04.755995 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a036871-7241-4d4c-827b-385fe2037420 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:04.772377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 790/1589] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:11:04 2022] POST /identity/v3/users => generated 294 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:04.773492 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2576f-f761-41a5-b6d5-7c214a374938 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:04.782323 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 800/1590] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:11:04 2022] POST /identity/v3/users => generated 283 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:04.783948 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b779f3-ef71-4d9a-a983-40ffd84cccd8 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:04.784073 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2576f-f761-41a5-b6d5-7c214a374938 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:04.784515 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b779f3-ef71-4d9a-a983-40ffd84cccd8 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:04.785123 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b779f3-ef71-4d9a-a983-40ffd84cccd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:04.788869 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23336012-b18b-466b-b971-67db056911b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:04.789548 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23336012-b18b-466b-b971-67db056911b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:04.789841 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23336012-b18b-466b-b971-67db056911b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:04.790127 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23336012-b18b-466b-b971-67db056911b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:04.790870 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23336012-b18b-466b-b971-67db056911b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:04.792968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23336012-b18b-466b-b971-67db056911b0 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:04.820807 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-b4b779f3-ef71-4d9a-a983-40ffd84cccd8 None None] MFA Rules not processed for user `7e5e63f04e504da6a20dd020d1b241eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:04.822107 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b4b779f3-ef71-4d9a-a983-40ffd84cccd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:04.824138 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 791/1591] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:11:04 2022] POST /identity/v3/users => generated 297 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:04.825217 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23336012-b18b-466b-b971-67db056911b0 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:04.836470 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23336012-b18b-466b-b971-67db056911b0 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:04.841572 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317ffc0-090a-4e3a-8ed1-3a64d5924ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:04.842601 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317ffc0-090a-4e3a-8ed1-3a64d5924ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:04.843057 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317ffc0-090a-4e3a-8ed1-3a64d5924ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:04.843336 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317ffc0-090a-4e3a-8ed1-3a64d5924ac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:04.844080 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8317ffc0-090a-4e3a-8ed1-3a64d5924ac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:04.845722 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8317ffc0-090a-4e3a-8ed1-3a64d5924ac9 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:04.859607 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 792/1592] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:04.859607 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317ffc0-090a-4e3a-8ed1-3a64d5924ac9 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:04.868348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317ffc0-090a-4e3a-8ed1-3a64d5924ac9 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:04.873573 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0768017-9c7c-4543-b65b-3a3fa74e5e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:04.874268 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0768017-9c7c-4543-b65b-3a3fa74e5e59 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:04.874565 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0768017-9c7c-4543-b65b-3a3fa74e5e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:04.874847 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0768017-9c7c-4543-b65b-3a3fa74e5e59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:04.875581 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0768017-9c7c-4543-b65b-3a3fa74e5e59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:04.877187 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0768017-9c7c-4543-b65b-3a3fa74e5e59 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:04.888867 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 793/1593] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:04.889593 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0768017-9c7c-4543-b65b-3a3fa74e5e59 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:04.900555 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 801/1594] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:04.901227 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0768017-9c7c-4543-b65b-3a3fa74e5e59 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:04.902712 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b779f3-ef71-4d9a-a983-40ffd84cccd8 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:04.908499 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd018b8-adf4-4361-a356-edca79b260ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:04.909387 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd018b8-adf4-4361-a356-edca79b260ed admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:04.909881 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd018b8-adf4-4361-a356-edca79b260ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:04.910370 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd018b8-adf4-4361-a356-edca79b260ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:04.911256 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd018b8-adf4-4361-a356-edca79b260ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:04.913483 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd018b8-adf4-4361-a356-edca79b260ed admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:04.916439 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b779f3-ef71-4d9a-a983-40ffd84cccd8 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:04.923912 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86448a3-c9ad-4ece-920d-176c6d4cadcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:04.924949 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86448a3-c9ad-4ece-920d-176c6d4cadcf admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:04.925307 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86448a3-c9ad-4ece-920d-176c6d4cadcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:04.925685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86448a3-c9ad-4ece-920d-176c6d4cadcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:04.926568 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86448a3-c9ad-4ece-920d-176c6d4cadcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:04.928210 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 794/1595] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:04.929159 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd018b8-adf4-4361-a356-edca79b260ed admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:04.930788 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86448a3-c9ad-4ece-920d-176c6d4cadcf admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:04.945320 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd018b8-adf4-4361-a356-edca79b260ed admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:04.946842 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 802/1596] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:04.951658 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86448a3-c9ad-4ece-920d-176c6d4cadcf admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:04.952139 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d10b7-16d8-41d9-9d46-6c6a7e2f5ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:04.952754 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d10b7-16d8-41d9-9d46-6c6a7e2f5ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:04.953037 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d10b7-16d8-41d9-9d46-6c6a7e2f5ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:04.953313 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d10b7-16d8-41d9-9d46-6c6a7e2f5ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:04.954053 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d10b7-16d8-41d9-9d46-6c6a7e2f5ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:04.955773 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d10b7-16d8-41d9-9d46-6c6a7e2f5ce9 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:04.964546 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86448a3-c9ad-4ece-920d-176c6d4cadcf admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:04.970020 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ed79c-b58b-4f1d-9075-7e854a7ff092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:04.971635 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ed79c-b58b-4f1d-9075-7e854a7ff092 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:04.971736 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 795/1597] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:04.971838 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ed79c-b58b-4f1d-9075-7e854a7ff092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:04.971838 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ed79c-b58b-4f1d-9075-7e854a7ff092 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:04.972200 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d10b7-16d8-41d9-9d46-6c6a7e2f5ce9 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:04.972297 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ed79c-b58b-4f1d-9075-7e854a7ff092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:04.974195 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ed79c-b58b-4f1d-9075-7e854a7ff092 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:04.979837 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:04.984159 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d10b7-16d8-41d9-9d46-6c6a7e2f5ce9 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:04.989783 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 803/1598] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:04.989912 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759681dd-b454-46b0-9463-c674a2bdf530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:04.990519 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759681dd-b454-46b0-9463-c674a2bdf530 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:04.990808 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759681dd-b454-46b0-9463-c674a2bdf530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:04.990954 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ed79c-b58b-4f1d-9075-7e854a7ff092 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:04.991220 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759681dd-b454-46b0-9463-c674a2bdf530 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:04.991958 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759681dd-b454-46b0-9463-c674a2bdf530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:04.994111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759681dd-b454-46b0-9463-c674a2bdf530 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:05.003103 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ed79c-b58b-4f1d-9075-7e854a7ff092 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:05.007801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 796/1599] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:05.007801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759681dd-b454-46b0-9463-c674a2bdf530 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:05.009664 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f3b8f-0d79-49d8-ba00-1f87666362f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:05.010779 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f3b8f-0d79-49d8-ba00-1f87666362f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:05.011134 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f3b8f-0d79-49d8-ba00-1f87666362f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:05.011534 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f3b8f-0d79-49d8-ba00-1f87666362f1 admin admin] PATH_INFO: `/v3/projects/90a6497a6f1040fe907164c42f161c1b/users/18f749cc6de44abd9958cc3e2af288ca/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:05.014992 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759681dd-b454-46b0-9463-c674a2bdf530 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:05.019542 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae854e9-d225-4b22-b219-162bc87b38ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:05.020399 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae854e9-d225-4b22-b219-162bc87b38ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:05.020682 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae854e9-d225-4b22-b219-162bc87b38ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:05.020958 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae854e9-d225-4b22-b219-162bc87b38ee admin admin] PATH_INFO: `/v3/projects/c583042f383d44cd8eee480a473fdf5e/users/8c08f725d244480c922fc400d34322ee/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:05.028216 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f3b8f-0d79-49d8-ba00-1f87666362f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90a6497a6f1040fe907164c42f161c1b, user_id=18f749cc6de44abd9958cc3e2af288ca, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:05.029265 dv-cinder-742162-5-smb devstack@keystone.service[80362]: WARNING py.warnings [None req-bd2f3b8f-0d79-49d8-ba00-1f87666362f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 04:11:05.029265 dv-cinder-742162-5-smb devstack@keystone.service[80362]: warnings.warn(msg) Jul 04 04:11:05.029265 dv-cinder-742162-5-smb devstack@keystone.service[80362]: Jul 04 04:11:05.031300 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f3b8f-0d79-49d8-ba00-1f87666362f1 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:05.035734 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae854e9-d225-4b22-b219-162bc87b38ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=c583042f383d44cd8eee480a473fdf5e, user_id=8c08f725d244480c922fc400d34322ee, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:05.039451 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae854e9-d225-4b22-b219-162bc87b38ee admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:05.044731 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 804/1600] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:04 2022] PUT /identity/v3/projects/90a6497a6f1040fe907164c42f161c1b/users/18f749cc6de44abd9958cc3e2af288ca/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:05.046183 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85f223-cb42-4b89-8df2-6a23c3d3cef4 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:05.046562 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85f223-cb42-4b89-8df2-6a23c3d3cef4 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:05.046777 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85f223-cb42-4b89-8df2-6a23c3d3cef4 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:05.048207 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 805/1601] 10.222.0.49 () {54 vars in 961 bytes} [Mon Jul 4 04:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:11:05.049235 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3eace-f5b2-4998-8844-b5658d4f03cf None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:05.049609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3eace-f5b2-4998-8844-b5658d4f03cf None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:05.049908 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3eace-f5b2-4998-8844-b5658d4f03cf None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:05.051321 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 806/1602] 10.222.0.49 () {54 vars in 912 bytes} [Mon Jul 4 04:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:11:05.052587 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3eace-f5b2-4998-8844-b5658d4f03cf None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:05.062233 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 797/1603] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:05 2022] PUT /identity/v3/projects/c583042f383d44cd8eee480a473fdf5e/users/8c08f725d244480c922fc400d34322ee/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:05.063379 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae854e9-d225-4b22-b219-162bc87b38ee admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:05.135494 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae854e9-d225-4b22-b219-162bc87b38ee admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:05.140967 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936715f-6d3b-43f9-8b2f-6233034781b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:05.141823 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936715f-6d3b-43f9-8b2f-6233034781b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:05.142255 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936715f-6d3b-43f9-8b2f-6233034781b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:05.142667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936715f-6d3b-43f9-8b2f-6233034781b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:05.143531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8936715f-6d3b-43f9-8b2f-6233034781b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:05.145310 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8936715f-6d3b-43f9-8b2f-6233034781b6 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:05.159857 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 798/1604] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:05.159857 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936715f-6d3b-43f9-8b2f-6233034781b6 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:05.171683 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936715f-6d3b-43f9-8b2f-6233034781b6 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:05.177921 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6451740-0ff0-4f54-9c89-828420c0a115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:05.178659 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6451740-0ff0-4f54-9c89-828420c0a115 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:05.178953 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6451740-0ff0-4f54-9c89-828420c0a115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:05.179237 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6451740-0ff0-4f54-9c89-828420c0a115 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:05.179991 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6451740-0ff0-4f54-9c89-828420c0a115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:05.181674 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6451740-0ff0-4f54-9c89-828420c0a115 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:05.192549 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 799/1605] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:05.195888 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6451740-0ff0-4f54-9c89-828420c0a115 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:05.203746 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6451740-0ff0-4f54-9c89-828420c0a115 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:05.208871 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92a643-5012-441a-92d5-d9d4c2ccfa80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:05.209773 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92a643-5012-441a-92d5-d9d4c2ccfa80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:05.210059 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92a643-5012-441a-92d5-d9d4c2ccfa80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:05.210474 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92a643-5012-441a-92d5-d9d4c2ccfa80 admin admin] PATH_INFO: `/v3/projects/1ebc2cb9ec154a33940044a5853a2404/users/c8ada8b86e2f4ad18c8af021def1a30e/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:05.225946 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e92a643-5012-441a-92d5-d9d4c2ccfa80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ebc2cb9ec154a33940044a5853a2404, user_id=c8ada8b86e2f4ad18c8af021def1a30e, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:05.228750 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e92a643-5012-441a-92d5-d9d4c2ccfa80 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:05.244953 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 800/1606] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:05 2022] PUT /identity/v3/projects/1ebc2cb9ec154a33940044a5853a2404/users/c8ada8b86e2f4ad18c8af021def1a30e/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:05.246333 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6decff-109d-4fd4-a157-32461db9a841 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:05.246633 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6decff-109d-4fd4-a157-32461db9a841 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:05.246919 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6decff-109d-4fd4-a157-32461db9a841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:05.247208 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3eace-f5b2-4998-8844-b5658d4f03cf None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:05.254405 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:05.265826 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-fa6decff-109d-4fd4-a157-32461db9a841 None None] MFA Rules not processed for user `8334e75253f843a980b01c6f0cda6015`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:05.267179 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-fa6decff-109d-4fd4-a157-32461db9a841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:05.304254 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8eb67-297a-4f34-b3f4-c410d3d35cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:05.305043 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8eb67-297a-4f34-b3f4-c410d3d35cdb admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:05.305328 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8eb67-297a-4f34-b3f4-c410d3d35cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:05.305603 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8eb67-297a-4f34-b3f4-c410d3d35cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:05.306376 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b8eb67-297a-4f34-b3f4-c410d3d35cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:05.308122 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b8eb67-297a-4f34-b3f4-c410d3d35cdb admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:05.318125 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 807/1607] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:05.319577 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f25e0-513a-4560-86b0-3efe8ef287d0 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:05.319879 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f25e0-513a-4560-86b0-3efe8ef287d0 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:05.320251 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f25e0-513a-4560-86b0-3efe8ef287d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:05.333747 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 801/1608] 10.222.0.49 () {58 vars in 1058 bytes} [Mon Jul 4 04:11:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:05.338716 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a541ca6-5038-4d8b-82ad-de41d2ea197c None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:05.339072 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a541ca6-5038-4d8b-82ad-de41d2ea197c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:05.339355 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a541ca6-5038-4d8b-82ad-de41d2ea197c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:05.346092 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-698f25e0-513a-4560-86b0-3efe8ef287d0 None None] MFA Rules not processed for user `18f749cc6de44abd9958cc3e2af288ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:05.347327 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-698f25e0-513a-4560-86b0-3efe8ef287d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:05.357006 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-7a541ca6-5038-4d8b-82ad-de41d2ea197c None None] MFA Rules not processed for user `8334e75253f843a980b01c6f0cda6015`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:05.358211 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-7a541ca6-5038-4d8b-82ad-de41d2ea197c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:05.367604 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 802/1609] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Jul 4 04:11:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:05.369308 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88142e-daf6-4be4-a0d8-09d3d3a9b1f8 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:05.369635 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88142e-daf6-4be4-a0d8-09d3d3a9b1f8 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:05.369954 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88142e-daf6-4be4-a0d8-09d3d3a9b1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:05.391062 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-3b88142e-daf6-4be4-a0d8-09d3d3a9b1f8 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:05.392201 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3b88142e-daf6-4be4-a0d8-09d3d3a9b1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:05.399915 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 803/1610] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:05.403209 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88142e-daf6-4be4-a0d8-09d3d3a9b1f8 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:05.413932 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 808/1611] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:05.414383 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88142e-daf6-4be4-a0d8-09d3d3a9b1f8 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:05.414939 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f25e0-513a-4560-86b0-3efe8ef287d0 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:05.421224 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48702b5-2e36-4af2-b15b-40c004153bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:05.422128 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48702b5-2e36-4af2-b15b-40c004153bed admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:05.422439 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48702b5-2e36-4af2-b15b-40c004153bed admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:05.422724 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48702b5-2e36-4af2-b15b-40c004153bed admin admin] PATH_INFO: `/v3/projects/f6171063f02e4b339c62b0e1731c322f/users/6e561bcab97d4720856cd7ea1765fb63/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:05.429127 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f25e0-513a-4560-86b0-3efe8ef287d0 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:05.433635 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010fcc5f-c9d4-4c3a-969e-16d443fb655b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:05.434548 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010fcc5f-c9d4-4c3a-969e-16d443fb655b admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:05.434831 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010fcc5f-c9d4-4c3a-969e-16d443fb655b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:05.435108 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010fcc5f-c9d4-4c3a-969e-16d443fb655b admin admin] PATH_INFO: `/v3/projects/e055788ea40d45d6941ea382fff04c77/users/2648301ff6d24e14a2b0b8e34f742c9a/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:05.438186 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48702b5-2e36-4af2-b15b-40c004153bed admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6171063f02e4b339c62b0e1731c322f, user_id=6e561bcab97d4720856cd7ea1765fb63, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:05.440939 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48702b5-2e36-4af2-b15b-40c004153bed admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:05.443023 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:05.460093 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010fcc5f-c9d4-4c3a-969e-16d443fb655b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e055788ea40d45d6941ea382fff04c77, user_id=2648301ff6d24e14a2b0b8e34f742c9a, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:05.463014 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 804/1612] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:05 2022] PUT /identity/v3/projects/f6171063f02e4b339c62b0e1731c322f/users/6e561bcab97d4720856cd7ea1765fb63/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:05.463214 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010fcc5f-c9d4-4c3a-969e-16d443fb655b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:05.464190 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60124a0f-d766-4c6e-8771-5e9dd0d4677b None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:05.464492 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60124a0f-d766-4c6e-8771-5e9dd0d4677b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:05.464779 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60124a0f-d766-4c6e-8771-5e9dd0d4677b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:05.485009 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-60124a0f-d766-4c6e-8771-5e9dd0d4677b None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:05.485210 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 809/1613] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:05 2022] PUT /identity/v3/projects/e055788ea40d45d6941ea382fff04c77/users/2648301ff6d24e14a2b0b8e34f742c9a/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:05.486053 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010fcc5f-c9d4-4c3a-969e-16d443fb655b admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:05.486277 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-60124a0f-d766-4c6e-8771-5e9dd0d4677b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:05.547382 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 805/1614] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:05.548235 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60124a0f-d766-4c6e-8771-5e9dd0d4677b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:05.552332 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010fcc5f-c9d4-4c3a-969e-16d443fb655b admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:05.557475 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afda1a0-d2ea-42a2-ab3f-3ed2088ba35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:05.558379 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afda1a0-d2ea-42a2-ab3f-3ed2088ba35d admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:05.558666 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afda1a0-d2ea-42a2-ab3f-3ed2088ba35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:05.558945 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afda1a0-d2ea-42a2-ab3f-3ed2088ba35d admin admin] PATH_INFO: `/v3/projects/1d265f050b0648df974919918e607fb4/users/0be198ad83014acfab897498c2d68d7d/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:05.574137 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afda1a0-d2ea-42a2-ab3f-3ed2088ba35d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d265f050b0648df974919918e607fb4, user_id=0be198ad83014acfab897498c2d68d7d, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:05.576841 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afda1a0-d2ea-42a2-ab3f-3ed2088ba35d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:05.590533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 810/1615] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:05 2022] PUT /identity/v3/projects/1d265f050b0648df974919918e607fb4/users/0be198ad83014acfab897498c2d68d7d/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:05.591538 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afda1a0-d2ea-42a2-ab3f-3ed2088ba35d admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:05.608909 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:05.624095 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60124a0f-d766-4c6e-8771-5e9dd0d4677b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:05.646997 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afda1a0-d2ea-42a2-ab3f-3ed2088ba35d admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:05.650935 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc99e80-8cc1-44fd-8e2a-0268e5a845c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:05.651593 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc99e80-8cc1-44fd-8e2a-0268e5a845c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:05.651876 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc99e80-8cc1-44fd-8e2a-0268e5a845c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:05.652153 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc99e80-8cc1-44fd-8e2a-0268e5a845c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:05.688836 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4d4dc-e01e-44dc-816f-dfda7dbe3a4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:05.689679 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4d4dc-e01e-44dc-816f-dfda7dbe3a4a service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:05.690113 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4d4dc-e01e-44dc-816f-dfda7dbe3a4a service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:05.690425 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4d4dc-e01e-44dc-816f-dfda7dbe3a4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:05.720516 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc99e80-8cc1-44fd-8e2a-0268e5a845c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:05.722018 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc99e80-8cc1-44fd-8e2a-0268e5a845c6 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:05.733316 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 811/1616] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:05.734237 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc99e80-8cc1-44fd-8e2a-0268e5a845c6 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:05.744175 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:05.747716 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4d4dc-e01e-44dc-816f-dfda7dbe3a4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:05.749675 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4d4dc-e01e-44dc-816f-dfda7dbe3a4a service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:05.760887 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 806/1617] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:05.762176 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db6685-96f9-4757-96b5-5d41a222e9ce None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:05.762480 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db6685-96f9-4757-96b5-5d41a222e9ce None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:05.762773 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db6685-96f9-4757-96b5-5d41a222e9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:05.791866 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-68db6685-96f9-4757-96b5-5d41a222e9ce None None] MFA Rules not processed for user `6e561bcab97d4720856cd7ea1765fb63`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:05.793185 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-68db6685-96f9-4757-96b5-5d41a222e9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:05.796712 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc99e80-8cc1-44fd-8e2a-0268e5a845c6 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:05.801683 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670baa7-3622-4684-a9b9-2cfe2b916ce9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:05.802838 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670baa7-3622-4684-a9b9-2cfe2b916ce9 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:05.803225 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670baa7-3622-4684-a9b9-2cfe2b916ce9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:05.804123 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670baa7-3622-4684-a9b9-2cfe2b916ce9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:05.879710 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 807/1618] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:05 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:05.881322 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fade11b-9b73-4112-a172-dabd2165c638 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:05.881643 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fade11b-9b73-4112-a172-dabd2165c638 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:05.881944 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fade11b-9b73-4112-a172-dabd2165c638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:05.890644 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670baa7-3622-4684-a9b9-2cfe2b916ce9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:05.893567 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670baa7-3622-4684-a9b9-2cfe2b916ce9 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:05.904848 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-6fade11b-9b73-4112-a172-dabd2165c638 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:05.906198 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 812/1619] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:05.907185 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670baa7-3622-4684-a9b9-2cfe2b916ce9 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:05.916240 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670baa7-3622-4684-a9b9-2cfe2b916ce9 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:05.917769 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6fade11b-9b73-4112-a172-dabd2165c638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:05.920204 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0210e59-65fe-4f9f-97f6-35710a42e49a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:05.921009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0210e59-65fe-4f9f-97f6-35710a42e49a service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:05.921395 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0210e59-65fe-4f9f-97f6-35710a42e49a service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:05.921769 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0210e59-65fe-4f9f-97f6-35710a42e49a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:05.932026 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0210e59-65fe-4f9f-97f6-35710a42e49a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:05.934109 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0210e59-65fe-4f9f-97f6-35710a42e49a service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:05.940810 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 808/1620] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:05.942224 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124b34a-c7d3-497a-9491-c5473e3ef5cb None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:05.949067 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 813/1621] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:05.950099 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0210e59-65fe-4f9f-97f6-35710a42e49a service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:05.952049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124b34a-c7d3-497a-9491-c5473e3ef5cb None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:05.952400 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124b34a-c7d3-497a-9491-c5473e3ef5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:05.962848 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0210e59-65fe-4f9f-97f6-35710a42e49a service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:05.977673 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19e902-1bd0-49f9-92a3-4474d6382bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:05.978673 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19e902-1bd0-49f9-92a3-4474d6382bab admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:05.979561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19e902-1bd0-49f9-92a3-4474d6382bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:05.979912 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19e902-1bd0-49f9-92a3-4474d6382bab admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:05.980739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19e902-1bd0-49f9-92a3-4474d6382bab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:05.982856 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19e902-1bd0-49f9-92a3-4474d6382bab admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:05.993862 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-9124b34a-c7d3-497a-9491-c5473e3ef5cb None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:05.998527 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9124b34a-c7d3-497a-9491-c5473e3ef5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:06.008696 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 809/1622] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:06.017889 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124b34a-c7d3-497a-9491-c5473e3ef5cb None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:06.017889 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9124b34a-c7d3-497a-9491-c5473e3ef5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:06.029786 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 814/1623] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:11:05 2022] POST /identity/v3/projects => generated 363 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:06.033984 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19e902-1bd0-49f9-92a3-4474d6382bab admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:06.041967 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124b34a-c7d3-497a-9491-c5473e3ef5cb None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:06.055607 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:06.099745 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19e902-1bd0-49f9-92a3-4474d6382bab admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:06.103696 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ce14a-9f30-486d-9fe7-85e7ec2bec8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:06.104443 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ce14a-9f30-486d-9fe7-85e7ec2bec8c service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:06.104817 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ce14a-9f30-486d-9fe7-85e7ec2bec8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:06.105132 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ce14a-9f30-486d-9fe7-85e7ec2bec8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:06.111975 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da95a04-8286-4264-83ea-305abb44c079 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:06.113274 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da95a04-8286-4264-83ea-305abb44c079 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:06.113826 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da95a04-8286-4264-83ea-305abb44c079 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:06.114417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da95a04-8286-4264-83ea-305abb44c079 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:06.154368 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:06.184309 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da95a04-8286-4264-83ea-305abb44c079 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:06.186286 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da95a04-8286-4264-83ea-305abb44c079 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:06.186609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ce14a-9f30-486d-9fe7-85e7ec2bec8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:06.188465 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ce14a-9f30-486d-9fe7-85e7ec2bec8c service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:06.199176 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 810/1624] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:06.200171 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da95a04-8286-4264-83ea-305abb44c079 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:06.202190 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 815/1625] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:06.203130 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ce14a-9f30-486d-9fe7-85e7ec2bec8c service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:06.214595 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ce14a-9f30-486d-9fe7-85e7ec2bec8c service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:06.219898 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ce27c-d99a-4de4-9bd7-d21dd8aab268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:06.220742 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ce27c-d99a-4de4-9bd7-d21dd8aab268 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:06.221072 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ce27c-d99a-4de4-9bd7-d21dd8aab268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:06.221579 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ce27c-d99a-4de4-9bd7-d21dd8aab268 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:06.222435 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ce27c-d99a-4de4-9bd7-d21dd8aab268 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:06.224631 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ce27c-d99a-4de4-9bd7-d21dd8aab268 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:06.274415 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 816/1626] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:11:06 2022] POST /identity/v3/users => generated 288 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:06.283152 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ce27c-d99a-4de4-9bd7-d21dd8aab268 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:06.301875 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ce27c-d99a-4de4-9bd7-d21dd8aab268 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:06.309725 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbab93c-edbf-484b-8e64-6940ab68a917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:06.310584 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbab93c-edbf-484b-8e64-6940ab68a917 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:06.310971 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbab93c-edbf-484b-8e64-6940ab68a917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:06.311255 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbab93c-edbf-484b-8e64-6940ab68a917 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:06.312183 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbab93c-edbf-484b-8e64-6940ab68a917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:06.313613 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da95a04-8286-4264-83ea-305abb44c079 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:06.314435 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbab93c-edbf-484b-8e64-6940ab68a917 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:06.320617 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e0e84-45d0-4cea-9964-6cb34d757728 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:06.321672 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e0e84-45d0-4cea-9964-6cb34d757728 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:06.322054 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e0e84-45d0-4cea-9964-6cb34d757728 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:06.322461 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e0e84-45d0-4cea-9964-6cb34d757728 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:06.331587 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 817/1627] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:06.335440 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbab93c-edbf-484b-8e64-6940ab68a917 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:06.350476 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbab93c-edbf-484b-8e64-6940ab68a917 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:06.355970 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e16c8e-f720-4c53-9f2d-40ea6d4b60dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:06.357046 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e16c8e-f720-4c53-9f2d-40ea6d4b60dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:06.357399 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e16c8e-f720-4c53-9f2d-40ea6d4b60dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:06.357767 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e16c8e-f720-4c53-9f2d-40ea6d4b60dd admin admin] PATH_INFO: `/v3/projects/5a5902f99729441188dbb5c3a7b41082/users/4d3253b19d0240aea8700cb921885481/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:06.377850 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e16c8e-f720-4c53-9f2d-40ea6d4b60dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a5902f99729441188dbb5c3a7b41082, user_id=4d3253b19d0240aea8700cb921885481, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:06.383930 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e16c8e-f720-4c53-9f2d-40ea6d4b60dd admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:06.408026 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 818/1628] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:06 2022] PUT /identity/v3/projects/5a5902f99729441188dbb5c3a7b41082/users/4d3253b19d0240aea8700cb921885481/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:06.412613 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e16c8e-f720-4c53-9f2d-40ea6d4b60dd admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:06.446812 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32e0e84-45d0-4cea-9964-6cb34d757728 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:06.450489 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32e0e84-45d0-4cea-9964-6cb34d757728 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:06.463047 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:06.480273 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 811/1629] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:06.510419 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e16c8e-f720-4c53-9f2d-40ea6d4b60dd admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:06.521992 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab5ceb2-d136-4dc9-be2c-342351e9661c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:06.523013 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5ceb2-d136-4dc9-be2c-342351e9661c admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:06.523545 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5ceb2-d136-4dc9-be2c-342351e9661c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:06.524080 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5ceb2-d136-4dc9-be2c-342351e9661c admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:06.525594 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab5ceb2-d136-4dc9-be2c-342351e9661c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:06.528611 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab5ceb2-d136-4dc9-be2c-342351e9661c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:06.550664 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 819/1630] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:06.552235 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa31bf-87fa-424e-bcde-8463155cd710 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:06.552538 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa31bf-87fa-424e-bcde-8463155cd710 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:06.553047 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa31bf-87fa-424e-bcde-8463155cd710 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:06.554234 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab5ceb2-d136-4dc9-be2c-342351e9661c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:06.554663 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 812/1631] 10.222.0.49 () {54 vars in 912 bytes} [Mon Jul 4 04:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 04 04:11:06.561793 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e83d53-dfe0-41d4-b11f-86cbb1e63c62 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:06.562098 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e83d53-dfe0-41d4-b11f-86cbb1e63c62 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:06.562453 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e83d53-dfe0-41d4-b11f-86cbb1e63c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:06.572461 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab5ceb2-d136-4dc9-be2c-342351e9661c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:06.581306 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da488fb3-23b7-44e6-abb2-3e8fbebb6978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:06.582431 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da488fb3-23b7-44e6-abb2-3e8fbebb6978 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:06.583140 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da488fb3-23b7-44e6-abb2-3e8fbebb6978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:06.583559 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da488fb3-23b7-44e6-abb2-3e8fbebb6978 admin admin] PATH_INFO: `/v3/projects/5a5902f99729441188dbb5c3a7b41082/users/4d3253b19d0240aea8700cb921885481/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:06.585872 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da488fb3-23b7-44e6-abb2-3e8fbebb6978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a5902f99729441188dbb5c3a7b41082, user_id=4d3253b19d0240aea8700cb921885481, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:06.589987 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da488fb3-23b7-44e6-abb2-3e8fbebb6978 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:06.613830 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 820/1632] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:06 2022] PUT /identity/v3/projects/5a5902f99729441188dbb5c3a7b41082/users/4d3253b19d0240aea8700cb921885481/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:06.615316 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-a9e83d53-dfe0-41d4-b11f-86cbb1e63c62 None None] MFA Rules not processed for user `8334e75253f843a980b01c6f0cda6015`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:06.616748 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a9e83d53-dfe0-41d4-b11f-86cbb1e63c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:06.623965 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68333bba-57f7-4902-8ff5-1d740947f305 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:06.624259 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68333bba-57f7-4902-8ff5-1d740947f305 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:06.624711 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68333bba-57f7-4902-8ff5-1d740947f305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:06.687587 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-68333bba-57f7-4902-8ff5-1d740947f305 None None] MFA Rules not processed for user `4d3253b19d0240aea8700cb921885481`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:06.688837 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-68333bba-57f7-4902-8ff5-1d740947f305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:06.799547 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 813/1633] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Jul 4 04:11:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:06.806923 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e83d53-dfe0-41d4-b11f-86cbb1e63c62 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:06.831718 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:06.871962 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 821/1634] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:06 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:06.884148 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68333bba-57f7-4902-8ff5-1d740947f305 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:06.933713 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e83d53-dfe0-41d4-b11f-86cbb1e63c62 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:06.940100 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a827c-5e07-400c-95ff-15e6c7028747 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:06.940780 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a827c-5e07-400c-95ff-15e6c7028747 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:06.941155 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a827c-5e07-400c-95ff-15e6c7028747 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:06.941441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a827c-5e07-400c-95ff-15e6c7028747 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:06.957552 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a827c-5e07-400c-95ff-15e6c7028747 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:06.959518 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a827c-5e07-400c-95ff-15e6c7028747 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:06.977880 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68333bba-57f7-4902-8ff5-1d740947f305 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:06.997704 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed290f-3ae6-434a-ab20-af15fa145dc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:06.998227 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 814/1635] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:07.000813 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed290f-3ae6-434a-ab20-af15fa145dc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:07.001116 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed290f-3ae6-434a-ab20-af15fa145dc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:07.001605 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed290f-3ae6-434a-ab20-af15fa145dc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:07.022020 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed290f-3ae6-434a-ab20-af15fa145dc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:07.026247 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed290f-3ae6-434a-ab20-af15fa145dc2 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:07.058957 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 822/1636] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:06 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:07.338709 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a827c-5e07-400c-95ff-15e6c7028747 service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:07.342894 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed290f-3ae6-434a-ab20-af15fa145dc2 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:07.352837 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed290f-3ae6-434a-ab20-af15fa145dc2 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:07.359948 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40d019-f0e5-4196-a5cc-d3ef8d95d999 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:07.361812 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40d019-f0e5-4196-a5cc-d3ef8d95d999 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:07.362386 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40d019-f0e5-4196-a5cc-d3ef8d95d999 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:07.362890 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40d019-f0e5-4196-a5cc-d3ef8d95d999 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:07.445782 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a827c-5e07-400c-95ff-15e6c7028747 service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:07.453870 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3ac1e-2c2b-41e7-bc9c-a1b87dceb16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:07.455091 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3ac1e-2c2b-41e7-bc9c-a1b87dceb16b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:07.455586 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3ac1e-2c2b-41e7-bc9c-a1b87dceb16b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:07.456491 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3ac1e-2c2b-41e7-bc9c-a1b87dceb16b admin admin] PATH_INFO: `/v3/users/7e5e63f04e504da6a20dd020d1b241eb` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:07.458142 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac3ac1e-2c2b-41e7-bc9c-a1b87dceb16b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e5e63f04e504da6a20dd020d1b241eb)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:07.462007 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac3ac1e-2c2b-41e7-bc9c-a1b87dceb16b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:07.478346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff40d019-f0e5-4196-a5cc-d3ef8d95d999 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:07.479933 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff40d019-f0e5-4196-a5cc-d3ef8d95d999 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:07.490733 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 823/1637] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:07 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:07.529609 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:07.565729 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0ac3ac1e-2c2b-41e7-bc9c-a1b87dceb16b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e5e63f04e504da6a20dd020d1b241eb'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:07.568350 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0ac3ac1e-2c2b-41e7-bc9c-a1b87dceb16b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e5e63f04e504da6a20dd020d1b241eb'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:07.590484 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0ac3ac1e-2c2b-41e7-bc9c-a1b87dceb16b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e5e63f04e504da6a20dd020d1b241eb'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:07.624888 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0ac3ac1e-2c2b-41e7-bc9c-a1b87dceb16b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e5e63f04e504da6a20dd020d1b241eb'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:07.626581 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0ac3ac1e-2c2b-41e7-bc9c-a1b87dceb16b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e5e63f04e504da6a20dd020d1b241eb'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:07.668049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 815/1638] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:11:07 2022] DELETE /identity/v3/users/7e5e63f04e504da6a20dd020d1b241eb => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:07.674279 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855555c7-ec8c-48df-9751-46a757d4e60b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:07.674725 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855555c7-ec8c-48df-9751-46a757d4e60b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:07.675074 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855555c7-ec8c-48df-9751-46a757d4e60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:07.698627 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-855555c7-ec8c-48df-9751-46a757d4e60b None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:07.700029 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-855555c7-ec8c-48df-9751-46a757d4e60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:07.784420 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 824/1639] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:07.870488 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3ac1e-2c2b-41e7-bc9c-a1b87dceb16b admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:07.872028 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0ac3ac1e-2c2b-41e7-bc9c-a1b87dceb16b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:07.988496 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3ac1e-2c2b-41e7-bc9c-a1b87dceb16b admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:08.008252 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950d155-e6e5-4d55-8c7d-781ebbf75faf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:08.008941 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950d155-e6e5-4d55-8c7d-781ebbf75faf service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:08.009232 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950d155-e6e5-4d55-8c7d-781ebbf75faf service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:08.009517 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950d155-e6e5-4d55-8c7d-781ebbf75faf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:08.029144 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950d155-e6e5-4d55-8c7d-781ebbf75faf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:08.030668 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950d155-e6e5-4d55-8c7d-781ebbf75faf service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:08.052325 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 816/1640] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:09.337362 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855555c7-ec8c-48df-9751-46a757d4e60b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:09.345695 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-855555c7-ec8c-48df-9751-46a757d4e60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:09.364855 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855555c7-ec8c-48df-9751-46a757d4e60b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:09.373599 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6aa05-01e8-4868-80c8-423de29a2bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:09.376034 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6aa05-01e8-4868-80c8-423de29a2bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:09.376610 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6aa05-01e8-4868-80c8-423de29a2bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:09.377114 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6aa05-01e8-4868-80c8-423de29a2bb4 admin admin] PATH_INFO: `/v3/projects/1a42a994d2ae4cbebd6e2c2c8cab4800` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:09.380202 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6aa05-01e8-4868-80c8-423de29a2bb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a42a994d2ae4cbebd6e2c2c8cab4800)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:09.387394 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6aa05-01e8-4868-80c8-423de29a2bb4 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:09.434083 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:09.461967 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-61d6aa05-01e8-4868-80c8-423de29a2bb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a42a994d2ae4cbebd6e2c2c8cab4800', 'request_id': 'req-61d6aa05-01e8-4868-80c8-423de29a2bb4'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:09.485233 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950d155-e6e5-4d55-8c7d-781ebbf75faf service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:09.485707 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d950d155-e6e5-4d55-8c7d-781ebbf75faf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:09.491299 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-61d6aa05-01e8-4868-80c8-423de29a2bb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a42a994d2ae4cbebd6e2c2c8cab4800', 'request_id': 'req-61d6aa05-01e8-4868-80c8-423de29a2bb4'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:09.509529 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-61d6aa05-01e8-4868-80c8-423de29a2bb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a42a994d2ae4cbebd6e2c2c8cab4800', 'request_id': 'req-61d6aa05-01e8-4868-80c8-423de29a2bb4'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:09.511989 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950d155-e6e5-4d55-8c7d-781ebbf75faf service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:09.551039 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-61d6aa05-01e8-4868-80c8-423de29a2bb4 admin admin] The token cache is being invalidate because project 1a42a994d2ae4cbebd6e2c2c8cab4800 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:11:09.551605 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-61d6aa05-01e8-4868-80c8-423de29a2bb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:09.553086 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-61d6aa05-01e8-4868-80c8-423de29a2bb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:09.557175 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 825/1641] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:11:09 2022] DELETE /identity/v3/projects/1a42a994d2ae4cbebd6e2c2c8cab4800 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:09.563281 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7ede0-5a9d-4b2a-af96-25c0b786653c None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:09.563978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7ede0-5a9d-4b2a-af96-25c0b786653c None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:09.564424 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7ede0-5a9d-4b2a-af96-25c0b786653c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:09.621063 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-96d7ede0-5a9d-4b2a-af96-25c0b786653c None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:09.623332 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-96d7ede0-5a9d-4b2a-af96-25c0b786653c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:09.636113 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabb87a-3155-44b4-9f5b-584bf3f8968a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:09.637046 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabb87a-3155-44b4-9f5b-584bf3f8968a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:09.637338 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabb87a-3155-44b4-9f5b-584bf3f8968a admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:09.637730 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabb87a-3155-44b4-9f5b-584bf3f8968a admin admin] PATH_INFO: `/v3/users/3b120e8522b54a38a2f140c56cca554b` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:09.638951 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cabb87a-3155-44b4-9f5b-584bf3f8968a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b120e8522b54a38a2f140c56cca554b)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:09.640958 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cabb87a-3155-44b4-9f5b-584bf3f8968a admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:09.651318 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 826/1642] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:09.666469 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5f08a-d585-4804-8c9c-ba0d8eb53317 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:09.667178 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5f08a-d585-4804-8c9c-ba0d8eb53317 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:09.667705 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5f08a-d585-4804-8c9c-ba0d8eb53317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:09.715789 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-09a5f08a-d585-4804-8c9c-ba0d8eb53317 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:09.719815 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-09a5f08a-d585-4804-8c9c-ba0d8eb53317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:09.734978 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2cabb87a-3155-44b4-9f5b-584bf3f8968a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b120e8522b54a38a2f140c56cca554b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:09.735883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2cabb87a-3155-44b4-9f5b-584bf3f8968a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b120e8522b54a38a2f140c56cca554b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:09.759516 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 827/1643] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:09.761858 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5f08a-d585-4804-8c9c-ba0d8eb53317 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:09.770979 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2cabb87a-3155-44b4-9f5b-584bf3f8968a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b120e8522b54a38a2f140c56cca554b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:09.774568 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:09.830336 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5f08a-d585-4804-8c9c-ba0d8eb53317 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:09.833317 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2cabb87a-3155-44b4-9f5b-584bf3f8968a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b120e8522b54a38a2f140c56cca554b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:09.834328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2cabb87a-3155-44b4-9f5b-584bf3f8968a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b120e8522b54a38a2f140c56cca554b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:09.840251 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2a867-29a1-4f6d-915d-22d934b41e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:09.841044 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2a867-29a1-4f6d-915d-22d934b41e66 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:09.841898 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2a867-29a1-4f6d-915d-22d934b41e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:09.841898 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2a867-29a1-4f6d-915d-22d934b41e66 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:09.842919 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d2a867-29a1-4f6d-915d-22d934b41e66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:11:09.843307 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d2a867-29a1-4f6d-915d-22d934b41e66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:09.846609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d2a867-29a1-4f6d-915d-22d934b41e66 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:09.863743 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 817/1644] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:11:09 2022] DELETE /identity/v3/users/3b120e8522b54a38a2f140c56cca554b => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:09.871177 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c324dc2-934b-448f-b4b1-69c8d1472a00 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:09.871535 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c324dc2-934b-448f-b4b1-69c8d1472a00 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:09.871828 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c324dc2-934b-448f-b4b1-69c8d1472a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:09.876223 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 828/1645] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:11:09.880124 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2a867-29a1-4f6d-915d-22d934b41e66 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:09.884587 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-77d2a867-29a1-4f6d-915d-22d934b41e66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:09.907444 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2a867-29a1-4f6d-915d-22d934b41e66 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:09.911652 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-1c324dc2-934b-448f-b4b1-69c8d1472a00 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:09.912879 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1c324dc2-934b-448f-b4b1-69c8d1472a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:10.025880 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0898d55-0ae0-473a-ad29-37867e7a1c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:10.026973 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0898d55-0ae0-473a-ad29-37867e7a1c30 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:10.027223 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0898d55-0ae0-473a-ad29-37867e7a1c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:10.027501 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0898d55-0ae0-473a-ad29-37867e7a1c30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:10.028869 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0898d55-0ae0-473a-ad29-37867e7a1c30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:10.031330 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0898d55-0ae0-473a-ad29-37867e7a1c30 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:10.046421 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 818/1646] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:11:10.059802 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c324dc2-934b-448f-b4b1-69c8d1472a00 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:10.061603 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1c324dc2-934b-448f-b4b1-69c8d1472a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:10.078772 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 829/1647] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:11:09 2022] POST /identity/v3/projects => generated 365 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:10.081574 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0898d55-0ae0-473a-ad29-37867e7a1c30 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:10.189031 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c324dc2-934b-448f-b4b1-69c8d1472a00 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:10.206771 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0898d55-0ae0-473a-ad29-37867e7a1c30 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:10.217797 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc5d6b-9a01-48a6-a2c3-e976fb43862b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:10.218838 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc5d6b-9a01-48a6-a2c3-e976fb43862b admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:10.219382 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc5d6b-9a01-48a6-a2c3-e976fb43862b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:10.219860 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc5d6b-9a01-48a6-a2c3-e976fb43862b admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:10.220930 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc5d6b-9a01-48a6-a2c3-e976fb43862b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:10.223503 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc5d6b-9a01-48a6-a2c3-e976fb43862b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:10.252271 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 830/1648] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:11:10 2022] POST /identity/v3/users => generated 283 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:10.255998 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc5d6b-9a01-48a6-a2c3-e976fb43862b admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:10.263253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:10.270466 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc5d6b-9a01-48a6-a2c3-e976fb43862b admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:10.277836 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404102b-c85a-443d-a6e7-9e57617911e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:10.279390 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404102b-c85a-443d-a6e7-9e57617911e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:10.280051 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404102b-c85a-443d-a6e7-9e57617911e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:10.280529 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404102b-c85a-443d-a6e7-9e57617911e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:10.281930 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404102b-c85a-443d-a6e7-9e57617911e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:10.287318 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404102b-c85a-443d-a6e7-9e57617911e5 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:10.304262 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45774393-5027-49e9-840a-a383d6aac1dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:10.304950 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45774393-5027-49e9-840a-a383d6aac1dc service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:10.305239 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45774393-5027-49e9-840a-a383d6aac1dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:10.305524 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45774393-5027-49e9-840a-a383d6aac1dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:10.316166 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 831/1649] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 04:11:10.320480 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404102b-c85a-443d-a6e7-9e57617911e5 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:10.332546 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45774393-5027-49e9-840a-a383d6aac1dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:10.336324 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45774393-5027-49e9-840a-a383d6aac1dc service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:10.344732 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404102b-c85a-443d-a6e7-9e57617911e5 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:10.362597 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 819/1650] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:10.363258 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05810695-94aa-49b4-830d-b78693d7cd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:10.365160 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05810695-94aa-49b4-830d-b78693d7cd17 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:10.365684 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05810695-94aa-49b4-830d-b78693d7cd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:10.366180 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05810695-94aa-49b4-830d-b78693d7cd17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:10.369867 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05810695-94aa-49b4-830d-b78693d7cd17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:10.375964 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05810695-94aa-49b4-830d-b78693d7cd17 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:10.402736 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 832/1651] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:10.406814 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45774393-5027-49e9-840a-a383d6aac1dc service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:10.417110 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45774393-5027-49e9-840a-a383d6aac1dc service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:10.421902 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d4db2-54d3-46b9-9328-3a92afd0bcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:10.422855 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d4db2-54d3-46b9-9328-3a92afd0bcf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:10.423141 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d4db2-54d3-46b9-9328-3a92afd0bcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:10.423420 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d4db2-54d3-46b9-9328-3a92afd0bcf3 admin admin] PATH_INFO: `/v3/projects/1e41bca01ee9464f8754ba6cce08e9e2/users/09ce8e5d701a48898f5cb738fa2713ca/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:10.439555 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d4db2-54d3-46b9-9328-3a92afd0bcf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e41bca01ee9464f8754ba6cce08e9e2, user_id=09ce8e5d701a48898f5cb738fa2713ca, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:10.442337 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d4db2-54d3-46b9-9328-3a92afd0bcf3 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:10.471314 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46ff5a-8198-44d1-815b-f78243a97692 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:10.471631 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46ff5a-8198-44d1-815b-f78243a97692 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:10.471874 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46ff5a-8198-44d1-815b-f78243a97692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:10.473918 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 820/1652] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:10 2022] PUT /identity/v3/projects/1e41bca01ee9464f8754ba6cce08e9e2/users/09ce8e5d701a48898f5cb738fa2713ca/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:10.507458 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-cc46ff5a-8198-44d1-815b-f78243a97692 None None] MFA Rules not processed for user `09ce8e5d701a48898f5cb738fa2713ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:10.514772 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-cc46ff5a-8198-44d1-815b-f78243a97692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:10.622067 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d4db2-54d3-46b9-9328-3a92afd0bcf3 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:10.624936 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 833/1653] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:10 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:10.635069 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:10.728403 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d4db2-54d3-46b9-9328-3a92afd0bcf3 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:10.749069 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2867b-cbdd-4b04-9f04-7b5a92c2942f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:10.749760 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2867b-cbdd-4b04-9f04-7b5a92c2942f admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:10.750045 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2867b-cbdd-4b04-9f04-7b5a92c2942f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:10.750347 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2867b-cbdd-4b04-9f04-7b5a92c2942f admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:10.751062 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2867b-cbdd-4b04-9f04-7b5a92c2942f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:10.753008 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2867b-cbdd-4b04-9f04-7b5a92c2942f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:10.844444 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46ff5a-8198-44d1-815b-f78243a97692 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:10.853262 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 821/1654] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:11:10 2022] POST /identity/v3/projects => generated 361 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:10.860451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46ff5a-8198-44d1-815b-f78243a97692 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:10.989180 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aae301-a5ab-46dd-87c9-76ce35505964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:10.989996 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aae301-a5ab-46dd-87c9-76ce35505964 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:10.990319 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aae301-a5ab-46dd-87c9-76ce35505964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:10.990597 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aae301-a5ab-46dd-87c9-76ce35505964 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:10.991353 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aae301-a5ab-46dd-87c9-76ce35505964 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:10.993749 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aae301-a5ab-46dd-87c9-76ce35505964 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:11.022065 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2867b-cbdd-4b04-9f04-7b5a92c2942f admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:11.023919 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-afe2867b-cbdd-4b04-9f04-7b5a92c2942f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:11.029237 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 834/1655] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:11:10 2022] POST /identity/v3/users => generated 287 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 04:11:11.037744 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aae301-a5ab-46dd-87c9-76ce35505964 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:11.048322 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2867b-cbdd-4b04-9f04-7b5a92c2942f admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:11.054413 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aae301-a5ab-46dd-87c9-76ce35505964 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:11.059783 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4746c3-244e-479d-b3f1-9bc632c524bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:11.060531 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4746c3-244e-479d-b3f1-9bc632c524bc admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:11.060869 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4746c3-244e-479d-b3f1-9bc632c524bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:11.061142 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4746c3-244e-479d-b3f1-9bc632c524bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:11.061886 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4746c3-244e-479d-b3f1-9bc632c524bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:11.063806 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4746c3-244e-479d-b3f1-9bc632c524bc admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:11.064749 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adef69-5886-4310-80ff-51f01d8bf6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:11.067482 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adef69-5886-4310-80ff-51f01d8bf6ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:11.068141 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adef69-5886-4310-80ff-51f01d8bf6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:11.068701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adef69-5886-4310-80ff-51f01d8bf6ea admin admin] PATH_INFO: `/v3/projects/5210a0c2351e4c3190dba6677cbb1af9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:11.077137 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2adef69-5886-4310-80ff-51f01d8bf6ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=5210a0c2351e4c3190dba6677cbb1af9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:11.078255 dv-cinder-742162-5-smb devstack@keystone.service[80363]: WARNING py.warnings [None req-a2adef69-5886-4310-80ff-51f01d8bf6ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 04:11:11.078255 dv-cinder-742162-5-smb devstack@keystone.service[80363]: warnings.warn(msg) Jul 04 04:11:11.078255 dv-cinder-742162-5-smb devstack@keystone.service[80363]: Jul 04 04:11:11.079211 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 835/1656] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:11.079806 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2adef69-5886-4310-80ff-51f01d8bf6ea admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:11.080107 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4746c3-244e-479d-b3f1-9bc632c524bc admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:11.090762 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4746c3-244e-479d-b3f1-9bc632c524bc admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:11.103892 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865a21c-2a4d-4d02-96fc-134ab98846f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:11.104874 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865a21c-2a4d-4d02-96fc-134ab98846f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:11.105156 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865a21c-2a4d-4d02-96fc-134ab98846f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:11.105443 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865a21c-2a4d-4d02-96fc-134ab98846f3 admin admin] PATH_INFO: `/v3/projects/4ae1cc953fca472c881e453eed17c47a/users/2c35338b7b914383b3fe3bce30c03cef/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:11.155837 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e865a21c-2a4d-4d02-96fc-134ab98846f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ae1cc953fca472c881e453eed17c47a, user_id=2c35338b7b914383b3fe3bce30c03cef, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:11.158865 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e865a21c-2a4d-4d02-96fc-134ab98846f3 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:11.185684 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 836/1657] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:11 2022] PUT /identity/v3/projects/4ae1cc953fca472c881e453eed17c47a/users/2c35338b7b914383b3fe3bce30c03cef/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:11.190456 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865a21c-2a4d-4d02-96fc-134ab98846f3 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:11.265911 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:11.273518 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a2adef69-5886-4310-80ff-51f01d8bf6ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5210a0c2351e4c3190dba6677cbb1af9', 'request_id': 'req-a2adef69-5886-4310-80ff-51f01d8bf6ea'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:11.293351 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a2adef69-5886-4310-80ff-51f01d8bf6ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5210a0c2351e4c3190dba6677cbb1af9', 'request_id': 'req-a2adef69-5886-4310-80ff-51f01d8bf6ea'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:11.324104 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865a21c-2a4d-4d02-96fc-134ab98846f3 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:11.333955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a2adef69-5886-4310-80ff-51f01d8bf6ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5210a0c2351e4c3190dba6677cbb1af9', 'request_id': 'req-a2adef69-5886-4310-80ff-51f01d8bf6ea'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:11.358045 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a2adef69-5886-4310-80ff-51f01d8bf6ea admin admin] The token cache is being invalidate because project 5210a0c2351e4c3190dba6677cbb1af9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:11:11.358595 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a2adef69-5886-4310-80ff-51f01d8bf6ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:11.359492 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a2adef69-5886-4310-80ff-51f01d8bf6ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:11.371746 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 822/1658] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:11:11 2022] DELETE /identity/v3/projects/5210a0c2351e4c3190dba6677cbb1af9 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 04:11:11.373659 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11954a0-0c4d-47a1-914e-ef26fd59ebf0 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:11.373978 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11954a0-0c4d-47a1-914e-ef26fd59ebf0 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:11.374553 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11954a0-0c4d-47a1-914e-ef26fd59ebf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:11.412005 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e11954a0-0c4d-47a1-914e-ef26fd59ebf0 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:11.414059 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e11954a0-0c4d-47a1-914e-ef26fd59ebf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:11.514491 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 823/1659] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:11.524556 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca60fb-54e7-4bcd-b90a-cf6b5464bdf2 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:11.524858 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca60fb-54e7-4bcd-b90a-cf6b5464bdf2 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:11.525146 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca60fb-54e7-4bcd-b90a-cf6b5464bdf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:11.569906 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-51ca60fb-54e7-4bcd-b90a-cf6b5464bdf2 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:11.573582 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-51ca60fb-54e7-4bcd-b90a-cf6b5464bdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:11.581824 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac66e23-0787-453d-8390-129a2897894a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:11.582569 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac66e23-0787-453d-8390-129a2897894a admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:11.582853 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac66e23-0787-453d-8390-129a2897894a admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:11.583128 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac66e23-0787-453d-8390-129a2897894a admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:11.583880 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac66e23-0787-453d-8390-129a2897894a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:11.591673 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac66e23-0787-453d-8390-129a2897894a admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:11.611850 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 824/1660] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:11.616354 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca60fb-54e7-4bcd-b90a-cf6b5464bdf2 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:11.624361 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 837/1661] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 438 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:11.625740 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac66e23-0787-453d-8390-129a2897894a admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:11.627097 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3ac66e23-0787-453d-8390-129a2897894a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:11.643587 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca60fb-54e7-4bcd-b90a-cf6b5464bdf2 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:11.663334 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9f4a6-eae7-46c4-957d-7a9b92bf0b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:11.664207 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9f4a6-eae7-46c4-957d-7a9b92bf0b04 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:11.664556 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9f4a6-eae7-46c4-957d-7a9b92bf0b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:11.664846 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9f4a6-eae7-46c4-957d-7a9b92bf0b04 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:11.665586 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d9f4a6-eae7-46c4-957d-7a9b92bf0b04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:11:11.666282 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d9f4a6-eae7-46c4-957d-7a9b92bf0b04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:11.668428 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d9f4a6-eae7-46c4-957d-7a9b92bf0b04 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:11.706206 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:11.723662 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac66e23-0787-453d-8390-129a2897894a admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:11.726504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 825/1662] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:11:11.731145 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9f4a6-eae7-46c4-957d-7a9b92bf0b04 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:11.734398 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb5c04-6197-4d5d-aa01-6b91a3e9620b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:11.735321 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb5c04-6197-4d5d-aa01-6b91a3e9620b admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:11.735656 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb5c04-6197-4d5d-aa01-6b91a3e9620b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:11.735936 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb5c04-6197-4d5d-aa01-6b91a3e9620b admin admin] PATH_INFO: `/v3/projects/4ae1cc953fca472c881e453eed17c47a/users/2c35338b7b914383b3fe3bce30c03cef/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:11.737959 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb5c04-6197-4d5d-aa01-6b91a3e9620b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ae1cc953fca472c881e453eed17c47a, user_id=2c35338b7b914383b3fe3bce30c03cef, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:11.741143 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb5c04-6197-4d5d-aa01-6b91a3e9620b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:11.751074 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9f4a6-eae7-46c4-957d-7a9b92bf0b04 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:11.764707 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 838/1663] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:11 2022] PUT /identity/v3/projects/4ae1cc953fca472c881e453eed17c47a/users/2c35338b7b914383b3fe3bce30c03cef/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:11.766090 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b600056-f303-4373-ba41-70adaa5570ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:11.767084 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b600056-f303-4373-ba41-70adaa5570ea admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:11.767598 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b600056-f303-4373-ba41-70adaa5570ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:11.768031 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b600056-f303-4373-ba41-70adaa5570ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:11.768887 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b600056-f303-4373-ba41-70adaa5570ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:11.774900 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b600056-f303-4373-ba41-70adaa5570ea admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:11.778619 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facbc64-c42f-4d2e-baa4-c0d5feeac103 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:11.778920 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facbc64-c42f-4d2e-baa4-c0d5feeac103 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:11.790474 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facbc64-c42f-4d2e-baa4-c0d5feeac103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:11.832280 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 826/1664] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:11:11 2022] POST /identity/v3/projects => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:11.836933 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b600056-f303-4373-ba41-70adaa5570ea admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:11.895658 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-2facbc64-c42f-4d2e-baa4-c0d5feeac103 None None] MFA Rules not processed for user `2c35338b7b914383b3fe3bce30c03cef`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:11.896915 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-2facbc64-c42f-4d2e-baa4-c0d5feeac103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:12.094691 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b600056-f303-4373-ba41-70adaa5570ea admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:12.106070 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885fcbc-f437-42f6-ba39-2ead6c466529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:12.107483 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885fcbc-f437-42f6-ba39-2ead6c466529 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:12.108037 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885fcbc-f437-42f6-ba39-2ead6c466529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:12.108779 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885fcbc-f437-42f6-ba39-2ead6c466529 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:12.119073 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9885fcbc-f437-42f6-ba39-2ead6c466529 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:12.127839 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9885fcbc-f437-42f6-ba39-2ead6c466529 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:12.148189 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 839/1665] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:11 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:12.162535 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facbc64-c42f-4d2e-baa4-c0d5feeac103 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:12.163987 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-2facbc64-c42f-4d2e-baa4-c0d5feeac103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:12.212621 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 827/1666] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:11:11 2022] POST /identity/v3/users => generated 284 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:12.217227 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885fcbc-f437-42f6-ba39-2ead6c466529 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:12.277037 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885fcbc-f437-42f6-ba39-2ead6c466529 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:12.305266 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed2b0d-0d11-4ca7-b4e9-25ad8205074a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:12.306229 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed2b0d-0d11-4ca7-b4e9-25ad8205074a admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:12.309465 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed2b0d-0d11-4ca7-b4e9-25ad8205074a admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:12.309968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed2b0d-0d11-4ca7-b4e9-25ad8205074a admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:12.310968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ed2b0d-0d11-4ca7-b4e9-25ad8205074a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:12.329052 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ed2b0d-0d11-4ca7-b4e9-25ad8205074a admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:12.340459 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:12.387509 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 828/1667] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:12.393351 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed2b0d-0d11-4ca7-b4e9-25ad8205074a admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:12.408513 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facbc64-c42f-4d2e-baa4-c0d5feeac103 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:12.431889 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2641527-8c52-4a8b-82ce-bc2c34d7ce16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:12.438893 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2641527-8c52-4a8b-82ce-bc2c34d7ce16 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:12.439216 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2641527-8c52-4a8b-82ce-bc2c34d7ce16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:12.443058 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2641527-8c52-4a8b-82ce-bc2c34d7ce16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:12.450175 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed2b0d-0d11-4ca7-b4e9-25ad8205074a admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:12.486667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ee571-944f-45b9-8343-3c0ab0358b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:12.488642 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ee571-944f-45b9-8343-3c0ab0358b6a admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:12.491513 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ee571-944f-45b9-8343-3c0ab0358b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:12.492019 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ee571-944f-45b9-8343-3c0ab0358b6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:12.494338 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913ee571-944f-45b9-8343-3c0ab0358b6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:12.505407 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913ee571-944f-45b9-8343-3c0ab0358b6a admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:12.505894 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2641527-8c52-4a8b-82ce-bc2c34d7ce16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:12.515976 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2641527-8c52-4a8b-82ce-bc2c34d7ce16 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:12.553725 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 829/1668] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:12.554846 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ee571-944f-45b9-8343-3c0ab0358b6a admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:12.561287 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 840/1669] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:12 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 04:11:12.589266 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ee571-944f-45b9-8343-3c0ab0358b6a admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:12.594744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455b5e5-a1ce-462d-ac97-3d59bb5aebb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:12.595681 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455b5e5-a1ce-462d-ac97-3d59bb5aebb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:12.595969 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455b5e5-a1ce-462d-ac97-3d59bb5aebb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:12.596253 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455b5e5-a1ce-462d-ac97-3d59bb5aebb6 admin admin] PATH_INFO: `/v3/projects/87265fd1ba2b4b75b09604dfddfcf5db/users/c0a1842511344cb083ecbfbf2f4dc736/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:12.619629 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455b5e5-a1ce-462d-ac97-3d59bb5aebb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87265fd1ba2b4b75b09604dfddfcf5db, user_id=c0a1842511344cb083ecbfbf2f4dc736, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:12.623491 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455b5e5-a1ce-462d-ac97-3d59bb5aebb6 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:12.656947 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 830/1670] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:12 2022] PUT /identity/v3/projects/87265fd1ba2b4b75b09604dfddfcf5db/users/c0a1842511344cb083ecbfbf2f4dc736/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:12.668996 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573c2a2-1ab8-4306-8ffe-e299a778fac3 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:12.669634 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573c2a2-1ab8-4306-8ffe-e299a778fac3 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:12.669634 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573c2a2-1ab8-4306-8ffe-e299a778fac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:12.755727 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-f573c2a2-1ab8-4306-8ffe-e299a778fac3 None None] MFA Rules not processed for user `c0a1842511344cb083ecbfbf2f4dc736`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:12.761965 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f573c2a2-1ab8-4306-8ffe-e299a778fac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:12.992748 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 841/1671] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:13.140683 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455b5e5-a1ce-462d-ac97-3d59bb5aebb6 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:13.335587 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455b5e5-a1ce-462d-ac97-3d59bb5aebb6 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:13.344286 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa426050-f0c1-4da8-8c00-97d09682e9b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:13.345962 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa426050-f0c1-4da8-8c00-97d09682e9b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:13.345962 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa426050-f0c1-4da8-8c00-97d09682e9b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:13.345962 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa426050-f0c1-4da8-8c00-97d09682e9b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:13.370026 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa426050-f0c1-4da8-8c00-97d09682e9b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:13.374273 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa426050-f0c1-4da8-8c00-97d09682e9b6 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:13.400816 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 831/1672] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:13 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:14.136960 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573c2a2-1ab8-4306-8ffe-e299a778fac3 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:14.138389 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f573c2a2-1ab8-4306-8ffe-e299a778fac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:14.314207 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573c2a2-1ab8-4306-8ffe-e299a778fac3 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:14.326139 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5801b-e78c-4cb5-849c-80a90f32b3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:14.327309 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5801b-e78c-4cb5-849c-80a90f32b3e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:14.327734 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5801b-e78c-4cb5-849c-80a90f32b3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:14.328178 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5801b-e78c-4cb5-849c-80a90f32b3e9 admin admin] PATH_INFO: `/v3/users/18f749cc6de44abd9958cc3e2af288ca` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:14.332430 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5801b-e78c-4cb5-849c-80a90f32b3e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18f749cc6de44abd9958cc3e2af288ca)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:14.340004 dv-cinder-742162-5-smb devstack@keystone.service[80362]: WARNING py.warnings [None req-5ba5801b-e78c-4cb5-849c-80a90f32b3e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 04 04:11:14.340004 dv-cinder-742162-5-smb devstack@keystone.service[80362]: warnings.warn(msg) Jul 04 04:11:14.340004 dv-cinder-742162-5-smb devstack@keystone.service[80362]: Jul 04 04:11:14.341893 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5801b-e78c-4cb5-849c-80a90f32b3e9 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:14.486814 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5ba5801b-e78c-4cb5-849c-80a90f32b3e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18f749cc6de44abd9958cc3e2af288ca'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:14.507475 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5ba5801b-e78c-4cb5-849c-80a90f32b3e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18f749cc6de44abd9958cc3e2af288ca'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:14.508826 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5ba5801b-e78c-4cb5-849c-80a90f32b3e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18f749cc6de44abd9958cc3e2af288ca'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:14.553589 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5ba5801b-e78c-4cb5-849c-80a90f32b3e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18f749cc6de44abd9958cc3e2af288ca'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:14.555862 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5ba5801b-e78c-4cb5-849c-80a90f32b3e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18f749cc6de44abd9958cc3e2af288ca'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:14.562487 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:14.595214 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 842/1673] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:11:14 2022] DELETE /identity/v3/users/18f749cc6de44abd9958cc3e2af288ca => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:14.600489 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214981da-cbfc-48a8-a04f-f01ad214c582 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:14.601957 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214981da-cbfc-48a8-a04f-f01ad214c582 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:14.602463 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214981da-cbfc-48a8-a04f-f01ad214c582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:14.636717 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-214981da-cbfc-48a8-a04f-f01ad214c582 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:14.638390 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-214981da-cbfc-48a8-a04f-f01ad214c582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:14.685049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:14.781800 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 832/1674] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:14.795133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5801b-e78c-4cb5-849c-80a90f32b3e9 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:14.796736 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-5ba5801b-e78c-4cb5-849c-80a90f32b3e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:14.941251 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5801b-e78c-4cb5-849c-80a90f32b3e9 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:14.951304 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30960d-fa89-4a64-a6cf-888efe5a18f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:14.954758 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30960d-fa89-4a64-a6cf-888efe5a18f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:14.955382 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30960d-fa89-4a64-a6cf-888efe5a18f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:14.956465 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30960d-fa89-4a64-a6cf-888efe5a18f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:14.960592 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214981da-cbfc-48a8-a04f-f01ad214c582 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:14.962920 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-214981da-cbfc-48a8-a04f-f01ad214c582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:14.996466 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214981da-cbfc-48a8-a04f-f01ad214c582 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:15.005086 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff30960d-fa89-4a64-a6cf-888efe5a18f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:15.010805 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff30960d-fa89-4a64-a6cf-888efe5a18f4 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:15.016938 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ffe2bf-b910-48b0-ad9d-98b3a2c00f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:15.017856 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffe2bf-b910-48b0-ad9d-98b3a2c00f33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:15.018227 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffe2bf-b910-48b0-ad9d-98b3a2c00f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:15.018515 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffe2bf-b910-48b0-ad9d-98b3a2c00f33 admin admin] PATH_INFO: `/v3/users/09ce8e5d701a48898f5cb738fa2713ca` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:15.023727 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ffe2bf-b910-48b0-ad9d-98b3a2c00f33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09ce8e5d701a48898f5cb738fa2713ca)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:15.026132 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ffe2bf-b910-48b0-ad9d-98b3a2c00f33 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:15.050443 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 843/1675] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:15.150457 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f8ffe2bf-b910-48b0-ad9d-98b3a2c00f33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09ce8e5d701a48898f5cb738fa2713ca'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:15.157250 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f8ffe2bf-b910-48b0-ad9d-98b3a2c00f33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09ce8e5d701a48898f5cb738fa2713ca'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:15.183010 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f8ffe2bf-b910-48b0-ad9d-98b3a2c00f33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09ce8e5d701a48898f5cb738fa2713ca'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:15.203337 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f8ffe2bf-b910-48b0-ad9d-98b3a2c00f33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09ce8e5d701a48898f5cb738fa2713ca'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:15.208636 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f8ffe2bf-b910-48b0-ad9d-98b3a2c00f33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09ce8e5d701a48898f5cb738fa2713ca'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:15.254844 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 833/1676] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:11:14 2022] DELETE /identity/v3/users/09ce8e5d701a48898f5cb738fa2713ca => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:15.257324 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99314c-e041-4e89-9d9c-6b1b8b124b3f None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:15.257832 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99314c-e041-4e89-9d9c-6b1b8b124b3f None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:15.258084 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99314c-e041-4e89-9d9c-6b1b8b124b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:15.295076 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ed99314c-e041-4e89-9d9c-6b1b8b124b3f None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:15.297408 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ed99314c-e041-4e89-9d9c-6b1b8b124b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:15.490911 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 844/1677] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:11:15.544816 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ffe2bf-b910-48b0-ad9d-98b3a2c00f33 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:15.552300 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f8ffe2bf-b910-48b0-ad9d-98b3a2c00f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:15.731072 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ffe2bf-b910-48b0-ad9d-98b3a2c00f33 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:15.738039 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fb5dc-0866-4595-996a-869f466ff48a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:15.738765 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fb5dc-0866-4595-996a-869f466ff48a service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:15.739063 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fb5dc-0866-4595-996a-869f466ff48a service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:15.739346 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fb5dc-0866-4595-996a-869f466ff48a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:15.769513 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9fb5dc-0866-4595-996a-869f466ff48a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:15.773435 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9fb5dc-0866-4595-996a-869f466ff48a service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:15.804456 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 834/1678] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:17.543052 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99314c-e041-4e89-9d9c-6b1b8b124b3f None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:17.544371 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ed99314c-e041-4e89-9d9c-6b1b8b124b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:17.564227 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99314c-e041-4e89-9d9c-6b1b8b124b3f None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:17.592033 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a64a06-9096-49d4-8b8b-8d363c3e9603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:17.594330 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a64a06-9096-49d4-8b8b-8d363c3e9603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:17.600363 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a64a06-9096-49d4-8b8b-8d363c3e9603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:17.600945 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a64a06-9096-49d4-8b8b-8d363c3e9603 admin admin] PATH_INFO: `/v3/projects/90a6497a6f1040fe907164c42f161c1b` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:17.603948 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a64a06-9096-49d4-8b8b-8d363c3e9603 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90a6497a6f1040fe907164c42f161c1b)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:17.610687 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a64a06-9096-49d4-8b8b-8d363c3e9603 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:17.738578 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-d7a64a06-9096-49d4-8b8b-8d363c3e9603 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90a6497a6f1040fe907164c42f161c1b', 'request_id': 'req-d7a64a06-9096-49d4-8b8b-8d363c3e9603'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:17.756950 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-d7a64a06-9096-49d4-8b8b-8d363c3e9603 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90a6497a6f1040fe907164c42f161c1b', 'request_id': 'req-d7a64a06-9096-49d4-8b8b-8d363c3e9603'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:17.773569 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-d7a64a06-9096-49d4-8b8b-8d363c3e9603 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90a6497a6f1040fe907164c42f161c1b', 'request_id': 'req-d7a64a06-9096-49d4-8b8b-8d363c3e9603'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:17.797739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-d7a64a06-9096-49d4-8b8b-8d363c3e9603 admin admin] The token cache is being invalidate because project 90a6497a6f1040fe907164c42f161c1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:11:17.798254 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-d7a64a06-9096-49d4-8b8b-8d363c3e9603 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:17.801945 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-d7a64a06-9096-49d4-8b8b-8d363c3e9603 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:17.804282 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 845/1679] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:11:17 2022] DELETE /identity/v3/projects/90a6497a6f1040fe907164c42f161c1b => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:17.810381 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd05b74-ea19-4fcb-9938-938cfa48259a None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:17.810916 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd05b74-ea19-4fcb-9938-938cfa48259a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:17.811174 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd05b74-ea19-4fcb-9938-938cfa48259a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:17.844118 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-fbd05b74-ea19-4fcb-9938-938cfa48259a None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:17.846713 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-fbd05b74-ea19-4fcb-9938-938cfa48259a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:17.932350 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:17.999038 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 835/1680] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:18.006910 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a90c07-bb64-40c5-ae7a-1fdd9c13d698 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:18.007303 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a90c07-bb64-40c5-ae7a-1fdd9c13d698 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:18.007776 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a90c07-bb64-40c5-ae7a-1fdd9c13d698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:18.048710 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-e5a90c07-bb64-40c5-ae7a-1fdd9c13d698 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:18.050849 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e5a90c07-bb64-40c5-ae7a-1fdd9c13d698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:18.084532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 846/1681] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:18.087660 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd05b74-ea19-4fcb-9938-938cfa48259a None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:18.101794 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd05b74-ea19-4fcb-9938-938cfa48259a None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:18.122905 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f9a1ba-6a9b-41b3-a610-6ccf0c1a1e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:18.123785 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9a1ba-6a9b-41b3-a610-6ccf0c1a1e74 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:18.124214 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9a1ba-6a9b-41b3-a610-6ccf0c1a1e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:18.124961 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9a1ba-6a9b-41b3-a610-6ccf0c1a1e74 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:18.136281 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f9a1ba-6a9b-41b3-a610-6ccf0c1a1e74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:11:18.137480 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f9a1ba-6a9b-41b3-a610-6ccf0c1a1e74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:18.142282 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f9a1ba-6a9b-41b3-a610-6ccf0c1a1e74 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:18.179472 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 836/1682] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 04:11:18.183583 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a90c07-bb64-40c5-ae7a-1fdd9c13d698 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:18.199762 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a90c07-bb64-40c5-ae7a-1fdd9c13d698 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:18.227810 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2a13e-0d0d-47f1-99e6-ab8da22f6577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:18.230912 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2a13e-0d0d-47f1-99e6-ab8da22f6577 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:18.232321 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2a13e-0d0d-47f1-99e6-ab8da22f6577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:18.232621 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2a13e-0d0d-47f1-99e6-ab8da22f6577 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:18.238751 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b2a13e-0d0d-47f1-99e6-ab8da22f6577 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:18.246471 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b2a13e-0d0d-47f1-99e6-ab8da22f6577 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:18.299217 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:18.389385 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 847/1683] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:11:18 2022] POST /identity/v3/projects => generated 379 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:18.391974 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f9a1ba-6a9b-41b3-a610-6ccf0c1a1e74 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:18.420524 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f9a1ba-6a9b-41b3-a610-6ccf0c1a1e74 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:18.458726 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2a13e-0d0d-47f1-99e6-ab8da22f6577 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:18.460656 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-33b2a13e-0d0d-47f1-99e6-ab8da22f6577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:18.594056 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ad636-afb6-4b15-be89-738195eb917e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:18.595267 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ad636-afb6-4b15-be89-738195eb917e admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:18.595822 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ad636-afb6-4b15-be89-738195eb917e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:18.597675 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ad636-afb6-4b15-be89-738195eb917e admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:18.599496 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ad636-afb6-4b15-be89-738195eb917e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:18.613282 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ad636-afb6-4b15-be89-738195eb917e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:18.617173 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2a13e-0d0d-47f1-99e6-ab8da22f6577 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:18.633684 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8ef0d-0835-465d-acc2-8e9588cb91ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:18.636020 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8ef0d-0835-465d-acc2-8e9588cb91ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:18.637687 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8ef0d-0835-465d-acc2-8e9588cb91ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:18.638275 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8ef0d-0835-465d-acc2-8e9588cb91ec admin admin] PATH_INFO: `/v3/users/6e561bcab97d4720856cd7ea1765fb63` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:18.643759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d8ef0d-0835-465d-acc2-8e9588cb91ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e561bcab97d4720856cd7ea1765fb63)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:18.651000 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d8ef0d-0835-465d-acc2-8e9588cb91ec admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:18.676321 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 837/1684] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:11:18 2022] POST /identity/v3/users => generated 290 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:18.679004 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ad636-afb6-4b15-be89-738195eb917e admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:18.708953 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ad636-afb6-4b15-be89-738195eb917e admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:18.737336 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd036c4-a8c9-4cb1-a63c-eb83fddb9b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:18.737919 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd036c4-a8c9-4cb1-a63c-eb83fddb9b46 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:18.738353 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd036c4-a8c9-4cb1-a63c-eb83fddb9b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:18.738504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd036c4-a8c9-4cb1-a63c-eb83fddb9b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:18.739316 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd036c4-a8c9-4cb1-a63c-eb83fddb9b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:18.741102 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd036c4-a8c9-4cb1-a63c-eb83fddb9b46 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:18.771957 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 838/1685] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:18.773004 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd036c4-a8c9-4cb1-a63c-eb83fddb9b46 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:18.788898 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd036c4-a8c9-4cb1-a63c-eb83fddb9b46 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:18.795050 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c9d8ef0d-0835-465d-acc2-8e9588cb91ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e561bcab97d4720856cd7ea1765fb63'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:18.809403 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c9d8ef0d-0835-465d-acc2-8e9588cb91ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e561bcab97d4720856cd7ea1765fb63'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:18.810552 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db09cc-f6f0-450b-9606-a032c1babe60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:18.811106 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c9d8ef0d-0835-465d-acc2-8e9588cb91ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e561bcab97d4720856cd7ea1765fb63'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:18.812069 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db09cc-f6f0-450b-9606-a032c1babe60 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:18.812521 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db09cc-f6f0-450b-9606-a032c1babe60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:18.813272 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db09cc-f6f0-450b-9606-a032c1babe60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:18.814842 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db09cc-f6f0-450b-9606-a032c1babe60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:18.817062 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db09cc-f6f0-450b-9606-a032c1babe60 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:18.835015 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 839/1686] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:18.838560 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db09cc-f6f0-450b-9606-a032c1babe60 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:18.843746 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c9d8ef0d-0835-465d-acc2-8e9588cb91ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e561bcab97d4720856cd7ea1765fb63'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:18.845984 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c9d8ef0d-0835-465d-acc2-8e9588cb91ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e561bcab97d4720856cd7ea1765fb63'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:18.849292 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-62db09cc-f6f0-450b-9606-a032c1babe60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:18.870230 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db09cc-f6f0-450b-9606-a032c1babe60 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:18.882584 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347af42-caea-40c5-9b99-2b878aa1f831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:18.883498 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 848/1687] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:11:18 2022] DELETE /identity/v3/users/6e561bcab97d4720856cd7ea1765fb63 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 04:11:18.884371 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347af42-caea-40c5-9b99-2b878aa1f831 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:18.884998 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347af42-caea-40c5-9b99-2b878aa1f831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:18.885449 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347af42-caea-40c5-9b99-2b878aa1f831 admin admin] PATH_INFO: `/v3/projects/336f1e28382844c29dd034dd6f4b78cf/users/f775e2819089476eb28b929aeb8ac45c/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:18.888619 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b34a0-5504-4cac-85d9-144f164aeb93 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:18.889277 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b34a0-5504-4cac-85d9-144f164aeb93 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:18.890261 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b34a0-5504-4cac-85d9-144f164aeb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:18.935336 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b347af42-caea-40c5-9b99-2b878aa1f831 admin admin] RBAC: Authorizing `identity:create_grant(project_id=336f1e28382844c29dd034dd6f4b78cf, user_id=f775e2819089476eb28b929aeb8ac45c, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:18.945200 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b347af42-caea-40c5-9b99-2b878aa1f831 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:18.948924 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-f89b34a0-5504-4cac-85d9-144f164aeb93 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:18.950610 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f89b34a0-5504-4cac-85d9-144f164aeb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:18.976915 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 840/1688] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:18 2022] PUT /identity/v3/projects/336f1e28382844c29dd034dd6f4b78cf/users/f775e2819089476eb28b929aeb8ac45c/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:18.989967 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd61bb-9495-466c-90ed-ac5ec46fe3ea None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:18.990870 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd61bb-9495-466c-90ed-ac5ec46fe3ea None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:18.994469 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd61bb-9495-466c-90ed-ac5ec46fe3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:19.076078 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-43fd61bb-9495-466c-90ed-ac5ec46fe3ea None None] MFA Rules not processed for user `f775e2819089476eb28b929aeb8ac45c`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:19.080418 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-43fd61bb-9495-466c-90ed-ac5ec46fe3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:19.135911 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 849/1689] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:19.210793 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b34a0-5504-4cac-85d9-144f164aeb93 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:19.213939 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f89b34a0-5504-4cac-85d9-144f164aeb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:19.237803 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:19.264821 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:19.282612 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 841/1690] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:19.287913 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd61bb-9495-466c-90ed-ac5ec46fe3ea None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:19.395497 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b34a0-5504-4cac-85d9-144f164aeb93 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:19.472882 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd61bb-9495-466c-90ed-ac5ec46fe3ea None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:19.480918 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46c519-03a9-4803-90f3-37657c9ff5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:19.481631 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46c519-03a9-4803-90f3-37657c9ff5b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:19.481923 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46c519-03a9-4803-90f3-37657c9ff5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:19.482276 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46c519-03a9-4803-90f3-37657c9ff5b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:19.483791 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e46c519-03a9-4803-90f3-37657c9ff5b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:19.490273 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e46c519-03a9-4803-90f3-37657c9ff5b8 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:19.573352 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 842/1691] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:11:19 2022] POST /identity/v3/projects => generated 381 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:19.575042 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46c519-03a9-4803-90f3-37657c9ff5b8 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:19.581509 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-8e46c519-03a9-4803-90f3-37657c9ff5b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:19.590990 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1b7d1-fe7d-45d9-8468-324dc16f8fb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:19.591682 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1b7d1-fe7d-45d9-8468-324dc16f8fb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:19.591970 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1b7d1-fe7d-45d9-8468-324dc16f8fb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:19.592403 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1b7d1-fe7d-45d9-8468-324dc16f8fb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:19.622940 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1b7d1-fe7d-45d9-8468-324dc16f8fb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:19.625802 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1b7d1-fe7d-45d9-8468-324dc16f8fb9 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:19.682800 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 850/1692] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:19.683984 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1b7d1-fe7d-45d9-8468-324dc16f8fb9 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:19.691966 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46c519-03a9-4803-90f3-37657c9ff5b8 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:19.698448 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790481b-5fd0-4ab7-96c5-296a61d9fdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:19.700517 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790481b-5fd0-4ab7-96c5-296a61d9fdb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:19.700919 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790481b-5fd0-4ab7-96c5-296a61d9fdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:19.701313 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790481b-5fd0-4ab7-96c5-296a61d9fdb1 admin admin] PATH_INFO: `/v3/projects/1e41bca01ee9464f8754ba6cce08e9e2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:19.703788 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790481b-5fd0-4ab7-96c5-296a61d9fdb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e41bca01ee9464f8754ba6cce08e9e2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:19.706582 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790481b-5fd0-4ab7-96c5-296a61d9fdb1 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:19.708125 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1b7d1-fe7d-45d9-8468-324dc16f8fb9 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:19.729797 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1209ce1-56a4-4cbc-9ffe-16f56017bb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:19.730623 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1209ce1-56a4-4cbc-9ffe-16f56017bb92 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:19.730914 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1209ce1-56a4-4cbc-9ffe-16f56017bb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:19.731205 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1209ce1-56a4-4cbc-9ffe-16f56017bb92 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:19.736383 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1209ce1-56a4-4cbc-9ffe-16f56017bb92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:19.738458 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1209ce1-56a4-4cbc-9ffe-16f56017bb92 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:19.783096 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2790481b-5fd0-4ab7-96c5-296a61d9fdb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e41bca01ee9464f8754ba6cce08e9e2', 'request_id': 'req-2790481b-5fd0-4ab7-96c5-296a61d9fdb1'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:19.801247 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2790481b-5fd0-4ab7-96c5-296a61d9fdb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e41bca01ee9464f8754ba6cce08e9e2', 'request_id': 'req-2790481b-5fd0-4ab7-96c5-296a61d9fdb1'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:19.817734 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 851/1693] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:11:19 2022] POST /identity/v3/users => generated 297 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:19.820979 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1209ce1-56a4-4cbc-9ffe-16f56017bb92 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:19.836462 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2790481b-5fd0-4ab7-96c5-296a61d9fdb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e41bca01ee9464f8754ba6cce08e9e2', 'request_id': 'req-2790481b-5fd0-4ab7-96c5-296a61d9fdb1'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:19.850995 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1209ce1-56a4-4cbc-9ffe-16f56017bb92 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:19.867848 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2790481b-5fd0-4ab7-96c5-296a61d9fdb1 admin admin] The token cache is being invalidate because project 1e41bca01ee9464f8754ba6cce08e9e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:11:19.870341 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2790481b-5fd0-4ab7-96c5-296a61d9fdb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:19.871825 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2790481b-5fd0-4ab7-96c5-296a61d9fdb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:19.875506 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 843/1694] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:11:19 2022] DELETE /identity/v3/projects/1e41bca01ee9464f8754ba6cce08e9e2 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:19.886606 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790481b-5fd0-4ab7-96c5-296a61d9fdb1 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:19.892226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-2790481b-5fd0-4ab7-96c5-296a61d9fdb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:19.933827 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:20.045756 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12037b7e-b3bb-47d8-acc4-756cab121724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:20.046909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12037b7e-b3bb-47d8-acc4-756cab121724 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:20.047950 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12037b7e-b3bb-47d8-acc4-756cab121724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:20.048070 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790481b-5fd0-4ab7-96c5-296a61d9fdb1 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:20.048381 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12037b7e-b3bb-47d8-acc4-756cab121724 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:20.049333 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12037b7e-b3bb-47d8-acc4-756cab121724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:20.051787 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12037b7e-b3bb-47d8-acc4-756cab121724 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:20.067194 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b8524-18f7-4dec-aa1f-86a067d3a61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:20.068134 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b8524-18f7-4dec-aa1f-86a067d3a61e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:20.068603 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b8524-18f7-4dec-aa1f-86a067d3a61e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:20.068897 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b8524-18f7-4dec-aa1f-86a067d3a61e admin admin] PATH_INFO: `/v3/users/2c35338b7b914383b3fe3bce30c03cef` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:20.071437 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b8524-18f7-4dec-aa1f-86a067d3a61e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c35338b7b914383b3fe3bce30c03cef)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:20.071569 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 852/1695] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:20.073392 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515901c9-c79f-4e76-82c9-cf64127afb62 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:20.073946 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515901c9-c79f-4e76-82c9-cf64127afb62 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:20.075446 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515901c9-c79f-4e76-82c9-cf64127afb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:20.076240 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b8524-18f7-4dec-aa1f-86a067d3a61e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:20.131790 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-515901c9-c79f-4e76-82c9-cf64127afb62 None None] MFA Rules not processed for user `c8ada8b86e2f4ad18c8af021def1a30e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:20.133173 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-515901c9-c79f-4e76-82c9-cf64127afb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:20.219242 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-116b8524-18f7-4dec-aa1f-86a067d3a61e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c35338b7b914383b3fe3bce30c03cef'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:20.221389 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-116b8524-18f7-4dec-aa1f-86a067d3a61e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c35338b7b914383b3fe3bce30c03cef'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:20.224717 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:20.240221 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-116b8524-18f7-4dec-aa1f-86a067d3a61e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c35338b7b914383b3fe3bce30c03cef'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:20.272222 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-116b8524-18f7-4dec-aa1f-86a067d3a61e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c35338b7b914383b3fe3bce30c03cef'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:20.272971 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-116b8524-18f7-4dec-aa1f-86a067d3a61e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c35338b7b914383b3fe3bce30c03cef'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:20.291487 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 844/1696] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:11:19 2022] DELETE /identity/v3/users/2c35338b7b914383b3fe3bce30c03cef => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:20.291487 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b8524-18f7-4dec-aa1f-86a067d3a61e admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:20.297293 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-116b8524-18f7-4dec-aa1f-86a067d3a61e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:20.322785 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 853/1697] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:20.324411 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e40b23-30d1-4bc0-b7a3-33d13ef550e5 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:20.324712 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e40b23-30d1-4bc0-b7a3-33d13ef550e5 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:20.324997 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e40b23-30d1-4bc0-b7a3-33d13ef550e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:20.380992 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-b0e40b23-30d1-4bc0-b7a3-33d13ef550e5 None None] MFA Rules not processed for user `0be198ad83014acfab897498c2d68d7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:20.383211 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b0e40b23-30d1-4bc0-b7a3-33d13ef550e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:20.567399 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b8524-18f7-4dec-aa1f-86a067d3a61e admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:20.584308 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e48c67-980e-4cc4-b122-cbe00b14af34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:20.585393 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e48c67-980e-4cc4-b122-cbe00b14af34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:20.585688 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e48c67-980e-4cc4-b122-cbe00b14af34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:20.585973 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e48c67-980e-4cc4-b122-cbe00b14af34 admin admin] PATH_INFO: `/v3/projects/1e848f5121a344a19d5ccf603140669b/users/596f419de0114934a2afe62a103ecf36/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:20.595667 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 854/1698] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:20.599707 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e40b23-30d1-4bc0-b7a3-33d13ef550e5 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:20.619608 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b0e40b23-30d1-4bc0-b7a3-33d13ef550e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:20.646599 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e48c67-980e-4cc4-b122-cbe00b14af34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e848f5121a344a19d5ccf603140669b, user_id=596f419de0114934a2afe62a103ecf36, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:20.649437 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e48c67-980e-4cc4-b122-cbe00b14af34 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:20.678202 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 845/1699] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:20 2022] PUT /identity/v3/projects/1e848f5121a344a19d5ccf603140669b/users/596f419de0114934a2afe62a103ecf36/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:20.679812 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e48c67-980e-4cc4-b122-cbe00b14af34 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:20.717280 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:20.841933 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e40b23-30d1-4bc0-b7a3-33d13ef550e5 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:20.862339 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e48c67-980e-4cc4-b122-cbe00b14af34 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:20.874983 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d866c6b-5195-44fa-9423-5ddb5158e895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:20.875699 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d866c6b-5195-44fa-9423-5ddb5158e895 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:20.876011 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d866c6b-5195-44fa-9423-5ddb5158e895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:20.876334 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d866c6b-5195-44fa-9423-5ddb5158e895 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:20.877103 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d866c6b-5195-44fa-9423-5ddb5158e895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:20.882548 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d866c6b-5195-44fa-9423-5ddb5158e895 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:20.911587 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 846/1700] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 04:11:20.912618 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d866c6b-5195-44fa-9423-5ddb5158e895 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:20.917511 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9d866c6b-5195-44fa-9423-5ddb5158e895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:20.959410 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:20.973387 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62507229-48a8-47bf-ace1-e9426f858f2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:20.974631 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62507229-48a8-47bf-ace1-e9426f858f2b service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:20.975043 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62507229-48a8-47bf-ace1-e9426f858f2b service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:20.975476 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62507229-48a8-47bf-ace1-e9426f858f2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:20.978056 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-62507229-48a8-47bf-ace1-e9426f858f2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:21.056732 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62507229-48a8-47bf-ace1-e9426f858f2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:21.058524 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62507229-48a8-47bf-ace1-e9426f858f2b service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:21.070527 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 855/1701] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:21.071407 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62507229-48a8-47bf-ace1-e9426f858f2b service nova] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:21.083577 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62507229-48a8-47bf-ace1-e9426f858f2b service nova] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:21.089306 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480a27e-7a9b-4635-906c-b901b53573ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:21.090548 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480a27e-7a9b-4635-906c-b901b53573ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:21.090843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480a27e-7a9b-4635-906c-b901b53573ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:21.091132 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480a27e-7a9b-4635-906c-b901b53573ee admin admin] PATH_INFO: `/v3/projects/1e848f5121a344a19d5ccf603140669b/users/596f419de0114934a2afe62a103ecf36/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:21.093409 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6480a27e-7a9b-4635-906c-b901b53573ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e848f5121a344a19d5ccf603140669b, user_id=596f419de0114934a2afe62a103ecf36, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:21.096680 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6480a27e-7a9b-4635-906c-b901b53573ee admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:21.122058 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 856/1702] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:21 2022] PUT /identity/v3/projects/1e848f5121a344a19d5ccf603140669b/users/596f419de0114934a2afe62a103ecf36/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:21.123180 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480a27e-7a9b-4635-906c-b901b53573ee admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:21.125072 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6480a27e-7a9b-4635-906c-b901b53573ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:21.147477 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d866c6b-5195-44fa-9423-5ddb5158e895 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:21.208460 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480a27e-7a9b-4635-906c-b901b53573ee admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:21.214440 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68f817-ff12-4b2d-8533-5a1cb58dfb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:21.216072 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68f817-ff12-4b2d-8533-5a1cb58dfb4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:21.216440 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68f817-ff12-4b2d-8533-5a1cb58dfb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:21.216951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68f817-ff12-4b2d-8533-5a1cb58dfb4d admin admin] PATH_INFO: `/v3/projects/4ae1cc953fca472c881e453eed17c47a` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:21.218642 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac68f817-ff12-4b2d-8533-5a1cb58dfb4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ae1cc953fca472c881e453eed17c47a)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:21.220716 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac68f817-ff12-4b2d-8533-5a1cb58dfb4d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:21.283108 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ac68f817-ff12-4b2d-8533-5a1cb58dfb4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ae1cc953fca472c881e453eed17c47a', 'request_id': 'req-ac68f817-ff12-4b2d-8533-5a1cb58dfb4d'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:21.293144 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ac68f817-ff12-4b2d-8533-5a1cb58dfb4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ae1cc953fca472c881e453eed17c47a', 'request_id': 'req-ac68f817-ff12-4b2d-8533-5a1cb58dfb4d'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:21.301036 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ac68f817-ff12-4b2d-8533-5a1cb58dfb4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ae1cc953fca472c881e453eed17c47a', 'request_id': 'req-ac68f817-ff12-4b2d-8533-5a1cb58dfb4d'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:21.322891 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ac68f817-ff12-4b2d-8533-5a1cb58dfb4d admin admin] The token cache is being invalidate because project 4ae1cc953fca472c881e453eed17c47a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:11:21.323193 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ac68f817-ff12-4b2d-8533-5a1cb58dfb4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:21.324175 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ac68f817-ff12-4b2d-8533-5a1cb58dfb4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:21.326110 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 857/1703] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:11:21 2022] DELETE /identity/v3/projects/4ae1cc953fca472c881e453eed17c47a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:21.327967 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04d1e5-b1f3-490f-8025-791a632286fc None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:21.328265 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04d1e5-b1f3-490f-8025-791a632286fc None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:21.329297 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04d1e5-b1f3-490f-8025-791a632286fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:21.360389 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca28eaad-8c9f-42b9-8934-1729b4483b82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:21.361063 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28eaad-8c9f-42b9-8934-1729b4483b82 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:21.362187 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28eaad-8c9f-42b9-8934-1729b4483b82 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:21.362295 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28eaad-8c9f-42b9-8934-1729b4483b82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:21.370769 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ff04d1e5-b1f3-490f-8025-791a632286fc None None] MFA Rules not processed for user `596f419de0114934a2afe62a103ecf36`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:21.371445 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ca28eaad-8c9f-42b9-8934-1729b4483b82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:21.376270 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ff04d1e5-b1f3-490f-8025-791a632286fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:21.383956 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:21.481808 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:21.510589 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca28eaad-8c9f-42b9-8934-1729b4483b82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:21.512696 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca28eaad-8c9f-42b9-8934-1729b4483b82 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:21.539961 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 858/1704] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:21 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:21.540125 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 847/1705] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:21.540125 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca28eaad-8c9f-42b9-8934-1729b4483b82 service nova] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:21.540125 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ca28eaad-8c9f-42b9-8934-1729b4483b82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:21.554367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c23a1-892a-40b9-b06d-08ddcfe3af05 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:21.554693 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c23a1-892a-40b9-b06d-08ddcfe3af05 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:21.554984 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c23a1-892a-40b9-b06d-08ddcfe3af05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:21.594739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-8c3c23a1-892a-40b9-b06d-08ddcfe3af05 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:21.595742 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca28eaad-8c9f-42b9-8934-1729b4483b82 service nova] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:21.595976 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-8c3c23a1-892a-40b9-b06d-08ddcfe3af05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:21.711040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba245e-4c65-4961-a8a2-adb4146e5a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:21.712222 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba245e-4c65-4961-a8a2-adb4146e5a61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:21.712512 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba245e-4c65-4961-a8a2-adb4146e5a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:21.712935 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba245e-4c65-4961-a8a2-adb4146e5a61 admin admin] PATH_INFO: `/v3/projects/f6171063f02e4b339c62b0e1731c322f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:21.714434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ba245e-4c65-4961-a8a2-adb4146e5a61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6171063f02e4b339c62b0e1731c322f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:21.718351 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ba245e-4c65-4961-a8a2-adb4146e5a61 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:21.776177 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 859/1706] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:21.777352 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c23a1-892a-40b9-b06d-08ddcfe3af05 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:21.779386 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-8c3c23a1-892a-40b9-b06d-08ddcfe3af05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:21.829664 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e8ba245e-4c65-4961-a8a2-adb4146e5a61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6171063f02e4b339c62b0e1731c322f', 'request_id': 'req-e8ba245e-4c65-4961-a8a2-adb4146e5a61'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:21.844696 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e8ba245e-4c65-4961-a8a2-adb4146e5a61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6171063f02e4b339c62b0e1731c322f', 'request_id': 'req-e8ba245e-4c65-4961-a8a2-adb4146e5a61'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:21.858884 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e8ba245e-4c65-4961-a8a2-adb4146e5a61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6171063f02e4b339c62b0e1731c322f', 'request_id': 'req-e8ba245e-4c65-4961-a8a2-adb4146e5a61'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:21.889305 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c23a1-892a-40b9-b06d-08ddcfe3af05 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:21.891535 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e8ba245e-4c65-4961-a8a2-adb4146e5a61 admin admin] The token cache is being invalidate because project f6171063f02e4b339c62b0e1731c322f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:11:21.891535 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e8ba245e-4c65-4961-a8a2-adb4146e5a61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:21.893096 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e8ba245e-4c65-4961-a8a2-adb4146e5a61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:21.902722 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 848/1707] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:11:21 2022] DELETE /identity/v3/projects/f6171063f02e4b339c62b0e1731c322f => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:21.905203 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1df80b-fe03-40bc-bee4-3bb10e0f95a3 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:21.905512 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1df80b-fe03-40bc-bee4-3bb10e0f95a3 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:21.905783 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1df80b-fe03-40bc-bee4-3bb10e0f95a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:21.987787 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-ae1df80b-fe03-40bc-bee4-3bb10e0f95a3 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:21.990013 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ae1df80b-fe03-40bc-bee4-3bb10e0f95a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:22.036427 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6c77b-7f68-4c89-87d3-26d5c9429075 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:22.037510 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6c77b-7f68-4c89-87d3-26d5c9429075 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:22.038051 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6c77b-7f68-4c89-87d3-26d5c9429075 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:22.038575 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6c77b-7f68-4c89-87d3-26d5c9429075 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:22.041520 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e4c6c77b-7f68-4c89-87d3-26d5c9429075 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:22.059354 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:22.072397 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 849/1708] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:22.073639 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1df80b-fe03-40bc-bee4-3bb10e0f95a3 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:22.075023 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ae1df80b-fe03-40bc-bee4-3bb10e0f95a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:22.088893 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1df80b-fe03-40bc-bee4-3bb10e0f95a3 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:22.096290 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d297a8f6-71b9-4336-a0e6-19ffec5bb5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:22.097364 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297a8f6-71b9-4336-a0e6-19ffec5bb5b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:22.097654 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297a8f6-71b9-4336-a0e6-19ffec5bb5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:22.097970 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297a8f6-71b9-4336-a0e6-19ffec5bb5b6 admin admin] PATH_INFO: `/v3/users/4d3253b19d0240aea8700cb921885481` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:22.100070 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d297a8f6-71b9-4336-a0e6-19ffec5bb5b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d3253b19d0240aea8700cb921885481)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:22.102495 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d297a8f6-71b9-4336-a0e6-19ffec5bb5b6 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:22.119025 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:22.130647 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c6c77b-7f68-4c89-87d3-26d5c9429075 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:22.132822 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c6c77b-7f68-4c89-87d3-26d5c9429075 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:22.159684 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 860/1709] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:21 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:22.160799 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6c77b-7f68-4c89-87d3-26d5c9429075 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:22.187714 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6c77b-7f68-4c89-87d3-26d5c9429075 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:22.195016 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d297a8f6-71b9-4336-a0e6-19ffec5bb5b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d3253b19d0240aea8700cb921885481'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:22.197392 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d297a8f6-71b9-4336-a0e6-19ffec5bb5b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d3253b19d0240aea8700cb921885481'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:22.215878 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebe761-1de0-436f-8c84-1b5e3a98a096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:22.217174 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d297a8f6-71b9-4336-a0e6-19ffec5bb5b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d3253b19d0240aea8700cb921885481'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:22.220574 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebe761-1de0-436f-8c84-1b5e3a98a096 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:22.220940 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebe761-1de0-436f-8c84-1b5e3a98a096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:22.222946 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebe761-1de0-436f-8c84-1b5e3a98a096 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:22.223824 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ebe761-1de0-436f-8c84-1b5e3a98a096 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:11:22.225121 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ebe761-1de0-436f-8c84-1b5e3a98a096 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:22.229630 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ebe761-1de0-436f-8c84-1b5e3a98a096 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:22.245693 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d297a8f6-71b9-4336-a0e6-19ffec5bb5b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d3253b19d0240aea8700cb921885481'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:22.248364 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d297a8f6-71b9-4336-a0e6-19ffec5bb5b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d3253b19d0240aea8700cb921885481'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:22.282390 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 861/1710] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:11:22.283426 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebe761-1de0-436f-8c84-1b5e3a98a096 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:22.288957 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 850/1711] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:11:22 2022] DELETE /identity/v3/users/4d3253b19d0240aea8700cb921885481 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:22.293310 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-73ebe761-1de0-436f-8c84-1b5e3a98a096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:22.318553 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebe761-1de0-436f-8c84-1b5e3a98a096 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:22.495031 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c4486-ddff-4c8f-9de8-77f23c248c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:22.495959 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c4486-ddff-4c8f-9de8-77f23c248c5f admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:22.496512 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c4486-ddff-4c8f-9de8-77f23c248c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:22.497275 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c4486-ddff-4c8f-9de8-77f23c248c5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:22.498250 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3c4486-ddff-4c8f-9de8-77f23c248c5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:22.500656 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3c4486-ddff-4c8f-9de8-77f23c248c5f admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:22.542138 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 862/1712] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:11:22 2022] POST /identity/v3/projects => generated 369 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:22.546626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d297a8f6-71b9-4336-a0e6-19ffec5bb5b6 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:22.559093 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d297a8f6-71b9-4336-a0e6-19ffec5bb5b6 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:22.724655 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d8974-f0d1-4cfb-aa8f-419b48bd4b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:22.725158 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d8974-f0d1-4cfb-aa8f-419b48bd4b74 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:22.725450 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d8974-f0d1-4cfb-aa8f-419b48bd4b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:22.725732 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d8974-f0d1-4cfb-aa8f-419b48bd4b74 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:22.727823 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d8974-f0d1-4cfb-aa8f-419b48bd4b74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:22.729884 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d8974-f0d1-4cfb-aa8f-419b48bd4b74 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:22.797399 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 851/1713] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:11:22 2022] POST /identity/v3/users => generated 285 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:22.801729 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c4486-ddff-4c8f-9de8-77f23c248c5f admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:22.829320 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c4486-ddff-4c8f-9de8-77f23c248c5f admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:22.834804 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8f332-e2c9-4817-b0c2-b220d55fab6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:22.835497 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8f332-e2c9-4817-b0c2-b220d55fab6d admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:22.835781 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8f332-e2c9-4817-b0c2-b220d55fab6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:22.836058 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8f332-e2c9-4817-b0c2-b220d55fab6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:22.836898 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f8f332-e2c9-4817-b0c2-b220d55fab6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:22.838508 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f8f332-e2c9-4817-b0c2-b220d55fab6d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:22.880582 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 863/1714] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 04:11:22.881878 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d8974-f0d1-4cfb-aa8f-419b48bd4b74 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:22.905006 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d8974-f0d1-4cfb-aa8f-419b48bd4b74 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:22.925832 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b461359-6e74-4347-b620-0c8fe526733c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:22.928613 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b461359-6e74-4347-b620-0c8fe526733c admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:22.928907 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b461359-6e74-4347-b620-0c8fe526733c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:22.929194 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b461359-6e74-4347-b620-0c8fe526733c admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:22.929979 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b461359-6e74-4347-b620-0c8fe526733c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:22.931758 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b461359-6e74-4347-b620-0c8fe526733c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:22.956240 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8f332-e2c9-4817-b0c2-b220d55fab6d admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:22.959091 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c9f8f332-e2c9-4817-b0c2-b220d55fab6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:22.987149 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 852/1715] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:22.993498 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b461359-6e74-4347-b620-0c8fe526733c admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:23.007913 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b461359-6e74-4347-b620-0c8fe526733c admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:23.017761 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60292901-6ba1-4791-873a-6ee8f3893c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:23.023314 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60292901-6ba1-4791-873a-6ee8f3893c6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:23.023314 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60292901-6ba1-4791-873a-6ee8f3893c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:23.023621 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60292901-6ba1-4791-873a-6ee8f3893c6c admin admin] PATH_INFO: `/v3/projects/8ad51ee6687e4e5ca3c08601a4faa95d/users/9678081c80244638bb26d60d658d70b7/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:23.064757 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60292901-6ba1-4791-873a-6ee8f3893c6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ad51ee6687e4e5ca3c08601a4faa95d, user_id=9678081c80244638bb26d60d658d70b7, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:23.067554 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60292901-6ba1-4791-873a-6ee8f3893c6c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:23.098756 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 853/1716] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:22 2022] PUT /identity/v3/projects/8ad51ee6687e4e5ca3c08601a4faa95d/users/9678081c80244638bb26d60d658d70b7/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 04:11:23.116599 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493ccfd-21ac-4e74-b69e-33c116bba585 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:23.116892 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493ccfd-21ac-4e74-b69e-33c116bba585 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:23.117219 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493ccfd-21ac-4e74-b69e-33c116bba585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:23.174715 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-9493ccfd-21ac-4e74-b69e-33c116bba585 None None] MFA Rules not processed for user `9678081c80244638bb26d60d658d70b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:23.183245 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9493ccfd-21ac-4e74-b69e-33c116bba585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:23.264030 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8f332-e2c9-4817-b0c2-b220d55fab6d admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:23.278512 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=86,keystone:DELETE=9,keystone:INSERT=5 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:23.360806 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:23.424622 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 854/1717] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:23 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:23.425984 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fd7c3-c8eb-47a7-a595-b76060fbdd08 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:23.426341 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fd7c3-c8eb-47a7-a595-b76060fbdd08 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:23.426747 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fd7c3-c8eb-47a7-a595-b76060fbdd08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:23.486540 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f96cc4-a878-4a8a-909a-eeccf9af22cc tempest-VolumeQuotaClassesTest-1594183824 tempest-VolumeQuotaClassesTest-1594183824-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '596f419de0114934a2afe62a103ecf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e848f5121a344a19d5ccf603140669b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:23.487246 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f96cc4-a878-4a8a-909a-eeccf9af22cc tempest-VolumeQuotaClassesTest-1594183824 tempest-VolumeQuotaClassesTest-1594183824-project-admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:23.487646 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f96cc4-a878-4a8a-909a-eeccf9af22cc tempest-VolumeQuotaClassesTest-1594183824 tempest-VolumeQuotaClassesTest-1594183824-project-admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:23.487942 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f96cc4-a878-4a8a-909a-eeccf9af22cc tempest-VolumeQuotaClassesTest-1594183824 tempest-VolumeQuotaClassesTest-1594183824-project-admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:23.488701 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f96cc4-a878-4a8a-909a-eeccf9af22cc tempest-VolumeQuotaClassesTest-1594183824 tempest-VolumeQuotaClassesTest-1594183824-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:11:23.489100 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f96cc4-a878-4a8a-909a-eeccf9af22cc tempest-VolumeQuotaClassesTest-1594183824 tempest-VolumeQuotaClassesTest-1594183824-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:23.490740 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f96cc4-a878-4a8a-909a-eeccf9af22cc tempest-VolumeQuotaClassesTest-1594183824 tempest-VolumeQuotaClassesTest-1594183824-project-admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:23.519498 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 864/1718] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 564 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:11:23.520479 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f96cc4-a878-4a8a-909a-eeccf9af22cc tempest-VolumeQuotaClassesTest-1594183824 tempest-VolumeQuotaClassesTest-1594183824-project-admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:23.532188 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-8a6fd7c3-c8eb-47a7-a595-b76060fbdd08 None None] MFA Rules not processed for user `2648301ff6d24e14a2b0b8e34f742c9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:23.533848 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-8a6fd7c3-c8eb-47a7-a595-b76060fbdd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:23.745653 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f96cc4-a878-4a8a-909a-eeccf9af22cc tempest-VolumeQuotaClassesTest-1594183824 tempest-VolumeQuotaClassesTest-1594183824-project-admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:23.751194 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c86b4-c4a3-485e-be94-52c2153930d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:23.751917 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c86b4-c4a3-485e-be94-52c2153930d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:23.752200 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c86b4-c4a3-485e-be94-52c2153930d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:23.752479 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c86b4-c4a3-485e-be94-52c2153930d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:23.753183 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c86b4-c4a3-485e-be94-52c2153930d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:23.755169 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c86b4-c4a3-485e-be94-52c2153930d8 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:23.759139 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 855/1719] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:23.760370 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fd7c3-c8eb-47a7-a595-b76060fbdd08 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:23.798801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fd7c3-c8eb-47a7-a595-b76060fbdd08 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:23.807445 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f9c3c-7b6d-4f20-9af4-9eda1d430afb tempest-VolumeQuotaClassesTest-1594183824 tempest-VolumeQuotaClassesTest-1594183824-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '596f419de0114934a2afe62a103ecf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e848f5121a344a19d5ccf603140669b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:23.808286 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f9c3c-7b6d-4f20-9af4-9eda1d430afb tempest-VolumeQuotaClassesTest-1594183824 tempest-VolumeQuotaClassesTest-1594183824-project-admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:23.808676 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f9c3c-7b6d-4f20-9af4-9eda1d430afb tempest-VolumeQuotaClassesTest-1594183824 tempest-VolumeQuotaClassesTest-1594183824-project-admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:23.808972 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f9c3c-7b6d-4f20-9af4-9eda1d430afb tempest-VolumeQuotaClassesTest-1594183824 tempest-VolumeQuotaClassesTest-1594183824-project-admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:23.809974 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f9c3c-7b6d-4f20-9af4-9eda1d430afb tempest-VolumeQuotaClassesTest-1594183824 tempest-VolumeQuotaClassesTest-1594183824-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:23.812358 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f9c3c-7b6d-4f20-9af4-9eda1d430afb tempest-VolumeQuotaClassesTest-1594183824 tempest-VolumeQuotaClassesTest-1594183824-project-admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:23.828084 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 865/1720] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:11:23 2022] POST /identity/v3/projects => generated 369 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:23.828912 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c86b4-c4a3-485e-be94-52c2153930d8 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:23.832995 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-942c86b4-c4a3-485e-be94-52c2153930d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:23.882888 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 856/1721] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:11:23 2022] POST /identity/v3/projects => generated 354 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:23.884901 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5bd36-69e2-4b0c-a23d-a3559952bfeb None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:23.887866 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5bd36-69e2-4b0c-a23d-a3559952bfeb None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:23.889100 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5bd36-69e2-4b0c-a23d-a3559952bfeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:23.928812 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-fdc5bd36-69e2-4b0c-a23d-a3559952bfeb None None] MFA Rules not processed for user `2648301ff6d24e14a2b0b8e34f742c9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:23.930292 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-fdc5bd36-69e2-4b0c-a23d-a3559952bfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:24.017647 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c86b4-c4a3-485e-be94-52c2153930d8 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:24.026976 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 857/1722] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:24.027947 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5bd36-69e2-4b0c-a23d-a3559952bfeb None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:24.113177 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:24.141913 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f322a3a-30eb-4caf-9ed9-bac2bf369f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:24.142905 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f322a3a-30eb-4caf-9ed9-bac2bf369f90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:24.143194 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f322a3a-30eb-4caf-9ed9-bac2bf369f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:24.143591 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f322a3a-30eb-4caf-9ed9-bac2bf369f90 admin admin] PATH_INFO: `/v3/projects/5a5902f99729441188dbb5c3a7b41082` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:24.145131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f322a3a-30eb-4caf-9ed9-bac2bf369f90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a5902f99729441188dbb5c3a7b41082)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:24.147358 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f322a3a-30eb-4caf-9ed9-bac2bf369f90 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:24.156097 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:24.211462 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5bd36-69e2-4b0c-a23d-a3559952bfeb None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:24.224342 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9e9b6-26be-4007-8681-1338ebcbc69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:24.225513 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9e9b6-26be-4007-8681-1338ebcbc69c admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:24.225968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9e9b6-26be-4007-8681-1338ebcbc69c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:24.226605 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9e9b6-26be-4007-8681-1338ebcbc69c admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:24.227961 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9e9b6-26be-4007-8681-1338ebcbc69c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:24.235110 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9e9b6-26be-4007-8681-1338ebcbc69c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:24.268957 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 858/1723] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:11:24 2022] POST /identity/v3/users => generated 291 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:24.270053 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9e9b6-26be-4007-8681-1338ebcbc69c admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:24.273807 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4f322a3a-30eb-4caf-9ed9-bac2bf369f90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a5902f99729441188dbb5c3a7b41082', 'request_id': 'req-4f322a3a-30eb-4caf-9ed9-bac2bf369f90'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:24.288182 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4f322a3a-30eb-4caf-9ed9-bac2bf369f90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a5902f99729441188dbb5c3a7b41082', 'request_id': 'req-4f322a3a-30eb-4caf-9ed9-bac2bf369f90'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:24.307447 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4f322a3a-30eb-4caf-9ed9-bac2bf369f90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a5902f99729441188dbb5c3a7b41082', 'request_id': 'req-4f322a3a-30eb-4caf-9ed9-bac2bf369f90'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:24.362770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4f322a3a-30eb-4caf-9ed9-bac2bf369f90 admin admin] The token cache is being invalidate because project 5a5902f99729441188dbb5c3a7b41082 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:11:24.364915 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4f322a3a-30eb-4caf-9ed9-bac2bf369f90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:24.366286 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4f322a3a-30eb-4caf-9ed9-bac2bf369f90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:24.371334 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 866/1724] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:11:23 2022] DELETE /identity/v3/projects/5a5902f99729441188dbb5c3a7b41082 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:24.375154 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5300b5a-c95d-401d-86b9-5c2a7edf48e1 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:24.375687 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5300b5a-c95d-401d-86b9-5c2a7edf48e1 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:24.376875 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5300b5a-c95d-401d-86b9-5c2a7edf48e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:24.457517 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-f5300b5a-c95d-401d-86b9-5c2a7edf48e1 None None] MFA Rules not processed for user `8c08f725d244480c922fc400d34322ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:24.459259 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f5300b5a-c95d-401d-86b9-5c2a7edf48e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:24.459759 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9e9b6-26be-4007-8681-1338ebcbc69c admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:24.634134 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 867/1725] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:24.634134 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5300b5a-c95d-401d-86b9-5c2a7edf48e1 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:24.634134 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f5300b5a-c95d-401d-86b9-5c2a7edf48e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:24.693634 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1260d9-c2c6-4097-937b-c6c162c2081c tempest-VolumeQuotaClassesTest-1594183824 tempest-VolumeQuotaClassesTest-1594183824-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '596f419de0114934a2afe62a103ecf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e848f5121a344a19d5ccf603140669b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:24.694574 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1260d9-c2c6-4097-937b-c6c162c2081c tempest-VolumeQuotaClassesTest-1594183824 tempest-VolumeQuotaClassesTest-1594183824-project-admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:24.694925 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1260d9-c2c6-4097-937b-c6c162c2081c tempest-VolumeQuotaClassesTest-1594183824 tempest-VolumeQuotaClassesTest-1594183824-project-admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:24.695273 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1260d9-c2c6-4097-937b-c6c162c2081c tempest-VolumeQuotaClassesTest-1594183824 tempest-VolumeQuotaClassesTest-1594183824-project-admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:24.696873 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1260d9-c2c6-4097-937b-c6c162c2081c tempest-VolumeQuotaClassesTest-1594183824 tempest-VolumeQuotaClassesTest-1594183824-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:11:24.697673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1260d9-c2c6-4097-937b-c6c162c2081c tempest-VolumeQuotaClassesTest-1594183824 tempest-VolumeQuotaClassesTest-1594183824-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:24.700352 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1260d9-c2c6-4097-937b-c6c162c2081c tempest-VolumeQuotaClassesTest-1594183824 tempest-VolumeQuotaClassesTest-1594183824-project-admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:24.752482 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 859/1726] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 483 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:11:24.753772 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1260d9-c2c6-4097-937b-c6c162c2081c tempest-VolumeQuotaClassesTest-1594183824 tempest-VolumeQuotaClassesTest-1594183824-project-admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:24.756229 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-2a1260d9-c2c6-4097-937b-c6c162c2081c tempest-VolumeQuotaClassesTest-1594183824 tempest-VolumeQuotaClassesTest-1594183824-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:24.827171 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:24.843713 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5300b5a-c95d-401d-86b9-5c2a7edf48e1 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:24.857190 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91384dae-0bcf-4392-badd-dabee67b903e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:24.858060 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91384dae-0bcf-4392-badd-dabee67b903e service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:24.858480 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91384dae-0bcf-4392-badd-dabee67b903e service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:24.858857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91384dae-0bcf-4392-badd-dabee67b903e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:24.862536 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-91384dae-0bcf-4392-badd-dabee67b903e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:24.935297 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1260d9-c2c6-4097-937b-c6c162c2081c tempest-VolumeQuotaClassesTest-1594183824 tempest-VolumeQuotaClassesTest-1594183824-project-admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:24.936303 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91384dae-0bcf-4392-badd-dabee67b903e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:24.938114 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91384dae-0bcf-4392-badd-dabee67b903e service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:24.947463 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f719c09-c8a2-4b5c-a21f-c246a70c7bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:24.948175 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f719c09-c8a2-4b5c-a21f-c246a70c7bad admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:24.948455 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f719c09-c8a2-4b5c-a21f-c246a70c7bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:24.948729 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f719c09-c8a2-4b5c-a21f-c246a70c7bad admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:24.949500 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f719c09-c8a2-4b5c-a21f-c246a70c7bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:24.951002 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 868/1727] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:24.952037 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f719c09-c8a2-4b5c-a21f-c246a70c7bad admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:24.953282 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bd6a0-89da-4615-84fe-62c10dca5f2d None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:24.953789 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bd6a0-89da-4615-84fe-62c10dca5f2d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:24.954361 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bd6a0-89da-4615-84fe-62c10dca5f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:24.980313 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-8f7bd6a0-89da-4615-84fe-62c10dca5f2d None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:24.981737 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-8f7bd6a0-89da-4615-84fe-62c10dca5f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:24.991746 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 869/1728] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:24.993719 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d40581-f759-4228-959c-14b246dafeee None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:24.994218 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d40581-f759-4228-959c-14b246dafeee None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:24.994900 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d40581-f759-4228-959c-14b246dafeee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:25.004160 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 860/1729] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:25.004476 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f719c09-c8a2-4b5c-a21f-c246a70c7bad admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:25.011509 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9f719c09-c8a2-4b5c-a21f-c246a70c7bad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:25.016947 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-13d40581-f759-4228-959c-14b246dafeee None None] MFA Rules not processed for user `8c08f725d244480c922fc400d34322ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:25.018675 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-13d40581-f759-4228-959c-14b246dafeee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:25.027285 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 870/1730] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:25.029072 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303252d5-ba18-4eae-87d7-80046755b65f None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:25.029516 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303252d5-ba18-4eae-87d7-80046755b65f None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:25.029981 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303252d5-ba18-4eae-87d7-80046755b65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:25.049808 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-303252d5-ba18-4eae-87d7-80046755b65f None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:25.051312 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-303252d5-ba18-4eae-87d7-80046755b65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:25.063828 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f719c09-c8a2-4b5c-a21f-c246a70c7bad admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:25.068337 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 871/1731] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:25.069632 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303252d5-ba18-4eae-87d7-80046755b65f None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:25.078163 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce247296-cbcf-4946-b035-d079f1d617d6 tempest-VolumeQuotaClassesTest-1594183824 tempest-VolumeQuotaClassesTest-1594183824-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '596f419de0114934a2afe62a103ecf36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e848f5121a344a19d5ccf603140669b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:25.081504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce247296-cbcf-4946-b035-d079f1d617d6 tempest-VolumeQuotaClassesTest-1594183824 tempest-VolumeQuotaClassesTest-1594183824-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:25.081923 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce247296-cbcf-4946-b035-d079f1d617d6 tempest-VolumeQuotaClassesTest-1594183824 tempest-VolumeQuotaClassesTest-1594183824-project-admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:25.082490 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce247296-cbcf-4946-b035-d079f1d617d6 tempest-VolumeQuotaClassesTest-1594183824 tempest-VolumeQuotaClassesTest-1594183824-project-admin] PATH_INFO: `/v3/projects/3238274e8ee04dad85d2efa85c240c8c` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:25.086444 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303252d5-ba18-4eae-87d7-80046755b65f None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:25.087107 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce247296-cbcf-4946-b035-d079f1d617d6 tempest-VolumeQuotaClassesTest-1594183824 tempest-VolumeQuotaClassesTest-1594183824-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3238274e8ee04dad85d2efa85c240c8c)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:25.090054 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce247296-cbcf-4946-b035-d079f1d617d6 tempest-VolumeQuotaClassesTest-1594183824 tempest-VolumeQuotaClassesTest-1594183824-project-admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:25.095437 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9918b-2700-4827-935e-08d8090d5826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:25.096470 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9918b-2700-4827-935e-08d8090d5826 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:25.096860 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9918b-2700-4827-935e-08d8090d5826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:25.097411 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9918b-2700-4827-935e-08d8090d5826 admin admin] PATH_INFO: `/v3/projects/1814084e9b5443c5a573c8d5e3e00c57/users/f9daf69e254f40a49bb06ae0d15820cb/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:25.114544 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:25.116019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb9918b-2700-4827-935e-08d8090d5826 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1814084e9b5443c5a573c8d5e3e00c57, user_id=f9daf69e254f40a49bb06ae0d15820cb, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:25.119895 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb9918b-2700-4827-935e-08d8090d5826 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:25.157043 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 872/1732] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:25 2022] PUT /identity/v3/projects/1814084e9b5443c5a573c8d5e3e00c57/users/f9daf69e254f40a49bb06ae0d15820cb/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:25.158281 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9918b-2700-4827-935e-08d8090d5826 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:25.161913 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ebb9918b-2700-4827-935e-08d8090d5826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:25.201754 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ce247296-cbcf-4946-b035-d079f1d617d6 tempest-VolumeQuotaClassesTest-1594183824 tempest-VolumeQuotaClassesTest-1594183824-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3238274e8ee04dad85d2efa85c240c8c', 'request_id': 'req-ce247296-cbcf-4946-b035-d079f1d617d6'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:25.211829 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ce247296-cbcf-4946-b035-d079f1d617d6 tempest-VolumeQuotaClassesTest-1594183824 tempest-VolumeQuotaClassesTest-1594183824-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3238274e8ee04dad85d2efa85c240c8c', 'request_id': 'req-ce247296-cbcf-4946-b035-d079f1d617d6'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:25.221637 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ce247296-cbcf-4946-b035-d079f1d617d6 tempest-VolumeQuotaClassesTest-1594183824 tempest-VolumeQuotaClassesTest-1594183824-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3238274e8ee04dad85d2efa85c240c8c', 'request_id': 'req-ce247296-cbcf-4946-b035-d079f1d617d6'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:25.239103 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ce247296-cbcf-4946-b035-d079f1d617d6 tempest-VolumeQuotaClassesTest-1594183824 tempest-VolumeQuotaClassesTest-1594183824-project-admin] The token cache is being invalidate because project 3238274e8ee04dad85d2efa85c240c8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:11:25.239651 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ce247296-cbcf-4946-b035-d079f1d617d6 tempest-VolumeQuotaClassesTest-1594183824 tempest-VolumeQuotaClassesTest-1594183824-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:25.240595 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ce247296-cbcf-4946-b035-d079f1d617d6 tempest-VolumeQuotaClassesTest-1594183824 tempest-VolumeQuotaClassesTest-1594183824-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:25.242762 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 861/1733] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:11:25 2022] DELETE /identity/v3/projects/3238274e8ee04dad85d2efa85c240c8c => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:25.244113 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce247296-cbcf-4946-b035-d079f1d617d6 tempest-VolumeQuotaClassesTest-1594183824 tempest-VolumeQuotaClassesTest-1594183824-project-admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:25.247411 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ce247296-cbcf-4946-b035-d079f1d617d6 tempest-VolumeQuotaClassesTest-1594183824 tempest-VolumeQuotaClassesTest-1594183824-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:25.338105 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce247296-cbcf-4946-b035-d079f1d617d6 tempest-VolumeQuotaClassesTest-1594183824 tempest-VolumeQuotaClassesTest-1594183824-project-admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:25.350645 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0f255-5fb9-472b-b548-4047002c240c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:25.351926 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0f255-5fb9-472b-b548-4047002c240c admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:25.352703 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0f255-5fb9-472b-b548-4047002c240c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:25.354474 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0f255-5fb9-472b-b548-4047002c240c admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:25.355374 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c0f255-5fb9-472b-b548-4047002c240c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:11:25.357118 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c0f255-5fb9-472b-b548-4047002c240c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:25.360386 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c0f255-5fb9-472b-b548-4047002c240c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:25.361018 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9918b-2700-4827-935e-08d8090d5826 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:25.395600 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 862/1734] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:11:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:11:25.399765 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0f255-5fb9-472b-b548-4047002c240c admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:25.402561 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-48c0f255-5fb9-472b-b548-4047002c240c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:25.449314 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0f255-5fb9-472b-b548-4047002c240c admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:25.470276 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764b906-9d83-4af3-b3d8-33eb1b74d753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:25.473778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764b906-9d83-4af3-b3d8-33eb1b74d753 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:25.475167 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764b906-9d83-4af3-b3d8-33eb1b74d753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:25.475522 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764b906-9d83-4af3-b3d8-33eb1b74d753 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:25.477088 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764b906-9d83-4af3-b3d8-33eb1b74d753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:25.483056 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764b906-9d83-4af3-b3d8-33eb1b74d753 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:25.500440 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:25.522685 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 863/1735] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:25.523645 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764b906-9d83-4af3-b3d8-33eb1b74d753 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:25.553361 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764b906-9d83-4af3-b3d8-33eb1b74d753 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:25.559158 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c4291-fff7-4e7c-9473-a9d9ef7c982d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:25.559856 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c4291-fff7-4e7c-9473-a9d9ef7c982d service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:25.560149 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c4291-fff7-4e7c-9473-a9d9ef7c982d service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:25.560432 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c4291-fff7-4e7c-9473-a9d9ef7c982d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:25.567545 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205fa586-e69a-44da-8d9d-3586face7440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:25.570052 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fa586-e69a-44da-8d9d-3586face7440 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:25.570374 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fa586-e69a-44da-8d9d-3586face7440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:25.570666 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fa586-e69a-44da-8d9d-3586face7440 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:25.571470 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205fa586-e69a-44da-8d9d-3586face7440 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:25.572482 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e62c4291-fff7-4e7c-9473-a9d9ef7c982d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:25.576583 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205fa586-e69a-44da-8d9d-3586face7440 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:25.678198 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 864/1736] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:11:25 2022] POST /identity/v3/projects => generated 379 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:25.680866 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205fa586-e69a-44da-8d9d-3586face7440 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:25.791408 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c4291-fff7-4e7c-9473-a9d9ef7c982d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:25.793076 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c4291-fff7-4e7c-9473-a9d9ef7c982d service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:25.821112 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 873/1737] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:25.822997 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2f2aa-c292-46c6-9666-113ce55c4db9 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:25.823298 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2f2aa-c292-46c6-9666-113ce55c4db9 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:25.823588 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2f2aa-c292-46c6-9666-113ce55c4db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:25.858208 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-72d2f2aa-c292-46c6-9666-113ce55c4db9 None None] MFA Rules not processed for user `0be198ad83014acfab897498c2d68d7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:25.859477 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-72d2f2aa-c292-46c6-9666-113ce55c4db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:25.872597 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:25.888836 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205fa586-e69a-44da-8d9d-3586face7440 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:25.896512 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ff5b0-591a-4089-82c9-646ef2836d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:25.898136 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ff5b0-591a-4089-82c9-646ef2836d4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:25.898588 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ff5b0-591a-4089-82c9-646ef2836d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:25.898968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ff5b0-591a-4089-82c9-646ef2836d4a admin admin] PATH_INFO: `/v3/projects/1814084e9b5443c5a573c8d5e3e00c57/users/f9daf69e254f40a49bb06ae0d15820cb/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:25.901249 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ff5b0-591a-4089-82c9-646ef2836d4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1814084e9b5443c5a573c8d5e3e00c57, user_id=f9daf69e254f40a49bb06ae0d15820cb, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:25.905597 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ff5b0-591a-4089-82c9-646ef2836d4a admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:25.931880 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 865/1738] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:25 2022] PUT /identity/v3/projects/1814084e9b5443c5a573c8d5e3e00c57/users/f9daf69e254f40a49bb06ae0d15820cb/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:25.933485 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ff5b0-591a-4089-82c9-646ef2836d4a admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:26.005650 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 874/1739] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:26.005650 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2f2aa-c292-46c6-9666-113ce55c4db9 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:26.008376 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-72d2f2aa-c292-46c6-9666-113ce55c4db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:26.036255 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2f2aa-c292-46c6-9666-113ce55c4db9 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:26.103668 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ff5b0-591a-4089-82c9-646ef2836d4a admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:26.119478 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f4b21-a458-428f-98bc-1d17dc141c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:26.120180 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f4b21-a458-428f-98bc-1d17dc141c00 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:26.120611 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f4b21-a458-428f-98bc-1d17dc141c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:26.120901 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f4b21-a458-428f-98bc-1d17dc141c00 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:26.121625 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f4b21-a458-428f-98bc-1d17dc141c00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:26.123679 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f4b21-a458-428f-98bc-1d17dc141c00 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:26.144931 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e77c0-eec8-4347-8215-ea8f5bead4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:26.145346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e77c0-eec8-4347-8215-ea8f5bead4e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:26.146440 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e77c0-eec8-4347-8215-ea8f5bead4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:26.146853 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e77c0-eec8-4347-8215-ea8f5bead4e6 admin admin] PATH_INFO: `/v3/users/c0a1842511344cb083ecbfbf2f4dc736` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:26.149267 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e77c0-eec8-4347-8215-ea8f5bead4e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0a1842511344cb083ecbfbf2f4dc736)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:26.152066 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e77c0-eec8-4347-8215-ea8f5bead4e6 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:26.170985 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 866/1740] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:11:25 2022] POST /identity/v3/users => generated 290 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:26.170985 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f4b21-a458-428f-98bc-1d17dc141c00 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:26.170985 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ce3f4b21-a458-428f-98bc-1d17dc141c00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:26.197398 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f4b21-a458-428f-98bc-1d17dc141c00 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:26.224854 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe49595-af3c-424f-95d0-9244b1d84f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:26.226295 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe49595-af3c-424f-95d0-9244b1d84f3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:26.226725 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe49595-af3c-424f-95d0-9244b1d84f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:26.227026 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:26.227331 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe49595-af3c-424f-95d0-9244b1d84f3b admin admin] PATH_INFO: `/v3/users/f775e2819089476eb28b929aeb8ac45c` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:26.229799 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe49595-af3c-424f-95d0-9244b1d84f3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f775e2819089476eb28b929aeb8ac45c)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:26.232131 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe49595-af3c-424f-95d0-9244b1d84f3b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:26.241294 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-253e77c0-eec8-4347-8215-ea8f5bead4e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0a1842511344cb083ecbfbf2f4dc736'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:26.263010 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-253e77c0-eec8-4347-8215-ea8f5bead4e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0a1842511344cb083ecbfbf2f4dc736'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:26.263757 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-253e77c0-eec8-4347-8215-ea8f5bead4e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0a1842511344cb083ecbfbf2f4dc736'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:26.290890 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-253e77c0-eec8-4347-8215-ea8f5bead4e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0a1842511344cb083ecbfbf2f4dc736'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:26.291720 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-253e77c0-eec8-4347-8215-ea8f5bead4e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0a1842511344cb083ecbfbf2f4dc736'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:26.327668 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 875/1741] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:11:26 2022] DELETE /identity/v3/users/c0a1842511344cb083ecbfbf2f4dc736 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:26.332140 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1d9e6-c67a-4ef0-85ba-53af34d17e3b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:26.333048 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1d9e6-c67a-4ef0-85ba-53af34d17e3b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:26.335627 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1d9e6-c67a-4ef0-85ba-53af34d17e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:26.344347 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0fe49595-af3c-424f-95d0-9244b1d84f3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f775e2819089476eb28b929aeb8ac45c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:26.348459 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0fe49595-af3c-424f-95d0-9244b1d84f3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f775e2819089476eb28b929aeb8ac45c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:26.364329 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0fe49595-af3c-424f-95d0-9244b1d84f3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f775e2819089476eb28b929aeb8ac45c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:26.438469 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0fe49595-af3c-424f-95d0-9244b1d84f3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f775e2819089476eb28b929aeb8ac45c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:26.440007 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0fe49595-af3c-424f-95d0-9244b1d84f3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f775e2819089476eb28b929aeb8ac45c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:26.447850 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-14c1d9e6-c67a-4ef0-85ba-53af34d17e3b None None] MFA Rules not processed for user `f9daf69e254f40a49bb06ae0d15820cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:26.449117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-14c1d9e6-c67a-4ef0-85ba-53af34d17e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:26.468671 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 867/1742] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:11:26 2022] DELETE /identity/v3/users/f775e2819089476eb28b929aeb8ac45c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:26.477392 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff207b3-84e3-4a32-b8d3-72e02cf8a668 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:26.477684 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff207b3-84e3-4a32-b8d3-72e02cf8a668 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:26.478043 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff207b3-84e3-4a32-b8d3-72e02cf8a668 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:26.482663 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 868/1743] 10.222.0.49 () {54 vars in 912 bytes} [Mon Jul 4 04:11:26 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:11:26.483516 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff207b3-84e3-4a32-b8d3-72e02cf8a668 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:26.492268 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4ff207b3-84e3-4a32-b8d3-72e02cf8a668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:26.595572 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:26.602327 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 876/1744] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:26 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:26.606853 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8baa1b1-4f9a-439b-bf22-0c85b9bd86cf None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:26.606853 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8baa1b1-4f9a-439b-bf22-0c85b9bd86cf None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:26.606853 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8baa1b1-4f9a-439b-bf22-0c85b9bd86cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:26.627449 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff207b3-84e3-4a32-b8d3-72e02cf8a668 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:26.633630 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ff34f-33a3-4797-83d7-2040de01a185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:26.634791 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ff34f-33a3-4797-83d7-2040de01a185 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:26.635006 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ff34f-33a3-4797-83d7-2040de01a185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:26.635353 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ff34f-33a3-4797-83d7-2040de01a185 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:26.636301 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ff34f-33a3-4797-83d7-2040de01a185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:26.636421 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-b8baa1b1-4f9a-439b-bf22-0c85b9bd86cf None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:26.637614 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b8baa1b1-4f9a-439b-bf22-0c85b9bd86cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:26.637996 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ff34f-33a3-4797-83d7-2040de01a185 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:26.646023 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 877/1745] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:26.647429 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7b909-bedb-497b-b1a3-7d3f6aafa1f6 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:26.647721 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7b909-bedb-497b-b1a3-7d3f6aafa1f6 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:26.648192 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7b909-bedb-497b-b1a3-7d3f6aafa1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:26.657821 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 869/1746] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:26.660644 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dfd0ff-1065-44f3-a097-1d349a8a7a39 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:26.660952 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dfd0ff-1065-44f3-a097-1d349a8a7a39 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:26.661951 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dfd0ff-1065-44f3-a097-1d349a8a7a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:26.676641 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-82e7b909-bedb-497b-b1a3-7d3f6aafa1f6 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:26.679467 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-82e7b909-bedb-497b-b1a3-7d3f6aafa1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:26.709255 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 878/1747] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:26.711327 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5845777-5841-4341-905b-b1d5774e18ce None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:26.713089 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5845777-5841-4341-905b-b1d5774e18ce None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:26.713736 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5845777-5841-4341-905b-b1d5774e18ce None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:26.715671 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 879/1748] 10.222.0.49 () {54 vars in 912 bytes} [Mon Jul 4 04:11:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:11:26.717183 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87eef9-1ad6-4007-bfe7-07a8d4ba5655 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:26.717671 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87eef9-1ad6-4007-bfe7-07a8d4ba5655 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:26.718306 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87eef9-1ad6-4007-bfe7-07a8d4ba5655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:26.732654 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-38dfd0ff-1065-44f3-a097-1d349a8a7a39 None None] MFA Rules not processed for user `b36a8402144c458fa98f80d7e3516127`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:26.734644 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-38dfd0ff-1065-44f3-a097-1d349a8a7a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:26.743983 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-9d87eef9-1ad6-4007-bfe7-07a8d4ba5655 None None] MFA Rules not processed for user `c8ada8b86e2f4ad18c8af021def1a30e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:26.745242 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9d87eef9-1ad6-4007-bfe7-07a8d4ba5655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:26.825668 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 870/1749] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Jul 4 04:11:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:26.827008 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dfd0ff-1065-44f3-a097-1d349a8a7a39 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:26.828633 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-38dfd0ff-1065-44f3-a097-1d349a8a7a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:26.830634 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 880/1750] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:26.831600 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87eef9-1ad6-4007-bfe7-07a8d4ba5655 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:26.856936 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87eef9-1ad6-4007-bfe7-07a8d4ba5655 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:26.864182 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a510270-d242-4ee1-b2ad-0327670a4d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:26.865215 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a510270-d242-4ee1-b2ad-0327670a4d5c admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:26.865694 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a510270-d242-4ee1-b2ad-0327670a4d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:26.866045 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a510270-d242-4ee1-b2ad-0327670a4d5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:26.866910 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a510270-d242-4ee1-b2ad-0327670a4d5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:26.869197 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a510270-d242-4ee1-b2ad-0327670a4d5c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:26.885499 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 881/1751] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:26.886603 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a510270-d242-4ee1-b2ad-0327670a4d5c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:26.888491 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7a510270-d242-4ee1-b2ad-0327670a4d5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:26.901875 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a510270-d242-4ee1-b2ad-0327670a4d5c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:26.906187 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956e2c7-7873-403b-aa09-feb914b28825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:26.906969 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956e2c7-7873-403b-aa09-feb914b28825 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:26.907810 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956e2c7-7873-403b-aa09-feb914b28825 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:26.908325 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956e2c7-7873-403b-aa09-feb914b28825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:26.922360 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956e2c7-7873-403b-aa09-feb914b28825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:26.923975 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956e2c7-7873-403b-aa09-feb914b28825 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:26.931291 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dfd0ff-1065-44f3-a097-1d349a8a7a39 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:26.936514 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3fd23-aa07-4119-9b04-4103f3ae23ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:26.937489 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3fd23-aa07-4119-9b04-4103f3ae23ef service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:26.938114 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3fd23-aa07-4119-9b04-4103f3ae23ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:26.938779 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3fd23-aa07-4119-9b04-4103f3ae23ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:26.943037 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 882/1752] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:26.945070 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fb343-7ce9-4743-ad05-e5817a9f4972 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:26.945630 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fb343-7ce9-4743-ad05-e5817a9f4972 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:26.945929 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fb343-7ce9-4743-ad05-e5817a9f4972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:26.981412 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-fe7fb343-7ce9-4743-ad05-e5817a9f4972 None None] MFA Rules not processed for user `b36a8402144c458fa98f80d7e3516127`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:26.982832 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-fe7fb343-7ce9-4743-ad05-e5817a9f4972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:26.996360 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 883/1753] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Jul 4 04:11:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:26.997254 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7fb343-7ce9-4743-ad05-e5817a9f4972 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:27.003462 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:27.015054 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7fb343-7ce9-4743-ad05-e5817a9f4972 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:27.024846 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24537d0b-a267-4853-a5cc-967695c99c36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:27.026448 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24537d0b-a267-4853-a5cc-967695c99c36 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:27.028055 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24537d0b-a267-4853-a5cc-967695c99c36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:27.028360 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24537d0b-a267-4853-a5cc-967695c99c36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:27.069208 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24537d0b-a267-4853-a5cc-967695c99c36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:27.071153 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24537d0b-a267-4853-a5cc-967695c99c36 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:27.116744 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 884/1754] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:27.117691 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24537d0b-a267-4853-a5cc-967695c99c36 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:27.121620 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-24537d0b-a267-4853-a5cc-967695c99c36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:27.147332 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3fd23-aa07-4119-9b04-4103f3ae23ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:27.150963 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3fd23-aa07-4119-9b04-4103f3ae23ef service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:27.154565 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24537d0b-a267-4853-a5cc-967695c99c36 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:27.162642 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe4b01-a89b-4aa3-aadb-301ea9e2419b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:27.163329 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe4b01-a89b-4aa3-aadb-301ea9e2419b service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:27.163620 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe4b01-a89b-4aa3-aadb-301ea9e2419b service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:27.163931 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe4b01-a89b-4aa3-aadb-301ea9e2419b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:27.188163 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 871/1755] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:26 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:27.190959 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3fd23-aa07-4119-9b04-4103f3ae23ef service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:27.203167 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe4b01-a89b-4aa3-aadb-301ea9e2419b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:27.204663 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe4b01-a89b-4aa3-aadb-301ea9e2419b service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:27.236043 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3fd23-aa07-4119-9b04-4103f3ae23ef service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:27.242122 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 885/1756] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:27.244350 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe4b01-a89b-4aa3-aadb-301ea9e2419b service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:27.265202 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15ad56-8bc1-4adc-ab91-aa3eaa5720da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:27.268292 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe4b01-a89b-4aa3-aadb-301ea9e2419b service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:27.270261 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15ad56-8bc1-4adc-ab91-aa3eaa5720da admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:27.271486 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15ad56-8bc1-4adc-ab91-aa3eaa5720da admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:27.271994 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15ad56-8bc1-4adc-ab91-aa3eaa5720da admin admin] PATH_INFO: `/v3/projects/6314928707334e5ca2b7aa38faf52d4a/users/39af713de1bd4560835baa823621f7d0/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:27.273623 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f656d3e-5116-4805-963c-3b69308089a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:27.274491 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f656d3e-5116-4805-963c-3b69308089a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:27.275185 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f656d3e-5116-4805-963c-3b69308089a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:27.275652 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f656d3e-5116-4805-963c-3b69308089a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:27.312456 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15ad56-8bc1-4adc-ab91-aa3eaa5720da admin admin] RBAC: Authorizing `identity:create_grant(project_id=6314928707334e5ca2b7aa38faf52d4a, user_id=39af713de1bd4560835baa823621f7d0, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:27.316592 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f656d3e-5116-4805-963c-3b69308089a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:27.321214 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f656d3e-5116-4805-963c-3b69308089a4 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:27.321867 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15ad56-8bc1-4adc-ab91-aa3eaa5720da admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:27.351458 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 886/1757] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:27.355340 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 872/1758] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:27 2022] PUT /identity/v3/projects/6314928707334e5ca2b7aa38faf52d4a/users/39af713de1bd4560835baa823621f7d0/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:27.366931 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa07b1-c417-47aa-92fe-5b30153332d6 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:27.367580 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa07b1-c417-47aa-92fe-5b30153332d6 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:27.369947 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa07b1-c417-47aa-92fe-5b30153332d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:27.481196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-81aa07b1-c417-47aa-92fe-5b30153332d6 None None] MFA Rules not processed for user `39af713de1bd4560835baa823621f7d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:27.484791 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-81aa07b1-c417-47aa-92fe-5b30153332d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:27.691261 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 887/1759] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:27.696072 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15ad56-8bc1-4adc-ab91-aa3eaa5720da admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:27.723333 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:27.851659 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15ad56-8bc1-4adc-ab91-aa3eaa5720da admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:27.870176 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5947e86-719d-4ef5-82e0-07c1092bc052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:27.871251 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5947e86-719d-4ef5-82e0-07c1092bc052 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:27.872480 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5947e86-719d-4ef5-82e0-07c1092bc052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:27.873020 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5947e86-719d-4ef5-82e0-07c1092bc052 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:27.874220 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5947e86-719d-4ef5-82e0-07c1092bc052 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:27.882214 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5947e86-719d-4ef5-82e0-07c1092bc052 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:27.944369 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 873/1760] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:11:27 2022] POST /identity/v3/projects => generated 379 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:27.949670 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa07b1-c417-47aa-92fe-5b30153332d6 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:27.973240 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa07b1-c417-47aa-92fe-5b30153332d6 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:28.117133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3062eeb-239c-4d25-bfce-e8d8b1e41cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:28.120964 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3062eeb-239c-4d25-bfce-e8d8b1e41cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:28.122207 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3062eeb-239c-4d25-bfce-e8d8b1e41cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:28.124204 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3062eeb-239c-4d25-bfce-e8d8b1e41cf3 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:28.126148 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3062eeb-239c-4d25-bfce-e8d8b1e41cf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:28.129857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3062eeb-239c-4d25-bfce-e8d8b1e41cf3 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:28.202237 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 888/1761] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:11:27 2022] POST /identity/v3/users => generated 296 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:28.205223 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5947e86-719d-4ef5-82e0-07c1092bc052 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:28.230950 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5947e86-719d-4ef5-82e0-07c1092bc052 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:28.257338 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235ce2c-0b11-492c-ac08-f29992e68524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:28.258102 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235ce2c-0b11-492c-ac08-f29992e68524 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:28.258415 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235ce2c-0b11-492c-ac08-f29992e68524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:28.258721 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235ce2c-0b11-492c-ac08-f29992e68524 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:28.259567 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235ce2c-0b11-492c-ac08-f29992e68524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:28.275483 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235ce2c-0b11-492c-ac08-f29992e68524 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:28.329506 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 874/1762] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:28.330303 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3062eeb-239c-4d25-bfce-e8d8b1e41cf3 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:28.349325 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3062eeb-239c-4d25-bfce-e8d8b1e41cf3 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:28.367378 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6990dd6-4cf1-4348-bab2-b9488fbe6fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:28.369128 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6990dd6-4cf1-4348-bab2-b9488fbe6fbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:28.369489 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6990dd6-4cf1-4348-bab2-b9488fbe6fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:28.369975 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6990dd6-4cf1-4348-bab2-b9488fbe6fbe admin admin] PATH_INFO: `/v3/projects/93b5180b61e7438cb26c3cb66b223bbd/users/1ab8c6f70d714fd79b752eef20488b20/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:28.423809 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6990dd6-4cf1-4348-bab2-b9488fbe6fbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=93b5180b61e7438cb26c3cb66b223bbd, user_id=1ab8c6f70d714fd79b752eef20488b20, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:28.436909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6990dd6-4cf1-4348-bab2-b9488fbe6fbe admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:28.453092 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235ce2c-0b11-492c-ac08-f29992e68524 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:28.456178 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d235ce2c-0b11-492c-ac08-f29992e68524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:28.487602 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 889/1763] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:28 2022] PUT /identity/v3/projects/93b5180b61e7438cb26c3cb66b223bbd/users/1ab8c6f70d714fd79b752eef20488b20/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:28.491385 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6990dd6-4cf1-4348-bab2-b9488fbe6fbe admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:28.538990 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235ce2c-0b11-492c-ac08-f29992e68524 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:28.570720 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:28.785808 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6990dd6-4cf1-4348-bab2-b9488fbe6fbe admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:28.799480 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4980f-f1bb-4d8e-8958-6a3ef4fe0786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:28.802105 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4980f-f1bb-4d8e-8958-6a3ef4fe0786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:28.804588 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4980f-f1bb-4d8e-8958-6a3ef4fe0786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:28.805121 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4980f-f1bb-4d8e-8958-6a3ef4fe0786 admin admin] PATH_INFO: `/v3/projects/87265fd1ba2b4b75b09604dfddfcf5db` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:28.807955 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925a025-15a1-4274-bf1a-34ae336a1302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:28.808812 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925a025-15a1-4274-bf1a-34ae336a1302 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:28.809219 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925a025-15a1-4274-bf1a-34ae336a1302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:28.809925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925a025-15a1-4274-bf1a-34ae336a1302 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:28.810857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0925a025-15a1-4274-bf1a-34ae336a1302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:28.811172 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4980f-f1bb-4d8e-8958-6a3ef4fe0786 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87265fd1ba2b4b75b09604dfddfcf5db)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:28.813011 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0925a025-15a1-4274-bf1a-34ae336a1302 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:28.813310 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4980f-f1bb-4d8e-8958-6a3ef4fe0786 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:28.855872 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 890/1764] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:28.858646 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925a025-15a1-4274-bf1a-34ae336a1302 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:28.867100 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0925a025-15a1-4274-bf1a-34ae336a1302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:28.921258 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925a025-15a1-4274-bf1a-34ae336a1302 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:28.988652 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8df4980f-f1bb-4d8e-8958-6a3ef4fe0786 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87265fd1ba2b4b75b09604dfddfcf5db', 'request_id': 'req-8df4980f-f1bb-4d8e-8958-6a3ef4fe0786'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:29.007172 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8df4980f-f1bb-4d8e-8958-6a3ef4fe0786 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87265fd1ba2b4b75b09604dfddfcf5db', 'request_id': 'req-8df4980f-f1bb-4d8e-8958-6a3ef4fe0786'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:29.022722 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8df4980f-f1bb-4d8e-8958-6a3ef4fe0786 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87265fd1ba2b4b75b09604dfddfcf5db', 'request_id': 'req-8df4980f-f1bb-4d8e-8958-6a3ef4fe0786'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:29.053873 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8df4980f-f1bb-4d8e-8958-6a3ef4fe0786 admin admin] The token cache is being invalidate because project 87265fd1ba2b4b75b09604dfddfcf5db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:11:29.054602 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8df4980f-f1bb-4d8e-8958-6a3ef4fe0786 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:29.057018 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8df4980f-f1bb-4d8e-8958-6a3ef4fe0786 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:29.059939 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 875/1765] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:11:28 2022] DELETE /identity/v3/projects/87265fd1ba2b4b75b09604dfddfcf5db => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:29.065090 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25be0a-63f0-4c5f-8048-368f310620f2 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:29.065391 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25be0a-63f0-4c5f-8048-368f310620f2 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:29.065681 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25be0a-63f0-4c5f-8048-368f310620f2 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:29.067144 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 876/1766] 10.222.0.49 () {54 vars in 960 bytes} [Mon Jul 4 04:11:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:11:29.078228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25be0a-63f0-4c5f-8048-368f310620f2 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:29.084214 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4c25be0a-63f0-4c5f-8048-368f310620f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:29.133090 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:29.143063 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c74a31-4d93-42b2-9d94-213fb057c04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:29.143990 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c74a31-4d93-42b2-9d94-213fb057c04d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:29.144285 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c74a31-4d93-42b2-9d94-213fb057c04d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:29.144567 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c74a31-4d93-42b2-9d94-213fb057c04d admin admin] PATH_INFO: `/v3/projects/336f1e28382844c29dd034dd6f4b78cf` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:29.148922 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c74a31-4d93-42b2-9d94-213fb057c04d admin admin] RBAC: Authorizing `identity:delete_project(project_id=336f1e28382844c29dd034dd6f4b78cf)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:29.151057 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c74a31-4d93-42b2-9d94-213fb057c04d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:29.231958 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25be0a-63f0-4c5f-8048-368f310620f2 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:29.239744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24963b-7190-4ed3-94a5-57a214b4509f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:29.241754 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24963b-7190-4ed3-94a5-57a214b4509f admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:29.242317 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24963b-7190-4ed3-94a5-57a214b4509f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:29.243170 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24963b-7190-4ed3-94a5-57a214b4509f admin admin] PATH_INFO: `/v3/projects/93b5180b61e7438cb26c3cb66b223bbd/users/1ab8c6f70d714fd79b752eef20488b20/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:29.247353 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c24963b-7190-4ed3-94a5-57a214b4509f admin admin] RBAC: Authorizing `identity:create_grant(project_id=93b5180b61e7438cb26c3cb66b223bbd, user_id=1ab8c6f70d714fd79b752eef20488b20, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:29.251848 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c24963b-7190-4ed3-94a5-57a214b4509f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:29.284393 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 877/1767] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:29 2022] PUT /identity/v3/projects/93b5180b61e7438cb26c3cb66b223bbd/users/1ab8c6f70d714fd79b752eef20488b20/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:29.286987 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24963b-7190-4ed3-94a5-57a214b4509f admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:29.291009 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-2c24963b-7190-4ed3-94a5-57a214b4509f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:29.348123 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-75c74a31-4d93-42b2-9d94-213fb057c04d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '336f1e28382844c29dd034dd6f4b78cf', 'request_id': 'req-75c74a31-4d93-42b2-9d94-213fb057c04d'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:29.392409 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-75c74a31-4d93-42b2-9d94-213fb057c04d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '336f1e28382844c29dd034dd6f4b78cf', 'request_id': 'req-75c74a31-4d93-42b2-9d94-213fb057c04d'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:29.408793 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-75c74a31-4d93-42b2-9d94-213fb057c04d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '336f1e28382844c29dd034dd6f4b78cf', 'request_id': 'req-75c74a31-4d93-42b2-9d94-213fb057c04d'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:29.440580 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-75c74a31-4d93-42b2-9d94-213fb057c04d admin admin] The token cache is being invalidate because project 336f1e28382844c29dd034dd6f4b78cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:11:29.442207 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-75c74a31-4d93-42b2-9d94-213fb057c04d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:29.443068 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-75c74a31-4d93-42b2-9d94-213fb057c04d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:29.447670 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 891/1768] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:11:28 2022] DELETE /identity/v3/projects/336f1e28382844c29dd034dd6f4b78cf => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:29.449309 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85442608-153d-4745-8c8d-7a3be038d8fd None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:29.449602 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85442608-153d-4745-8c8d-7a3be038d8fd None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:29.449880 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85442608-153d-4745-8c8d-7a3be038d8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:29.499202 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-85442608-153d-4745-8c8d-7a3be038d8fd None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:29.500465 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-85442608-153d-4745-8c8d-7a3be038d8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:29.560107 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24963b-7190-4ed3-94a5-57a214b4509f admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:29.639865 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:29.697295 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 892/1769] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:29.701470 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134c83a-1b05-4b49-9a91-563e411c8304 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:29.701769 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134c83a-1b05-4b49-9a91-563e411c8304 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:29.702286 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134c83a-1b05-4b49-9a91-563e411c8304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:29.765934 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-4134c83a-1b05-4b49-9a91-563e411c8304 None None] MFA Rules not processed for user `c2a18591461343c3a0a1b0e317734ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:29.768951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4134c83a-1b05-4b49-9a91-563e411c8304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:29.835153 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509aeec-ff79-4c25-95b1-ab45c7d979ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a18591461343c3a0a1b0e317734ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:29.835849 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509aeec-ff79-4c25-95b1-ab45c7d979ea service placement] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:29.836137 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509aeec-ff79-4c25-95b1-ab45c7d979ea service placement] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:29.836418 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509aeec-ff79-4c25-95b1-ab45c7d979ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:29.841239 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b509aeec-ff79-4c25-95b1-ab45c7d979ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:29.875456 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b509aeec-ff79-4c25-95b1-ab45c7d979ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:29.877046 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b509aeec-ff79-4c25-95b1-ab45c7d979ea service placement] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:29.901505 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 878/1770] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:29.902967 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a605c-8160-4047-8325-3a5f4182ee9c None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:29.903265 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a605c-8160-4047-8325-3a5f4182ee9c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:29.903553 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a605c-8160-4047-8325-3a5f4182ee9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:29.975183 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 893/1771] 10.222.0.49 () {58 vars in 1057 bytes} [Mon Jul 4 04:11:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:29.976364 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134c83a-1b05-4b49-9a91-563e411c8304 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:29.977990 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-740a605c-8160-4047-8325-3a5f4182ee9c None None] MFA Rules not processed for user `1ab8c6f70d714fd79b752eef20488b20`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:29.987195 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-740a605c-8160-4047-8325-3a5f4182ee9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:29.991873 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4134c83a-1b05-4b49-9a91-563e411c8304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:30.015352 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134c83a-1b05-4b49-9a91-563e411c8304 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:30.035692 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab3ab8-a664-4a68-b86e-4d0f12537ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:30.043741 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab3ab8-a664-4a68-b86e-4d0f12537ffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:30.044914 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab3ab8-a664-4a68-b86e-4d0f12537ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:30.046255 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab3ab8-a664-4a68-b86e-4d0f12537ffa admin admin] PATH_INFO: `/v3/users/596f419de0114934a2afe62a103ecf36` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:30.049916 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab3ab8-a664-4a68-b86e-4d0f12537ffa admin admin] RBAC: Authorizing `identity:delete_user(user_id=596f419de0114934a2afe62a103ecf36)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:30.059419 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab3ab8-a664-4a68-b86e-4d0f12537ffa admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:30.091200 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:30.214863 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-94ab3ab8-a664-4a68-b86e-4d0f12537ffa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '596f419de0114934a2afe62a103ecf36'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:30.231904 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-94ab3ab8-a664-4a68-b86e-4d0f12537ffa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '596f419de0114934a2afe62a103ecf36'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:30.233217 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-94ab3ab8-a664-4a68-b86e-4d0f12537ffa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '596f419de0114934a2afe62a103ecf36'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:30.258181 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-94ab3ab8-a664-4a68-b86e-4d0f12537ffa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '596f419de0114934a2afe62a103ecf36'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:30.259295 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-94ab3ab8-a664-4a68-b86e-4d0f12537ffa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '596f419de0114934a2afe62a103ecf36'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:30.274981 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 879/1772] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:29 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:30.277124 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c6ce2-eb16-402d-805d-2643e73dbd37 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:30.277622 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c6ce2-eb16-402d-805d-2643e73dbd37 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:30.283251 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c6ce2-eb16-402d-805d-2643e73dbd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:30.287404 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 894/1773] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:11:29 2022] DELETE /identity/v3/users/596f419de0114934a2afe62a103ecf36 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:30.289821 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab3ab8-a664-4a68-b86e-4d0f12537ffa admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:30.301918 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-94ab3ab8-a664-4a68-b86e-4d0f12537ffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:30.358751 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-5b2c6ce2-eb16-402d-805d-2643e73dbd37 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:30.367071 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5b2c6ce2-eb16-402d-805d-2643e73dbd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:30.555842 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:30.637386 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab3ab8-a664-4a68-b86e-4d0f12537ffa admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:30.661305 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f17ea-2157-4217-bb58-a8dd24a0ef3d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a18591461343c3a0a1b0e317734ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:30.662000 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f17ea-2157-4217-bb58-a8dd24a0ef3d service placement] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:30.665372 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 880/1774] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:30.666370 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c6ce2-eb16-402d-805d-2643e73dbd37 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:30.667885 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f17ea-2157-4217-bb58-a8dd24a0ef3d service placement] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:30.670172 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f17ea-2157-4217-bb58-a8dd24a0ef3d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:30.672732 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5b2c6ce2-eb16-402d-805d-2643e73dbd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:30.677109 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-296f17ea-2157-4217-bb58-a8dd24a0ef3d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:30.719483 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f17ea-2157-4217-bb58-a8dd24a0ef3d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:30.726262 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f17ea-2157-4217-bb58-a8dd24a0ef3d service placement] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:30.770330 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 895/1775] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:30.771289 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f17ea-2157-4217-bb58-a8dd24a0ef3d service placement] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:30.777188 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-296f17ea-2157-4217-bb58-a8dd24a0ef3d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:30.827967 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f17ea-2157-4217-bb58-a8dd24a0ef3d service placement] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:30.843382 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c32981-e343-451f-a1c5-0fb669f62856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:30.849399 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c32981-e343-451f-a1c5-0fb669f62856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:30.850410 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c32981-e343-451f-a1c5-0fb669f62856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:30.851340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c32981-e343-451f-a1c5-0fb669f62856 admin admin] PATH_INFO: `/v3/users/9678081c80244638bb26d60d658d70b7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:30.855465 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c32981-e343-451f-a1c5-0fb669f62856 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9678081c80244638bb26d60d658d70b7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:30.865065 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c32981-e343-451f-a1c5-0fb669f62856 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:30.889658 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c6ce2-eb16-402d-805d-2643e73dbd37 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:30.906177 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94fef5f-3a97-46cc-bd71-0600c2bd9f5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:30.908612 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fef5f-3a97-46cc-bd71-0600c2bd9f5f service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:30.908905 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fef5f-3a97-46cc-bd71-0600c2bd9f5f service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:30.909181 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fef5f-3a97-46cc-bd71-0600c2bd9f5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:30.919738 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c94fef5f-3a97-46cc-bd71-0600c2bd9f5f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:31.073952 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-97c32981-e343-451f-a1c5-0fb669f62856 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9678081c80244638bb26d60d658d70b7'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:31.095063 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-97c32981-e343-451f-a1c5-0fb669f62856 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9678081c80244638bb26d60d658d70b7'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:31.097044 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-97c32981-e343-451f-a1c5-0fb669f62856 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9678081c80244638bb26d60d658d70b7'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:31.134852 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-97c32981-e343-451f-a1c5-0fb669f62856 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9678081c80244638bb26d60d658d70b7'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:31.136985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-97c32981-e343-451f-a1c5-0fb669f62856 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9678081c80244638bb26d60d658d70b7'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:31.181610 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 896/1776] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:11:30 2022] DELETE /identity/v3/users/9678081c80244638bb26d60d658d70b7 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:31.183887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c32981-e343-451f-a1c5-0fb669f62856 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:31.188781 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-97c32981-e343-451f-a1c5-0fb669f62856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:31.226336 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94fef5f-3a97-46cc-bd71-0600c2bd9f5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:31.233411 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94fef5f-3a97-46cc-bd71-0600c2bd9f5f service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:31.270280 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 881/1777] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:31.281145 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d7ff5-3904-4526-b40d-c5a729323c6d None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:31.281673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d7ff5-3904-4526-b40d-c5a729323c6d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:31.281744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d7ff5-3904-4526-b40d-c5a729323c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:31.354402 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-881d7ff5-3904-4526-b40d-c5a729323c6d None None] MFA Rules not processed for user `2648301ff6d24e14a2b0b8e34f742c9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:31.356585 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-881d7ff5-3904-4526-b40d-c5a729323c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:31.395231 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c32981-e343-451f-a1c5-0fb669f62856 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:31.403990 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:31.410220 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ed015-26e4-4d35-9524-1d988ac30443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:31.413035 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ed015-26e4-4d35-9524-1d988ac30443 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:31.415382 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ed015-26e4-4d35-9524-1d988ac30443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:31.415927 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ed015-26e4-4d35-9524-1d988ac30443 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:31.417617 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ed015-26e4-4d35-9524-1d988ac30443 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:11:31.421664 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ed015-26e4-4d35-9524-1d988ac30443 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:31.427327 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ed015-26e4-4d35-9524-1d988ac30443 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:31.457292 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 897/1778] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:11:31.457292 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786af03c-58d0-4d03-812a-4fcf9649ed35 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:31.457292 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786af03c-58d0-4d03-812a-4fcf9649ed35 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:31.457292 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786af03c-58d0-4d03-812a-4fcf9649ed35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:31.480185 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-786af03c-58d0-4d03-812a-4fcf9649ed35 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:31.482628 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-786af03c-58d0-4d03-812a-4fcf9649ed35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:31.510738 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 898/1779] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:31.511658 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786af03c-58d0-4d03-812a-4fcf9649ed35 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:31.538986 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786af03c-58d0-4d03-812a-4fcf9649ed35 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:31.547599 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 882/1780] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:31.549644 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5373b0-07ed-41f2-84f3-ff743774b857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:31.550665 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5373b0-07ed-41f2-84f3-ff743774b857 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:31.551303 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5373b0-07ed-41f2-84f3-ff743774b857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:31.552093 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d7ff5-3904-4526-b40d-c5a729323c6d None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:31.558115 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-881d7ff5-3904-4526-b40d-c5a729323c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:31.564840 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5373b0-07ed-41f2-84f3-ff743774b857 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:31.568109 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5373b0-07ed-41f2-84f3-ff743774b857 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:31.574190 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5373b0-07ed-41f2-84f3-ff743774b857 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:31.637255 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 899/1781] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:11:31 2022] POST /identity/v3/projects => generated 405 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:31.641551 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5373b0-07ed-41f2-84f3-ff743774b857 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:31.704626 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:31.805601 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d7ff5-3904-4526-b40d-c5a729323c6d None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:31.885495 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5373b0-07ed-41f2-84f3-ff743774b857 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:31.915244 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be30a69-d0a9-4a99-ae98-0231c1aa3a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:31.915877 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be30a69-d0a9-4a99-ae98-0231c1aa3a78 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:31.916323 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be30a69-d0a9-4a99-ae98-0231c1aa3a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:31.916559 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be30a69-d0a9-4a99-ae98-0231c1aa3a78 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:31.917356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be30a69-d0a9-4a99-ae98-0231c1aa3a78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:31.920314 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be30a69-d0a9-4a99-ae98-0231c1aa3a78 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:31.970450 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 900/1782] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:11:31 2022] POST /identity/v3/users => generated 303 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 04:11:31.976817 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be30a69-d0a9-4a99-ae98-0231c1aa3a78 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:32.001470 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be30a69-d0a9-4a99-ae98-0231c1aa3a78 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:32.008244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb796fb-37f4-4e6b-b612-6553d64f1e0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:32.009994 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb796fb-37f4-4e6b-b612-6553d64f1e0b service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:32.010579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb796fb-37f4-4e6b-b612-6553d64f1e0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:32.011083 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb796fb-37f4-4e6b-b612-6553d64f1e0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:32.037959 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a262e-5540-4abe-ac94-238f03ca9417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:32.038722 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a262e-5540-4abe-ac94-238f03ca9417 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:32.039088 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a262e-5540-4abe-ac94-238f03ca9417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:32.039282 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a262e-5540-4abe-ac94-238f03ca9417 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:32.040052 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a262e-5540-4abe-ac94-238f03ca9417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:32.052394 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a262e-5540-4abe-ac94-238f03ca9417 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:32.071729 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb796fb-37f4-4e6b-b612-6553d64f1e0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:32.074290 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb796fb-37f4-4e6b-b612-6553d64f1e0b service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:32.085393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 901/1783] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:32.088813 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a262e-5540-4abe-ac94-238f03ca9417 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:32.108236 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a262e-5540-4abe-ac94-238f03ca9417 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:32.119628 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106b66d-9e30-49d9-9a6e-b15f2e1fcf25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:32.120857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106b66d-9e30-49d9-9a6e-b15f2e1fcf25 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:32.121396 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 883/1784] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:32.133042 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106b66d-9e30-49d9-9a6e-b15f2e1fcf25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:32.133042 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106b66d-9e30-49d9-9a6e-b15f2e1fcf25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:32.137680 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a106b66d-9e30-49d9-9a6e-b15f2e1fcf25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:32.144527 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a106b66d-9e30-49d9-9a6e-b15f2e1fcf25 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:32.210622 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 902/1785] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:32.213239 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb796fb-37f4-4e6b-b612-6553d64f1e0b service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:32.228645 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb796fb-37f4-4e6b-b612-6553d64f1e0b service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:32.237920 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e47617-4797-4b6b-915b-c616af0f8b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:32.239682 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e47617-4797-4b6b-915b-c616af0f8b92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:32.239978 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e47617-4797-4b6b-915b-c616af0f8b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:32.240267 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e47617-4797-4b6b-915b-c616af0f8b92 admin admin] PATH_INFO: `/v3/projects/2b953a430b9a4156b0d69a3331dbffff/users/141f52692a9c47ddbd16459b28a9c0ce/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:32.247029 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106b66d-9e30-49d9-9a6e-b15f2e1fcf25 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:32.249956 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a106b66d-9e30-49d9-9a6e-b15f2e1fcf25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:32.283302 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106b66d-9e30-49d9-9a6e-b15f2e1fcf25 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:32.297287 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e47617-4797-4b6b-915b-c616af0f8b92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b953a430b9a4156b0d69a3331dbffff, user_id=141f52692a9c47ddbd16459b28a9c0ce, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:32.298143 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae18764-b9a0-4458-8c41-87c0f2e4bd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:32.300045 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae18764-b9a0-4458-8c41-87c0f2e4bd5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:32.300337 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae18764-b9a0-4458-8c41-87c0f2e4bd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:32.300617 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae18764-b9a0-4458-8c41-87c0f2e4bd5e admin admin] PATH_INFO: `/v3/projects/1e848f5121a344a19d5ccf603140669b` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:32.303348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e47617-4797-4b6b-915b-c616af0f8b92 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:32.304294 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae18764-b9a0-4458-8c41-87c0f2e4bd5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e848f5121a344a19d5ccf603140669b)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:32.313263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae18764-b9a0-4458-8c41-87c0f2e4bd5e admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:32.378966 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 884/1786] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:32 2022] PUT /identity/v3/projects/2b953a430b9a4156b0d69a3331dbffff/users/141f52692a9c47ddbd16459b28a9c0ce/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:32.384820 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84f33a-db1f-4e7e-97f7-6e3f84747bfc None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:32.385122 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84f33a-db1f-4e7e-97f7-6e3f84747bfc None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:32.385407 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84f33a-db1f-4e7e-97f7-6e3f84747bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:32.522774 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-5d84f33a-db1f-4e7e-97f7-6e3f84747bfc None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:32.524109 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5d84f33a-db1f-4e7e-97f7-6e3f84747bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:32.614567 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-cae18764-b9a0-4458-8c41-87c0f2e4bd5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e848f5121a344a19d5ccf603140669b', 'request_id': 'req-cae18764-b9a0-4458-8c41-87c0f2e4bd5e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:32.656323 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-cae18764-b9a0-4458-8c41-87c0f2e4bd5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e848f5121a344a19d5ccf603140669b', 'request_id': 'req-cae18764-b9a0-4458-8c41-87c0f2e4bd5e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:32.686512 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-cae18764-b9a0-4458-8c41-87c0f2e4bd5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e848f5121a344a19d5ccf603140669b', 'request_id': 'req-cae18764-b9a0-4458-8c41-87c0f2e4bd5e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:32.723780 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-cae18764-b9a0-4458-8c41-87c0f2e4bd5e admin admin] The token cache is being invalidate because project 1e848f5121a344a19d5ccf603140669b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:11:32.724164 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-cae18764-b9a0-4458-8c41-87c0f2e4bd5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:32.724916 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-cae18764-b9a0-4458-8c41-87c0f2e4bd5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:32.727006 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 903/1787] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:11:32 2022] DELETE /identity/v3/projects/1e848f5121a344a19d5ccf603140669b => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:32.732337 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca3959-cd9e-435b-bf89-fc99965a968d None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:32.732676 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca3959-cd9e-435b-bf89-fc99965a968d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:32.733056 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca3959-cd9e-435b-bf89-fc99965a968d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:32.777621 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-24ca3959-cd9e-435b-bf89-fc99965a968d None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:32.779123 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-24ca3959-cd9e-435b-bf89-fc99965a968d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:32.793950 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 885/1788] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:32.821325 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84f33a-db1f-4e7e-97f7-6e3f84747bfc None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:32.823390 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5d84f33a-db1f-4e7e-97f7-6e3f84747bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:32.832732 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:33.001194 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84f33a-db1f-4e7e-97f7-6e3f84747bfc None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:33.002964 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 904/1789] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:11:33.011302 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbe373-59c0-4af7-bb14-06293f3fd55c None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:33.011302 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbe373-59c0-4af7-bb14-06293f3fd55c None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:33.011649 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbe373-59c0-4af7-bb14-06293f3fd55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:33.089272 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-5ecbe373-59c0-4af7-bb14-06293f3fd55c None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:33.090623 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-5ecbe373-59c0-4af7-bb14-06293f3fd55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:33.108036 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036ed4a-e273-4a59-8e27-fbe74e81170b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:33.109182 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036ed4a-e273-4a59-8e27-fbe74e81170b service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:33.109669 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036ed4a-e273-4a59-8e27-fbe74e81170b service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:33.110144 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036ed4a-e273-4a59-8e27-fbe74e81170b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:33.121568 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 905/1790] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:33.127081 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbe373-59c0-4af7-bb14-06293f3fd55c None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:33.128850 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036ed4a-e273-4a59-8e27-fbe74e81170b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:33.132339 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036ed4a-e273-4a59-8e27-fbe74e81170b service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:33.142024 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:33.152993 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbe373-59c0-4af7-bb14-06293f3fd55c None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:33.157263 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 886/1791] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 04:11:33.178371 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344026d-bba0-428e-9802-a07217c09482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:33.179148 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344026d-bba0-428e-9802-a07217c09482 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:33.179436 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344026d-bba0-428e-9802-a07217c09482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:33.179718 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344026d-bba0-428e-9802-a07217c09482 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:33.180491 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344026d-bba0-428e-9802-a07217c09482 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:11:33.180853 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344026d-bba0-428e-9802-a07217c09482 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:33.182566 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344026d-bba0-428e-9802-a07217c09482 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:33.226728 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 906/1792] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 04:11:33.231949 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036ed4a-e273-4a59-8e27-fbe74e81170b service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:33.251013 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036ed4a-e273-4a59-8e27-fbe74e81170b service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:33.265008 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9092b-2925-4f64-8b08-457aa1a35f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:33.266944 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9092b-2925-4f64-8b08-457aa1a35f96 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:33.268585 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9092b-2925-4f64-8b08-457aa1a35f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:33.268971 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9092b-2925-4f64-8b08-457aa1a35f96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:33.269756 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f9092b-2925-4f64-8b08-457aa1a35f96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:33.276241 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f9092b-2925-4f64-8b08-457aa1a35f96 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:33.364512 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 887/1793] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:11:33 2022] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:33.369526 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344026d-bba0-428e-9802-a07217c09482 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:33.385433 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344026d-bba0-428e-9802-a07217c09482 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:33.409977 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9092b-2925-4f64-8b08-457aa1a35f96 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:33.414605 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e1f9092b-2925-4f64-8b08-457aa1a35f96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:33.686932 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20431fce-6579-4315-bbea-eb803b617a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:33.687635 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20431fce-6579-4315-bbea-eb803b617a3e admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:33.688074 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20431fce-6579-4315-bbea-eb803b617a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:33.688503 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20431fce-6579-4315-bbea-eb803b617a3e admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:33.689407 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20431fce-6579-4315-bbea-eb803b617a3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:33.691580 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20431fce-6579-4315-bbea-eb803b617a3e admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:33.723943 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9092b-2925-4f64-8b08-457aa1a35f96 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:33.753763 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94c588-bd99-42dd-b7ee-f9080260c179 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:33.756303 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94c588-bd99-42dd-b7ee-f9080260c179 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:33.756614 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94c588-bd99-42dd-b7ee-f9080260c179 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:33.757135 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94c588-bd99-42dd-b7ee-f9080260c179 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:33.769208 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4a94c588-bd99-42dd-b7ee-f9080260c179 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:33.772663 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 907/1794] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:11:33 2022] POST /identity/v3/users => generated 291 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:33.772663 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20431fce-6579-4315-bbea-eb803b617a3e admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:33.786984 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-20431fce-6579-4315-bbea-eb803b617a3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:33.832458 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20431fce-6579-4315-bbea-eb803b617a3e admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:33.864231 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f1229-59e1-4bca-bec1-3a3ab09487a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:33.865392 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f1229-59e1-4bca-bec1-3a3ab09487a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:33.865925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f1229-59e1-4bca-bec1-3a3ab09487a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:33.866378 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f1229-59e1-4bca-bec1-3a3ab09487a7 admin admin] PATH_INFO: `/v3/projects/8ad51ee6687e4e5ca3c08601a4faa95d` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:33.868913 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f1229-59e1-4bca-bec1-3a3ab09487a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ad51ee6687e4e5ca3c08601a4faa95d)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:33.871179 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f1229-59e1-4bca-bec1-3a3ab09487a7 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:33.885659 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:33.934344 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a94c588-bd99-42dd-b7ee-f9080260c179 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:33.940155 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a94c588-bd99-42dd-b7ee-f9080260c179 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:34.021871 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 888/1795] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:33 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:34.025005 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94c588-bd99-42dd-b7ee-f9080260c179 service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:34.031634 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-2e3f1229-59e1-4bca-bec1-3a3ab09487a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ad51ee6687e4e5ca3c08601a4faa95d', 'request_id': 'req-2e3f1229-59e1-4bca-bec1-3a3ab09487a7'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:34.046850 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-2e3f1229-59e1-4bca-bec1-3a3ab09487a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ad51ee6687e4e5ca3c08601a4faa95d', 'request_id': 'req-2e3f1229-59e1-4bca-bec1-3a3ab09487a7'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:34.060484 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94c588-bd99-42dd-b7ee-f9080260c179 service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:34.071160 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-2e3f1229-59e1-4bca-bec1-3a3ab09487a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ad51ee6687e4e5ca3c08601a4faa95d', 'request_id': 'req-2e3f1229-59e1-4bca-bec1-3a3ab09487a7'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:34.105106 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-2e3f1229-59e1-4bca-bec1-3a3ab09487a7 admin admin] The token cache is being invalidate because project 8ad51ee6687e4e5ca3c08601a4faa95d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:11:34.105410 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-2e3f1229-59e1-4bca-bec1-3a3ab09487a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:34.109363 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-2e3f1229-59e1-4bca-bec1-3a3ab09487a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:34.118256 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 908/1796] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:11:33 2022] DELETE /identity/v3/projects/8ad51ee6687e4e5ca3c08601a4faa95d => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:34.123447 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f1229-59e1-4bca-bec1-3a3ab09487a7 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:34.126097 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-2e3f1229-59e1-4bca-bec1-3a3ab09487a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:34.217212 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f1229-59e1-4bca-bec1-3a3ab09487a7 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:34.224488 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6153fa-75e8-4789-b797-b34fba1521c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:34.225873 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6153fa-75e8-4789-b797-b34fba1521c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:34.226459 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6153fa-75e8-4789-b797-b34fba1521c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:34.227087 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6153fa-75e8-4789-b797-b34fba1521c7 admin admin] PATH_INFO: `/v3/users/f9daf69e254f40a49bb06ae0d15820cb` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:34.230469 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6153fa-75e8-4789-b797-b34fba1521c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9daf69e254f40a49bb06ae0d15820cb)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:34.234876 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6153fa-75e8-4789-b797-b34fba1521c7 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:34.247233 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:34.359902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9f6153fa-75e8-4789-b797-b34fba1521c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9daf69e254f40a49bb06ae0d15820cb'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:34.369920 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2839b8a-0003-4599-a08d-345b3f65dadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:34.373113 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2839b8a-0003-4599-a08d-345b3f65dadc admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:34.373816 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2839b8a-0003-4599-a08d-345b3f65dadc admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:34.374108 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2839b8a-0003-4599-a08d-345b3f65dadc admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:34.376955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2839b8a-0003-4599-a08d-345b3f65dadc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:34.377301 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9f6153fa-75e8-4789-b797-b34fba1521c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9daf69e254f40a49bb06ae0d15820cb'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:34.378141 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9f6153fa-75e8-4789-b797-b34fba1521c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9daf69e254f40a49bb06ae0d15820cb'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:34.383349 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2839b8a-0003-4599-a08d-345b3f65dadc admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:34.414390 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9f6153fa-75e8-4789-b797-b34fba1521c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9daf69e254f40a49bb06ae0d15820cb'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:34.415860 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 889/1797] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:34.416882 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9f6153fa-75e8-4789-b797-b34fba1521c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9daf69e254f40a49bb06ae0d15820cb'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:34.419903 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2839b8a-0003-4599-a08d-345b3f65dadc admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:34.425853 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b2839b8a-0003-4599-a08d-345b3f65dadc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:34.452111 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 909/1798] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:11:34 2022] DELETE /identity/v3/users/f9daf69e254f40a49bb06ae0d15820cb => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 04:11:34.460607 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2839b8a-0003-4599-a08d-345b3f65dadc admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:34.653336 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398f474-0f3e-4a78-a3ed-55925ad8ad36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:34.655469 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398f474-0f3e-4a78-a3ed-55925ad8ad36 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:34.657499 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398f474-0f3e-4a78-a3ed-55925ad8ad36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:34.657499 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398f474-0f3e-4a78-a3ed-55925ad8ad36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:34.695482 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398f474-0f3e-4a78-a3ed-55925ad8ad36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:34.702089 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398f474-0f3e-4a78-a3ed-55925ad8ad36 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:34.734418 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 890/1799] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:34.735665 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6153fa-75e8-4789-b797-b34fba1521c7 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:34.749740 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6153fa-75e8-4789-b797-b34fba1521c7 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:34.765986 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31acd2-2511-4ad6-9d2a-db042d2df908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:34.767673 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31acd2-2511-4ad6-9d2a-db042d2df908 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:34.768176 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31acd2-2511-4ad6-9d2a-db042d2df908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:34.768678 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31acd2-2511-4ad6-9d2a-db042d2df908 admin admin] PATH_INFO: `/v3/projects/f5414156f823452b8e82c3f233551ee5/users/a0e05332116d4be4bc197d3f2cac074e/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:34.822626 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31acd2-2511-4ad6-9d2a-db042d2df908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5414156f823452b8e82c3f233551ee5, user_id=a0e05332116d4be4bc197d3f2cac074e, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:34.825983 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31acd2-2511-4ad6-9d2a-db042d2df908 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:34.845207 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaccec3-554d-40d2-8d03-eeb6250799c5 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:34.845514 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaccec3-554d-40d2-8d03-eeb6250799c5 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:34.845804 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaccec3-554d-40d2-8d03-eeb6250799c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:34.877017 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 910/1800] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:34 2022] PUT /identity/v3/projects/f5414156f823452b8e82c3f233551ee5/users/a0e05332116d4be4bc197d3f2cac074e/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:34.896029 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd67e4-4c23-4f8a-9da4-f04a3f758005 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:34.902990 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd67e4-4c23-4f8a-9da4-f04a3f758005 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:34.905901 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd67e4-4c23-4f8a-9da4-f04a3f758005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:34.921093 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-adaccec3-554d-40d2-8d03-eeb6250799c5 None None] MFA Rules not processed for user `141f52692a9c47ddbd16459b28a9c0ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:34.926186 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-adaccec3-554d-40d2-8d03-eeb6250799c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:34.986265 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-5bcd67e4-4c23-4f8a-9da4-f04a3f758005 None None] MFA Rules not processed for user `a0e05332116d4be4bc197d3f2cac074e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:34.995849 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-5bcd67e4-4c23-4f8a-9da4-f04a3f758005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:35.128368 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 891/1801] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:34 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:35.132749 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaccec3-554d-40d2-8d03-eeb6250799c5 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:35.135021 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-adaccec3-554d-40d2-8d03-eeb6250799c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:35.189398 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:35.196804 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 911/1802] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:35.199522 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd67e4-4c23-4f8a-9da4-f04a3f758005 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:35.205259 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-5bcd67e4-4c23-4f8a-9da4-f04a3f758005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:35.349694 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaccec3-554d-40d2-8d03-eeb6250799c5 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:35.356916 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:35.362015 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4187ebd1-c76b-47fb-aa5e-0591fd5f85b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:35.365820 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187ebd1-c76b-47fb-aa5e-0591fd5f85b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:35.367051 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187ebd1-c76b-47fb-aa5e-0591fd5f85b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:35.367388 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187ebd1-c76b-47fb-aa5e-0591fd5f85b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:35.371216 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4187ebd1-c76b-47fb-aa5e-0591fd5f85b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:35.380938 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4187ebd1-c76b-47fb-aa5e-0591fd5f85b5 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:35.406001 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd67e4-4c23-4f8a-9da4-f04a3f758005 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:35.418894 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb8eda-f237-4525-85bc-638a34386c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:35.419801 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb8eda-f237-4525-85bc-638a34386c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:35.420605 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb8eda-f237-4525-85bc-638a34386c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:35.422082 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb8eda-f237-4525-85bc-638a34386c5f admin admin] PATH_INFO: `/v3/projects/1814084e9b5443c5a573c8d5e3e00c57` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:35.423783 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb8eda-f237-4525-85bc-638a34386c5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1814084e9b5443c5a573c8d5e3e00c57)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:35.427146 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb8eda-f237-4525-85bc-638a34386c5f admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:35.471637 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 892/1803] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:11:35 2022] POST /identity/v3/projects => generated 405 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 04:11:35.475850 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4187ebd1-c76b-47fb-aa5e-0591fd5f85b5 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:35.606476 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-abbb8eda-f237-4525-85bc-638a34386c5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1814084e9b5443c5a573c8d5e3e00c57', 'request_id': 'req-abbb8eda-f237-4525-85bc-638a34386c5f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:35.629852 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-abbb8eda-f237-4525-85bc-638a34386c5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1814084e9b5443c5a573c8d5e3e00c57', 'request_id': 'req-abbb8eda-f237-4525-85bc-638a34386c5f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:35.655483 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-abbb8eda-f237-4525-85bc-638a34386c5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1814084e9b5443c5a573c8d5e3e00c57', 'request_id': 'req-abbb8eda-f237-4525-85bc-638a34386c5f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:35.692730 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-abbb8eda-f237-4525-85bc-638a34386c5f admin admin] The token cache is being invalidate because project 1814084e9b5443c5a573c8d5e3e00c57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:11:35.693081 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4187ebd1-c76b-47fb-aa5e-0591fd5f85b5 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:35.693632 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-abbb8eda-f237-4525-85bc-638a34386c5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:35.694690 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-abbb8eda-f237-4525-85bc-638a34386c5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:35.698568 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 912/1804] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:11:35 2022] DELETE /identity/v3/projects/1814084e9b5443c5a573c8d5e3e00c57 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:35.704577 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb8eda-f237-4525-85bc-638a34386c5f admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:35.707387 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-abbb8eda-f237-4525-85bc-638a34386c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:35.813893 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb8eda-f237-4525-85bc-638a34386c5f admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:35.820774 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d9911-1d7f-4959-9e0e-abb8119030ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:35.821472 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d9911-1d7f-4959-9e0e-abb8119030ff admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:35.821757 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d9911-1d7f-4959-9e0e-abb8119030ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:35.822086 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d9911-1d7f-4959-9e0e-abb8119030ff admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:35.823564 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d9911-1d7f-4959-9e0e-abb8119030ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:35.826289 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d9911-1d7f-4959-9e0e-abb8119030ff admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:35.863423 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 913/1805] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:11:35 2022] POST /identity/v3/users => generated 309 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:35.865343 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e4484-9427-40aa-8063-c012d64b2f36 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:35.865803 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e4484-9427-40aa-8063-c012d64b2f36 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:35.866408 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e4484-9427-40aa-8063-c012d64b2f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:35.890146 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ed6e4484-9427-40aa-8063-c012d64b2f36 None None] MFA Rules not processed for user `03e7f908f0a7499792e59e31d497edb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:35.891654 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ed6e4484-9427-40aa-8063-c012d64b2f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:35.926838 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282f2a9-fe87-4035-a22c-689121c95298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:35.927931 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282f2a9-fe87-4035-a22c-689121c95298 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:35.927931 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282f2a9-fe87-4035-a22c-689121c95298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:35.933396 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282f2a9-fe87-4035-a22c-689121c95298 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:35.934313 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282f2a9-fe87-4035-a22c-689121c95298 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:35.944407 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282f2a9-fe87-4035-a22c-689121c95298 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:35.981908 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 914/1806] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Jul 4 04:11:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:35.985740 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db6366-b735-452c-b96a-a96972119632 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:35.986440 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db6366-b735-452c-b96a-a96972119632 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:35.987179 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db6366-b735-452c-b96a-a96972119632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:36.022829 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-34db6366-b735-452c-b96a-a96972119632 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:36.030104 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-34db6366-b735-452c-b96a-a96972119632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:36.056044 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 915/1807] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:36.057094 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db6366-b735-452c-b96a-a96972119632 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:36.058804 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 893/1808] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:11:35 2022] POST /identity/v3/projects => generated 381 bytes in 587 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:36.061420 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ff795-0fd4-4a8f-8336-71b146dea388 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:36.061718 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ff795-0fd4-4a8f-8336-71b146dea388 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:36.064741 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ff795-0fd4-4a8f-8336-71b146dea388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:36.078617 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db6366-b735-452c-b96a-a96972119632 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:36.085520 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:36.130489 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-bc7ff795-0fd4-4a8f-8336-71b146dea388 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:36.153015 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-bc7ff795-0fd4-4a8f-8336-71b146dea388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:36.161506 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960f654-7db1-4b5f-aedd-88d5e7fad5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:36.164319 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960f654-7db1-4b5f-aedd-88d5e7fad5f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:36.164777 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960f654-7db1-4b5f-aedd-88d5e7fad5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:36.165260 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960f654-7db1-4b5f-aedd-88d5e7fad5f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:36.166360 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4960f654-7db1-4b5f-aedd-88d5e7fad5f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:36.168868 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4960f654-7db1-4b5f-aedd-88d5e7fad5f8 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:36.186526 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 916/1809] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:36.187946 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960f654-7db1-4b5f-aedd-88d5e7fad5f8 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:36.191767 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4960f654-7db1-4b5f-aedd-88d5e7fad5f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:36.214105 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960f654-7db1-4b5f-aedd-88d5e7fad5f8 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:36.214709 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 894/1810] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:36.215767 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ff795-0fd4-4a8f-8336-71b146dea388 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:36.228295 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24f9de-1681-4835-b233-cf24b1af27f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:36.232013 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24f9de-1681-4835-b233-cf24b1af27f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:36.232621 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24f9de-1681-4835-b233-cf24b1af27f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:36.233247 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e24f9de-1681-4835-b233-cf24b1af27f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:36.234370 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e24f9de-1681-4835-b233-cf24b1af27f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:36.237651 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ff795-0fd4-4a8f-8336-71b146dea388 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:36.237795 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e24f9de-1681-4835-b233-cf24b1af27f2 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:36.267054 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3c0e2-6cb1-42f4-9427-55e2eceefa80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:36.268542 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3c0e2-6cb1-42f4-9427-55e2eceefa80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:36.269125 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3c0e2-6cb1-42f4-9427-55e2eceefa80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:36.269431 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3c0e2-6cb1-42f4-9427-55e2eceefa80 admin admin] PATH_INFO: `/v3/projects/4d8cc6a1029a455fb15511ada976a452/users/bdbd4d8876ae4adbaca6bf975cf16521/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:36.288724 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 917/1811] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:11:36 2022] POST /identity/v3/users => generated 297 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:36.292108 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24f9de-1681-4835-b233-cf24b1af27f2 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:36.306862 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b3c0e2-6cb1-42f4-9427-55e2eceefa80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d8cc6a1029a455fb15511ada976a452, user_id=bdbd4d8876ae4adbaca6bf975cf16521, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:36.309560 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b3c0e2-6cb1-42f4-9427-55e2eceefa80 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:36.309697 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e24f9de-1681-4835-b233-cf24b1af27f2 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:36.318352 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b43c5-e543-480e-b12d-59cecd653df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:36.319354 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b43c5-e543-480e-b12d-59cecd653df9 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:36.319770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b43c5-e543-480e-b12d-59cecd653df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:36.320191 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b43c5-e543-480e-b12d-59cecd653df9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:36.321146 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b43c5-e543-480e-b12d-59cecd653df9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:11:36.322949 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b43c5-e543-480e-b12d-59cecd653df9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:36.327196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b43c5-e543-480e-b12d-59cecd653df9 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:36.329190 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:36.337469 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 895/1812] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:36 2022] PUT /identity/v3/projects/4d8cc6a1029a455fb15511ada976a452/users/bdbd4d8876ae4adbaca6bf975cf16521/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:36.339849 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3c0e2-6cb1-42f4-9427-55e2eceefa80 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:36.361042 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 918/1813] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:11:36.362460 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b43c5-e543-480e-b12d-59cecd653df9 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:36.378738 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b43c5-e543-480e-b12d-59cecd653df9 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:36.519826 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f6636-19c6-4a97-b4c8-3c96d07b5445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:36.520556 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f6636-19c6-4a97-b4c8-3c96d07b5445 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:36.520845 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f6636-19c6-4a97-b4c8-3c96d07b5445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:36.521127 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f6636-19c6-4a97-b4c8-3c96d07b5445 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:36.521863 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753f6636-19c6-4a97-b4c8-3c96d07b5445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:36.523570 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753f6636-19c6-4a97-b4c8-3c96d07b5445 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:36.530788 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3c0e2-6cb1-42f4-9427-55e2eceefa80 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:36.540042 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 919/1814] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:36.542635 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f6636-19c6-4a97-b4c8-3c96d07b5445 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:36.550077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30180820-5274-42d8-a76a-d2ad3b1bd099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:36.552063 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30180820-5274-42d8-a76a-d2ad3b1bd099 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:36.552577 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30180820-5274-42d8-a76a-d2ad3b1bd099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:36.553005 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30180820-5274-42d8-a76a-d2ad3b1bd099 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:36.557698 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30180820-5274-42d8-a76a-d2ad3b1bd099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:36.559583 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30180820-5274-42d8-a76a-d2ad3b1bd099 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:36.568385 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f6636-19c6-4a97-b4c8-3c96d07b5445 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:36.580388 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafe241-545c-4288-86f3-87b8814da1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:36.581376 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafe241-545c-4288-86f3-87b8814da1ef admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:36.581769 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafe241-545c-4288-86f3-87b8814da1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:36.582123 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafe241-545c-4288-86f3-87b8814da1ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:36.582942 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bafe241-545c-4288-86f3-87b8814da1ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:36.583982 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 896/1815] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:36.585136 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30180820-5274-42d8-a76a-d2ad3b1bd099 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:36.593191 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-30180820-5274-42d8-a76a-d2ad3b1bd099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:36.602129 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bafe241-545c-4288-86f3-87b8814da1ef admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:36.695786 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 920/1816] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:11:36 2022] POST /identity/v3/projects => generated 401 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:36.697760 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafe241-545c-4288-86f3-87b8814da1ef admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:36.768151 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30180820-5274-42d8-a76a-d2ad3b1bd099 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:36.876745 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:36.921188 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafe241-545c-4288-86f3-87b8814da1ef admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:36.931244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28eeaa-b8b0-4793-90e7-5f96304a2025 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f93fdc98ff425791da3e2194b3a671', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:36.932503 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28eeaa-b8b0-4793-90e7-5f96304a2025 service swift] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:36.932622 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28eeaa-b8b0-4793-90e7-5f96304a2025 service swift] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:36.932990 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28eeaa-b8b0-4793-90e7-5f96304a2025 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:36.937443 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629f6ad-2664-402d-b322-153b8d56e394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:36.938445 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629f6ad-2664-402d-b322-153b8d56e394 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:36.938730 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629f6ad-2664-402d-b322-153b8d56e394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:36.939009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629f6ad-2664-402d-b322-153b8d56e394 admin admin] PATH_INFO: `/v3/projects/4d8cc6a1029a455fb15511ada976a452/users/bdbd4d8876ae4adbaca6bf975cf16521/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:36.944824 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e629f6ad-2664-402d-b322-153b8d56e394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d8cc6a1029a455fb15511ada976a452, user_id=bdbd4d8876ae4adbaca6bf975cf16521, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:36.954698 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e629f6ad-2664-402d-b322-153b8d56e394 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:37.010686 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 921/1817] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:36 2022] PUT /identity/v3/projects/4d8cc6a1029a455fb15511ada976a452/users/bdbd4d8876ae4adbaca6bf975cf16521/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:37.011730 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629f6ad-2664-402d-b322-153b8d56e394 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:37.032506 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:37.074203 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f28eeaa-b8b0-4793-90e7-5f96304a2025 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:37.080239 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f28eeaa-b8b0-4793-90e7-5f96304a2025 service swift] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:37.115139 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 897/1818] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Jul 4 04:11:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 04:11:37.116332 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28eeaa-b8b0-4793-90e7-5f96304a2025 service swift] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:37.128264 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28eeaa-b8b0-4793-90e7-5f96304a2025 service swift] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:37.160235 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629f6ad-2664-402d-b322-153b8d56e394 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:37.176231 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ea23a-75fa-4213-b8a2-d1b8b761b077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:37.178360 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ea23a-75fa-4213-b8a2-d1b8b761b077 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:37.180555 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ea23a-75fa-4213-b8a2-d1b8b761b077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:37.181916 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ea23a-75fa-4213-b8a2-d1b8b761b077 admin admin] PATH_INFO: `/v3/projects/bdf2575a52724110bc7ee464560336b0/users/c0f4af5a531c4520b031172545ab8392/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:37.228078 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ea23a-75fa-4213-b8a2-d1b8b761b077 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf2575a52724110bc7ee464560336b0, user_id=c0f4af5a531c4520b031172545ab8392, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:37.237519 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ea23a-75fa-4213-b8a2-d1b8b761b077 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:37.269772 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 922/1819] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:37 2022] PUT /identity/v3/projects/bdf2575a52724110bc7ee464560336b0/users/c0f4af5a531c4520b031172545ab8392/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:37.280335 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ea23a-75fa-4213-b8a2-d1b8b761b077 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:37.366691 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc51d8-f0b7-4699-85c6-2d59fed86c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:37.367531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc51d8-f0b7-4699-85c6-2d59fed86c38 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:37.376513 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc51d8-f0b7-4699-85c6-2d59fed86c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:37.376849 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc51d8-f0b7-4699-85c6-2d59fed86c38 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:37.377703 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc51d8-f0b7-4699-85c6-2d59fed86c38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:37.390850 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc51d8-f0b7-4699-85c6-2d59fed86c38 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:37.473801 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ea23a-75fa-4213-b8a2-d1b8b761b077 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:37.477597 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 898/1820] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:11:37 2022] POST /identity/v3/users => generated 301 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:37.479555 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc51d8-f0b7-4699-85c6-2d59fed86c38 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:37.489339 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493d9e9-47ec-4e81-8702-0a42f8668c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:37.490029 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493d9e9-47ec-4e81-8702-0a42f8668c1c admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:37.490351 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493d9e9-47ec-4e81-8702-0a42f8668c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:37.490638 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493d9e9-47ec-4e81-8702-0a42f8668c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:37.491525 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493d9e9-47ec-4e81-8702-0a42f8668c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:37.503328 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493d9e9-47ec-4e81-8702-0a42f8668c1c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:37.512403 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc51d8-f0b7-4699-85c6-2d59fed86c38 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:37.526585 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e823be-4024-4b3d-aff6-8355563756c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:37.527449 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e823be-4024-4b3d-aff6-8355563756c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:37.527675 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e823be-4024-4b3d-aff6-8355563756c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:37.528661 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e823be-4024-4b3d-aff6-8355563756c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:37.529702 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e823be-4024-4b3d-aff6-8355563756c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:37.531978 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e823be-4024-4b3d-aff6-8355563756c9 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:37.543576 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 923/1821] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:37.550785 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493d9e9-47ec-4e81-8702-0a42f8668c1c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:37.555214 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 899/1822] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:37.556748 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e823be-4024-4b3d-aff6-8355563756c9 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:37.588803 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493d9e9-47ec-4e81-8702-0a42f8668c1c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:37.612236 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e823be-4024-4b3d-aff6-8355563756c9 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:37.615896 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bae825-761c-4f52-9351-fc300cf6f658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:37.616838 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bae825-761c-4f52-9351-fc300cf6f658 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:37.617139 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bae825-761c-4f52-9351-fc300cf6f658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:37.617417 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bae825-761c-4f52-9351-fc300cf6f658 admin admin] PATH_INFO: `/v3/projects/bdf2575a52724110bc7ee464560336b0/users/c0f4af5a531c4520b031172545ab8392/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:37.630846 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bae825-761c-4f52-9351-fc300cf6f658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf2575a52724110bc7ee464560336b0, user_id=c0f4af5a531c4520b031172545ab8392, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:37.632648 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ca433-b5b3-4403-87a9-c3f6637632c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:37.633629 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bae825-761c-4f52-9351-fc300cf6f658 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:37.639795 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ca433-b5b3-4403-87a9-c3f6637632c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:37.640107 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ca433-b5b3-4403-87a9-c3f6637632c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:37.642571 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ca433-b5b3-4403-87a9-c3f6637632c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:37.643415 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ca433-b5b3-4403-87a9-c3f6637632c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:37.649717 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ca433-b5b3-4403-87a9-c3f6637632c9 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:37.678886 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 924/1823] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:37 2022] PUT /identity/v3/projects/bdf2575a52724110bc7ee464560336b0/users/c0f4af5a531c4520b031172545ab8392/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:37.689434 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87f529-bf95-46aa-aa32-adf496102e48 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:37.689730 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87f529-bf95-46aa-aa32-adf496102e48 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:37.690024 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87f529-bf95-46aa-aa32-adf496102e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:37.694450 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 900/1824] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:37.695435 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ca433-b5b3-4403-87a9-c3f6637632c9 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:37.723641 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ca433-b5b3-4403-87a9-c3f6637632c9 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:37.774126 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-5c87f529-bf95-46aa-aa32-adf496102e48 None None] MFA Rules not processed for user `c0f4af5a531c4520b031172545ab8392`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:37.775461 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-5c87f529-bf95-46aa-aa32-adf496102e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:37.916856 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466fa5f-da91-4688-85f0-b16f311974a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:37.917963 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466fa5f-da91-4688-85f0-b16f311974a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:37.918303 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466fa5f-da91-4688-85f0-b16f311974a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:37.918777 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466fa5f-da91-4688-85f0-b16f311974a6 admin admin] PATH_INFO: `/v3/projects/2aeadd97e6514844b867b4cec569b9d9/users/db0d39764f074ad2b759848d0e3ab25f/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:37.918948 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:37.956341 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466fa5f-da91-4688-85f0-b16f311974a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aeadd97e6514844b867b4cec569b9d9, user_id=db0d39764f074ad2b759848d0e3ab25f, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:37.959942 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466fa5f-da91-4688-85f0-b16f311974a6 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:38.006239 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 901/1825] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:37 2022] PUT /identity/v3/projects/2aeadd97e6514844b867b4cec569b9d9/users/db0d39764f074ad2b759848d0e3ab25f/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:38.033195 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3e76f-b3d2-498f-a968-e374b8b3e555 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:38.035893 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3e76f-b3d2-498f-a968-e374b8b3e555 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:38.040681 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3e76f-b3d2-498f-a968-e374b8b3e555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:38.080342 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 925/1826] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:37 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:11:38.091944 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87f529-bf95-46aa-aa32-adf496102e48 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:38.094336 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-5c87f529-bf95-46aa-aa32-adf496102e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:38.163471 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-64b3e76f-b3d2-498f-a968-e374b8b3e555 None None] MFA Rules not processed for user `db0d39764f074ad2b759848d0e3ab25f`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:38.165331 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-64b3e76f-b3d2-498f-a968-e374b8b3e555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:38.212925 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:38.263404 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87f529-bf95-46aa-aa32-adf496102e48 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:38.379287 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 902/1827] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:38 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:38.385496 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3e76f-b3d2-498f-a968-e374b8b3e555 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:38.458322 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717498a3-99d7-49b1-9e54-c965390122a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:38.459243 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717498a3-99d7-49b1-9e54-c965390122a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:38.459682 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717498a3-99d7-49b1-9e54-c965390122a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:38.460119 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717498a3-99d7-49b1-9e54-c965390122a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:38.635886 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3e76f-b3d2-498f-a968-e374b8b3e555 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:38.653726 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac369691-54a5-4d52-9adf-f9996c9a4bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:38.654612 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac369691-54a5-4d52-9adf-f9996c9a4bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:38.655419 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac369691-54a5-4d52-9adf-f9996c9a4bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:38.655419 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac369691-54a5-4d52-9adf-f9996c9a4bd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:38.656089 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac369691-54a5-4d52-9adf-f9996c9a4bd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:38.658462 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac369691-54a5-4d52-9adf-f9996c9a4bd2 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:38.737638 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717498a3-99d7-49b1-9e54-c965390122a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:38.739424 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717498a3-99d7-49b1-9e54-c965390122a6 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:38.779677 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 903/1828] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:11:38 2022] POST /identity/v3/projects => generated 401 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:38.781203 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 926/1829] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:38 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 690 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 04:11:38.784553 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac369691-54a5-4d52-9adf-f9996c9a4bd2 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:39.015938 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac369691-54a5-4d52-9adf-f9996c9a4bd2 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:39.031026 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f384c86-69fe-47dd-a5ec-23b157825ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:39.031824 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f384c86-69fe-47dd-a5ec-23b157825ada admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:39.032115 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f384c86-69fe-47dd-a5ec-23b157825ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:39.032398 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f384c86-69fe-47dd-a5ec-23b157825ada admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:39.033274 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f384c86-69fe-47dd-a5ec-23b157825ada admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:39.035565 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f384c86-69fe-47dd-a5ec-23b157825ada admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:39.132058 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717498a3-99d7-49b1-9e54-c965390122a6 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:39.142268 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 904/1830] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:11:38 2022] POST /identity/v3/users => generated 307 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:39.155129 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717498a3-99d7-49b1-9e54-c965390122a6 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:39.181329 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844d955-0001-49e7-a323-d92c034ebd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:39.189150 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844d955-0001-49e7-a323-d92c034ebd61 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:39.189699 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844d955-0001-49e7-a323-d92c034ebd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:39.190437 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844d955-0001-49e7-a323-d92c034ebd61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:39.191527 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e844d955-0001-49e7-a323-d92c034ebd61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:39.200388 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e844d955-0001-49e7-a323-d92c034ebd61 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:39.238952 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f384c86-69fe-47dd-a5ec-23b157825ada admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:39.250663 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 927/1831] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:39.254327 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f384c86-69fe-47dd-a5ec-23b157825ada admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:39.275014 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b0f3e-7b1c-4dd9-a644-22b656fb454d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:39.276126 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b0f3e-7b1c-4dd9-a644-22b656fb454d admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:39.276294 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b0f3e-7b1c-4dd9-a644-22b656fb454d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:39.276581 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b0f3e-7b1c-4dd9-a644-22b656fb454d admin admin] PATH_INFO: `/v3/projects/b822a91c7d1d4bf79e0fa6bee1ae4bda/users/9944b3d82f2c42eb8c1388f09fd95471/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:39.292866 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844d955-0001-49e7-a323-d92c034ebd61 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:39.294784 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e844d955-0001-49e7-a323-d92c034ebd61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:39.322354 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844d955-0001-49e7-a323-d92c034ebd61 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:39.340209 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8d4ea-34a8-44df-a44a-4652589279d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:39.341369 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8d4ea-34a8-44df-a44a-4652589279d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:39.341657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8d4ea-34a8-44df-a44a-4652589279d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:39.341935 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8d4ea-34a8-44df-a44a-4652589279d4 admin admin] PATH_INFO: `/v3/users/39af713de1bd4560835baa823621f7d0` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:39.343274 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8d4ea-34a8-44df-a44a-4652589279d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39af713de1bd4560835baa823621f7d0)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:39.345521 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8d4ea-34a8-44df-a44a-4652589279d4 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:39.348145 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b0f3e-7b1c-4dd9-a644-22b656fb454d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b822a91c7d1d4bf79e0fa6bee1ae4bda, user_id=9944b3d82f2c42eb8c1388f09fd95471, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:39.357659 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b0f3e-7b1c-4dd9-a644-22b656fb454d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:39.414762 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:39.416067 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 905/1832] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:39 2022] PUT /identity/v3/projects/b822a91c7d1d4bf79e0fa6bee1ae4bda/users/9944b3d82f2c42eb8c1388f09fd95471/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 04:11:39.421482 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29dbd48-752f-495d-8567-acc3ab028038 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:39.422600 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29dbd48-752f-495d-8567-acc3ab028038 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:39.422921 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29dbd48-752f-495d-8567-acc3ab028038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:39.501190 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e6f8d4ea-34a8-44df-a44a-4652589279d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39af713de1bd4560835baa823621f7d0'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:39.503782 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-a29dbd48-752f-495d-8567-acc3ab028038 None None] MFA Rules not processed for user `b36a8402144c458fa98f80d7e3516127`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:39.505083 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a29dbd48-752f-495d-8567-acc3ab028038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:39.524815 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e6f8d4ea-34a8-44df-a44a-4652589279d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39af713de1bd4560835baa823621f7d0'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:39.524815 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e6f8d4ea-34a8-44df-a44a-4652589279d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39af713de1bd4560835baa823621f7d0'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:39.532878 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:39.559707 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e6f8d4ea-34a8-44df-a44a-4652589279d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39af713de1bd4560835baa823621f7d0'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:39.562677 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e6f8d4ea-34a8-44df-a44a-4652589279d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39af713de1bd4560835baa823621f7d0'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:39.644345 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 928/1833] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:11:39 2022] DELETE /identity/v3/users/39af713de1bd4560835baa823621f7d0 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:39.645397 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8d4ea-34a8-44df-a44a-4652589279d4 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:39.664959 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e6f8d4ea-34a8-44df-a44a-4652589279d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:39.699400 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 906/1834] 10.222.0.43 () {58 vars in 1015 bytes} [Mon Jul 4 04:11:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:39.701314 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4fc366-7ab4-4886-9760-a52ea456203f None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:39.701616 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4fc366-7ab4-4886-9760-a52ea456203f None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:39.701907 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4fc366-7ab4-4886-9760-a52ea456203f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:39.755312 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-5f4fc366-7ab4-4886-9760-a52ea456203f None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:39.758600 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5f4fc366-7ab4-4886-9760-a52ea456203f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:39.852644 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8d4ea-34a8-44df-a44a-4652589279d4 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:39.868737 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71225329-b9bc-4637-a1a8-0f4738a7c748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:39.869523 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71225329-b9bc-4637-a1a8-0f4738a7c748 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:39.869862 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71225329-b9bc-4637-a1a8-0f4738a7c748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:39.870231 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71225329-b9bc-4637-a1a8-0f4738a7c748 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:39.871026 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71225329-b9bc-4637-a1a8-0f4738a7c748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:39.873335 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71225329-b9bc-4637-a1a8-0f4738a7c748 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:39.921473 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 929/1835] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:39.922641 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71225329-b9bc-4637-a1a8-0f4738a7c748 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:39.939512 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-71225329-b9bc-4637-a1a8-0f4738a7c748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:39.975649 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71225329-b9bc-4637-a1a8-0f4738a7c748 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:39.996219 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ed829-6b3f-4abc-a387-e08ecd9d2509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:39.997279 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ed829-6b3f-4abc-a387-e08ecd9d2509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:39.997563 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ed829-6b3f-4abc-a387-e08ecd9d2509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:39.997875 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ed829-6b3f-4abc-a387-e08ecd9d2509 admin admin] PATH_INFO: `/v3/users/a0e05332116d4be4bc197d3f2cac074e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:40.007335 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ed829-6b3f-4abc-a387-e08ecd9d2509 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0e05332116d4be4bc197d3f2cac074e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:40.009611 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ed829-6b3f-4abc-a387-e08ecd9d2509 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:40.195530 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7f9ed829-6b3f-4abc-a387-e08ecd9d2509 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0e05332116d4be4bc197d3f2cac074e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:40.221815 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7f9ed829-6b3f-4abc-a387-e08ecd9d2509 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0e05332116d4be4bc197d3f2cac074e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:40.222715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7f9ed829-6b3f-4abc-a387-e08ecd9d2509 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0e05332116d4be4bc197d3f2cac074e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:40.265785 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7f9ed829-6b3f-4abc-a387-e08ecd9d2509 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0e05332116d4be4bc197d3f2cac074e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:40.267880 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7f9ed829-6b3f-4abc-a387-e08ecd9d2509 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0e05332116d4be4bc197d3f2cac074e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:40.336905 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 930/1836] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:11:39 2022] DELETE /identity/v3/users/a0e05332116d4be4bc197d3f2cac074e => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:40.342055 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ed829-6b3f-4abc-a387-e08ecd9d2509 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:40.346749 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7f9ed829-6b3f-4abc-a387-e08ecd9d2509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:40.385571 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:40.393551 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 907/1837] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 693 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:40.395565 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4fc366-7ab4-4886-9760-a52ea456203f None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:40.403446 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5f4fc366-7ab4-4886-9760-a52ea456203f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:40.426253 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4fc366-7ab4-4886-9760-a52ea456203f None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:40.515141 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c372c04-6193-40ae-98c6-392ff999f0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:40.517348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c372c04-6193-40ae-98c6-392ff999f0c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:40.518116 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c372c04-6193-40ae-98c6-392ff999f0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:40.519444 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c372c04-6193-40ae-98c6-392ff999f0c0 admin admin] PATH_INFO: `/v3/projects/b822a91c7d1d4bf79e0fa6bee1ae4bda/users/9944b3d82f2c42eb8c1388f09fd95471/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:40.526868 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c372c04-6193-40ae-98c6-392ff999f0c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b822a91c7d1d4bf79e0fa6bee1ae4bda, user_id=9944b3d82f2c42eb8c1388f09fd95471, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:40.557749 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c372c04-6193-40ae-98c6-392ff999f0c0 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:40.582437 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ed829-6b3f-4abc-a387-e08ecd9d2509 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:40.586242 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 908/1838] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:40 2022] PUT /identity/v3/projects/b822a91c7d1d4bf79e0fa6bee1ae4bda/users/9944b3d82f2c42eb8c1388f09fd95471/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:40.587318 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c372c04-6193-40ae-98c6-392ff999f0c0 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:40.599518 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5c372c04-6193-40ae-98c6-392ff999f0c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:40.778445 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c372c04-6193-40ae-98c6-392ff999f0c0 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:40.793478 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fcb2c2-8446-49fa-adae-d5d2f82bbd23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:40.794030 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcb2c2-8446-49fa-adae-d5d2f82bbd23 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:40.794664 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcb2c2-8446-49fa-adae-d5d2f82bbd23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:40.794664 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcb2c2-8446-49fa-adae-d5d2f82bbd23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:40.796583 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d8fcb2c2-8446-49fa-adae-d5d2f82bbd23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:40.801656 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a932b5-006b-49fc-99f5-1d9235b19785 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:40.803371 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a932b5-006b-49fc-99f5-1d9235b19785 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:40.803664 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a932b5-006b-49fc-99f5-1d9235b19785 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:40.806410 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a932b5-006b-49fc-99f5-1d9235b19785 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:40.820120 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:40.825117 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fcb2c2-8446-49fa-adae-d5d2f82bbd23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:40.826735 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fcb2c2-8446-49fa-adae-d5d2f82bbd23 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:40.843323 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a932b5-006b-49fc-99f5-1d9235b19785 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:40.863065 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a932b5-006b-49fc-99f5-1d9235b19785 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:40.880600 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 931/1839] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:40.881984 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c51d0-dc92-40bd-a058-96bb8aa81c9f None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:40.882308 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c51d0-dc92-40bd-a058-96bb8aa81c9f None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:40.882635 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c51d0-dc92-40bd-a058-96bb8aa81c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:40.895957 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 909/1840] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:40.896739 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fcb2c2-8446-49fa-adae-d5d2f82bbd23 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:40.933860 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fcb2c2-8446-49fa-adae-d5d2f82bbd23 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:40.934632 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-1d3c51d0-dc92-40bd-a058-96bb8aa81c9f None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:40.936069 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1d3c51d0-dc92-40bd-a058-96bb8aa81c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:40.952637 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a8a89-d9d7-4aa5-a94a-4f3861b1e771 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:40.954696 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a8a89-d9d7-4aa5-a94a-4f3861b1e771 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:40.954999 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a8a89-d9d7-4aa5-a94a-4f3861b1e771 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:40.955289 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a8a89-d9d7-4aa5-a94a-4f3861b1e771 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:41.169029 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a8a89-d9d7-4aa5-a94a-4f3861b1e771 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:41.170827 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a8a89-d9d7-4aa5-a94a-4f3861b1e771 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:41.196850 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 932/1841] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:41.202237 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef951875-ba3f-4731-829e-fbb25f5725a4 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:41.202536 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef951875-ba3f-4731-829e-fbb25f5725a4 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:41.205819 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 910/1842] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:41.206605 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef951875-ba3f-4731-829e-fbb25f5725a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:41.273698 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ef951875-ba3f-4731-829e-fbb25f5725a4 None None] MFA Rules not processed for user `9944b3d82f2c42eb8c1388f09fd95471`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:41.275160 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ef951875-ba3f-4731-829e-fbb25f5725a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:41.317793 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a8a89-d9d7-4aa5-a94a-4f3861b1e771 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:41.339019 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a8a89-d9d7-4aa5-a94a-4f3861b1e771 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:41.344807 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3517cc59-e7f0-4383-a096-08ebe16a39c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:41.345698 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517cc59-e7f0-4383-a096-08ebe16a39c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:41.345994 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517cc59-e7f0-4383-a096-08ebe16a39c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:41.346555 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517cc59-e7f0-4383-a096-08ebe16a39c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:41.362633 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3517cc59-e7f0-4383-a096-08ebe16a39c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:41.365437 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3517cc59-e7f0-4383-a096-08ebe16a39c2 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:41.378064 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 911/1843] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 04:11:41.408427 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:41.438535 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 933/1844] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:41 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:41.452258 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3517cc59-e7f0-4383-a096-08ebe16a39c2 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:41.455394 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3517cc59-e7f0-4383-a096-08ebe16a39c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:41.577017 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3517cc59-e7f0-4383-a096-08ebe16a39c2 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:41.584191 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29dc92d-ade8-43f2-aa21-7e08d190a0f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:41.586359 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29dc92d-ade8-43f2-aa21-7e08d190a0f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:41.586932 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29dc92d-ade8-43f2-aa21-7e08d190a0f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:41.587412 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29dc92d-ade8-43f2-aa21-7e08d190a0f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:41.604287 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29dc92d-ade8-43f2-aa21-7e08d190a0f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:41.607472 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29dc92d-ade8-43f2-aa21-7e08d190a0f6 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:41.630802 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 912/1845] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:41 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:41.814409 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef951875-ba3f-4731-829e-fbb25f5725a4 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:41.836356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef951875-ba3f-4731-829e-fbb25f5725a4 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:41.853741 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17e84c-fad0-42b7-b5e6-ea7a542c704a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:41.855039 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17e84c-fad0-42b7-b5e6-ea7a542c704a service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:41.855550 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17e84c-fad0-42b7-b5e6-ea7a542c704a service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:41.856038 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17e84c-fad0-42b7-b5e6-ea7a542c704a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:41.870871 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-af17e84c-fad0-42b7-b5e6-ea7a542c704a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:42.029677 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17e84c-fad0-42b7-b5e6-ea7a542c704a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:42.031292 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17e84c-fad0-42b7-b5e6-ea7a542c704a service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:42.052522 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 934/1846] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:41 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:44.312806 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29dc92d-ade8-43f2-aa21-7e08d190a0f6 service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:44.315097 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c29dc92d-ade8-43f2-aa21-7e08d190a0f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:44.363456 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29dc92d-ade8-43f2-aa21-7e08d190a0f6 service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:44.403304 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311fcc9a-a555-4daf-986f-e4f8b6eda49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:44.414030 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fcc9a-a555-4daf-986f-e4f8b6eda49d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:44.414359 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fcc9a-a555-4daf-986f-e4f8b6eda49d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:44.418694 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fcc9a-a555-4daf-986f-e4f8b6eda49d admin admin] PATH_INFO: `/v3/projects/6314928707334e5ca2b7aa38faf52d4a` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:44.427481 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311fcc9a-a555-4daf-986f-e4f8b6eda49d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6314928707334e5ca2b7aa38faf52d4a)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:44.438481 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311fcc9a-a555-4daf-986f-e4f8b6eda49d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:44.653045 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-311fcc9a-a555-4daf-986f-e4f8b6eda49d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6314928707334e5ca2b7aa38faf52d4a', 'request_id': 'req-311fcc9a-a555-4daf-986f-e4f8b6eda49d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:44.675293 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-311fcc9a-a555-4daf-986f-e4f8b6eda49d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6314928707334e5ca2b7aa38faf52d4a', 'request_id': 'req-311fcc9a-a555-4daf-986f-e4f8b6eda49d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:44.711172 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-311fcc9a-a555-4daf-986f-e4f8b6eda49d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6314928707334e5ca2b7aa38faf52d4a', 'request_id': 'req-311fcc9a-a555-4daf-986f-e4f8b6eda49d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:44.752954 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-311fcc9a-a555-4daf-986f-e4f8b6eda49d admin admin] The token cache is being invalidate because project 6314928707334e5ca2b7aa38faf52d4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:11:44.757357 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-311fcc9a-a555-4daf-986f-e4f8b6eda49d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:44.759417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-311fcc9a-a555-4daf-986f-e4f8b6eda49d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:44.765514 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 913/1847] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:11:44 2022] DELETE /identity/v3/projects/6314928707334e5ca2b7aa38faf52d4a => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:44.766251 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17e84c-fad0-42b7-b5e6-ea7a542c704a service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:44.788649 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17e84c-fad0-42b7-b5e6-ea7a542c704a service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:44.919202 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61067ba3-4016-4404-b1ac-4301d2854da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:44.920242 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61067ba3-4016-4404-b1ac-4301d2854da8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:44.920595 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61067ba3-4016-4404-b1ac-4301d2854da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:44.921421 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61067ba3-4016-4404-b1ac-4301d2854da8 admin admin] PATH_INFO: `/v3/users/1ab8c6f70d714fd79b752eef20488b20` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:44.922386 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61067ba3-4016-4404-b1ac-4301d2854da8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ab8c6f70d714fd79b752eef20488b20)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:44.924727 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61067ba3-4016-4404-b1ac-4301d2854da8 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:45.059350 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-61067ba3-4016-4404-b1ac-4301d2854da8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ab8c6f70d714fd79b752eef20488b20'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:45.073831 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-61067ba3-4016-4404-b1ac-4301d2854da8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ab8c6f70d714fd79b752eef20488b20'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:45.074626 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-61067ba3-4016-4404-b1ac-4301d2854da8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ab8c6f70d714fd79b752eef20488b20'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:45.105712 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-61067ba3-4016-4404-b1ac-4301d2854da8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ab8c6f70d714fd79b752eef20488b20'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:45.108971 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-61067ba3-4016-4404-b1ac-4301d2854da8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ab8c6f70d714fd79b752eef20488b20'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:45.141997 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 935/1848] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:11:44 2022] DELETE /identity/v3/users/1ab8c6f70d714fd79b752eef20488b20 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 04:11:45.195374 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d4cc6-dbed-43e8-9737-44472bc0198b None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:45.195374 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d4cc6-dbed-43e8-9737-44472bc0198b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:45.198607 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d4cc6-dbed-43e8-9737-44472bc0198b None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:45.200274 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 914/1849] 10.222.0.49 () {54 vars in 921 bytes} [Mon Jul 4 04:11:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:11:45.260802 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff6bc7-64fc-4239-96c4-1b34fc11311f None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:45.261029 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff6bc7-64fc-4239-96c4-1b34fc11311f None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:45.261423 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff6bc7-64fc-4239-96c4-1b34fc11311f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:45.305543 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-5cff6bc7-64fc-4239-96c4-1b34fc11311f None None] MFA Rules not processed for user `8334e75253f843a980b01c6f0cda6015`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:45.310469 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-5cff6bc7-64fc-4239-96c4-1b34fc11311f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:45.328719 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:45.463100 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d4cc6-dbed-43e8-9737-44472bc0198b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:45.466002 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-562d4cc6-dbed-43e8-9737-44472bc0198b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:45.473967 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:45.517663 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 936/1850] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Jul 4 04:11:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:45.667477 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d4cc6-dbed-43e8-9737-44472bc0198b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:45.673365 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e934c-ad7c-4e91-b4b8-036b137433a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:45.674447 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e934c-ad7c-4e91-b4b8-036b137433a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:45.674910 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e934c-ad7c-4e91-b4b8-036b137433a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:45.675195 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e934c-ad7c-4e91-b4b8-036b137433a2 admin admin] PATH_INFO: `/v3/projects/f5414156f823452b8e82c3f233551ee5` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:45.677595 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e934c-ad7c-4e91-b4b8-036b137433a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5414156f823452b8e82c3f233551ee5)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:45.680325 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e934c-ad7c-4e91-b4b8-036b137433a2 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:45.771848 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c01e934c-ad7c-4e91-b4b8-036b137433a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5414156f823452b8e82c3f233551ee5', 'request_id': 'req-c01e934c-ad7c-4e91-b4b8-036b137433a2'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:45.779430 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c01e934c-ad7c-4e91-b4b8-036b137433a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5414156f823452b8e82c3f233551ee5', 'request_id': 'req-c01e934c-ad7c-4e91-b4b8-036b137433a2'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:45.787925 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c01e934c-ad7c-4e91-b4b8-036b137433a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5414156f823452b8e82c3f233551ee5', 'request_id': 'req-c01e934c-ad7c-4e91-b4b8-036b137433a2'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:45.823160 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c01e934c-ad7c-4e91-b4b8-036b137433a2 admin admin] The token cache is being invalidate because project f5414156f823452b8e82c3f233551ee5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:11:45.823506 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c01e934c-ad7c-4e91-b4b8-036b137433a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:45.830876 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c01e934c-ad7c-4e91-b4b8-036b137433a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:45.837694 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 915/1851] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:11:45 2022] DELETE /identity/v3/projects/f5414156f823452b8e82c3f233551ee5 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 04:11:45.842341 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff6bc7-64fc-4239-96c4-1b34fc11311f None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:45.864600 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b700d-4dd4-4a2f-b84b-71168d756570 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:45.864909 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b700d-4dd4-4a2f-b84b-71168d756570 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:45.865202 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b700d-4dd4-4a2f-b84b-71168d756570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:45.882374 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff6bc7-64fc-4239-96c4-1b34fc11311f None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:45.995673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-167b700d-4dd4-4a2f-b84b-71168d756570 None None] MFA Rules not processed for user `bdbd4d8876ae4adbaca6bf975cf16521`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:45.999330 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-167b700d-4dd4-4a2f-b84b-71168d756570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:46.116225 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d5d10-28e9-46b1-a04b-6b9f7385001a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:46.117260 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d5d10-28e9-46b1-a04b-6b9f7385001a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:46.117948 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d5d10-28e9-46b1-a04b-6b9f7385001a admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:46.118365 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d5d10-28e9-46b1-a04b-6b9f7385001a admin admin] PATH_INFO: `/v3/users/c0f4af5a531c4520b031172545ab8392` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:46.121122 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d5d10-28e9-46b1-a04b-6b9f7385001a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0f4af5a531c4520b031172545ab8392)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:46.126105 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d5d10-28e9-46b1-a04b-6b9f7385001a admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:46.284344 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-367d5d10-28e9-46b1-a04b-6b9f7385001a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0f4af5a531c4520b031172545ab8392'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:46.301404 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-367d5d10-28e9-46b1-a04b-6b9f7385001a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0f4af5a531c4520b031172545ab8392'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:46.303739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-367d5d10-28e9-46b1-a04b-6b9f7385001a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0f4af5a531c4520b031172545ab8392'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:46.341328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 916/1852] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:45 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 484 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:46.380480 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-367d5d10-28e9-46b1-a04b-6b9f7385001a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0f4af5a531c4520b031172545ab8392'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:46.382105 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-367d5d10-28e9-46b1-a04b-6b9f7385001a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0f4af5a531c4520b031172545ab8392'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:46.441098 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 937/1853] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:11:45 2022] DELETE /identity/v3/users/c0f4af5a531c4520b031172545ab8392 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:46.472298 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10bdb0a-c107-4ea3-b89f-33b7d992be54 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:46.472915 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10bdb0a-c107-4ea3-b89f-33b7d992be54 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:46.472915 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10bdb0a-c107-4ea3-b89f-33b7d992be54 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:46.475078 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 917/1854] 10.222.0.49 () {54 vars in 921 bytes} [Mon Jul 4 04:11:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:11:46.768867 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c6348-c327-47c7-84ab-a0e23c48f13b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:46.769292 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c6348-c327-47c7-84ab-a0e23c48f13b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:46.769467 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c6348-c327-47c7-84ab-a0e23c48f13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:46.802335 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-f28c6348-c327-47c7-84ab-a0e23c48f13b None None] MFA Rules not processed for user `8334e75253f843a980b01c6f0cda6015`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:46.803598 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f28c6348-c327-47c7-84ab-a0e23c48f13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:46.841528 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:46.991841 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 938/1855] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Jul 4 04:11:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:11:47.255247 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10bdb0a-c107-4ea3-b89f-33b7d992be54 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:47.258846 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d10bdb0a-c107-4ea3-b89f-33b7d992be54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:47.298654 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10bdb0a-c107-4ea3-b89f-33b7d992be54 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:47.311701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062c460-75f8-4134-b35f-23698ad83289 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:47.312450 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062c460-75f8-4134-b35f-23698ad83289 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:47.312833 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062c460-75f8-4134-b35f-23698ad83289 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:47.313010 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062c460-75f8-4134-b35f-23698ad83289 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:47.322243 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4062c460-75f8-4134-b35f-23698ad83289 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:47.348419 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062c460-75f8-4134-b35f-23698ad83289 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:47.350375 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062c460-75f8-4134-b35f-23698ad83289 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:47.385084 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 918/1856] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:47.804466 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c6348-c327-47c7-84ab-a0e23c48f13b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:47.806794 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f28c6348-c327-47c7-84ab-a0e23c48f13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:47.811478 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062c460-75f8-4134-b35f-23698ad83289 service nova] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:47.813077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4062c460-75f8-4134-b35f-23698ad83289 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:47.824289 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:48.049773 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c6348-c327-47c7-84ab-a0e23c48f13b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:48.070288 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2d310-e4ba-499f-99ac-b4e8c67b2bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:48.071683 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2d310-e4ba-499f-99ac-b4e8c67b2bfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:48.073555 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2d310-e4ba-499f-99ac-b4e8c67b2bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:48.086768 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2d310-e4ba-499f-99ac-b4e8c67b2bfb admin admin] PATH_INFO: `/v3/projects/93b5180b61e7438cb26c3cb66b223bbd` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:48.088659 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2d310-e4ba-499f-99ac-b4e8c67b2bfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=93b5180b61e7438cb26c3cb66b223bbd)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:48.090925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2d310-e4ba-499f-99ac-b4e8c67b2bfb admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:48.155958 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062c460-75f8-4134-b35f-23698ad83289 service nova] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:48.169469 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b76cf8-830d-4aa9-9cbf-e3411fc888b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:48.171362 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b76cf8-830d-4aa9-9cbf-e3411fc888b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:48.171668 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b76cf8-830d-4aa9-9cbf-e3411fc888b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:48.172029 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b76cf8-830d-4aa9-9cbf-e3411fc888b8 admin admin] PATH_INFO: `/v3/users/db0d39764f074ad2b759848d0e3ab25f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:48.173834 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b76cf8-830d-4aa9-9cbf-e3411fc888b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db0d39764f074ad2b759848d0e3ab25f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:48.176774 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b76cf8-830d-4aa9-9cbf-e3411fc888b8 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:48.222056 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6bd2d310-e4ba-499f-99ac-b4e8c67b2bfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93b5180b61e7438cb26c3cb66b223bbd', 'request_id': 'req-6bd2d310-e4ba-499f-99ac-b4e8c67b2bfb'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:48.232138 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6bd2d310-e4ba-499f-99ac-b4e8c67b2bfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93b5180b61e7438cb26c3cb66b223bbd', 'request_id': 'req-6bd2d310-e4ba-499f-99ac-b4e8c67b2bfb'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:48.253516 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6bd2d310-e4ba-499f-99ac-b4e8c67b2bfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93b5180b61e7438cb26c3cb66b223bbd', 'request_id': 'req-6bd2d310-e4ba-499f-99ac-b4e8c67b2bfb'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:48.290939 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6bd2d310-e4ba-499f-99ac-b4e8c67b2bfb admin admin] The token cache is being invalidate because project 93b5180b61e7438cb26c3cb66b223bbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:11:48.291251 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6bd2d310-e4ba-499f-99ac-b4e8c67b2bfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:48.292287 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6bd2d310-e4ba-499f-99ac-b4e8c67b2bfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:48.295331 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 939/1857] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:11:47 2022] DELETE /identity/v3/projects/93b5180b61e7438cb26c3cb66b223bbd => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:48.296932 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2d310-e4ba-499f-99ac-b4e8c67b2bfb admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:48.300523 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6bd2d310-e4ba-499f-99ac-b4e8c67b2bfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:48.328207 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-55b76cf8-830d-4aa9-9cbf-e3411fc888b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db0d39764f074ad2b759848d0e3ab25f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:48.330559 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-55b76cf8-830d-4aa9-9cbf-e3411fc888b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db0d39764f074ad2b759848d0e3ab25f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:48.351524 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-55b76cf8-830d-4aa9-9cbf-e3411fc888b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db0d39764f074ad2b759848d0e3ab25f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:48.376905 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:48.401025 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-55b76cf8-830d-4aa9-9cbf-e3411fc888b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db0d39764f074ad2b759848d0e3ab25f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:48.403391 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-55b76cf8-830d-4aa9-9cbf-e3411fc888b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db0d39764f074ad2b759848d0e3ab25f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:48.435942 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 919/1858] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:11:47 2022] DELETE /identity/v3/users/db0d39764f074ad2b759848d0e3ab25f => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 04:11:48.437241 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb9838-9500-43e9-83bd-4238829d3baa None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:48.437538 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb9838-9500-43e9-83bd-4238829d3baa None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:48.437821 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb9838-9500-43e9-83bd-4238829d3baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:48.443584 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2d310-e4ba-499f-99ac-b4e8c67b2bfb admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:48.482551 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-9adb9838-9500-43e9-83bd-4238829d3baa None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:48.484995 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9adb9838-9500-43e9-83bd-4238829d3baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:48.548437 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c020b-f42f-493b-b3d0-fa15e8492014 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:48.549249 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c020b-f42f-493b-b3d0-fa15e8492014 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:48.549539 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c020b-f42f-493b-b3d0-fa15e8492014 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:48.550223 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c020b-f42f-493b-b3d0-fa15e8492014 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:48.552375 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-893c020b-f42f-493b-b3d0-fa15e8492014 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:48.570785 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c020b-f42f-493b-b3d0-fa15e8492014 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:48.574417 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c020b-f42f-493b-b3d0-fa15e8492014 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:48.593140 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 940/1859] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:48.594963 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f63fb4-19fa-4c4c-923c-24af3476c836 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:48.595266 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f63fb4-19fa-4c4c-923c-24af3476c836 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:48.596544 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f63fb4-19fa-4c4c-923c-24af3476c836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:48.617713 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 920/1860] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:48.620062 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc97b2-350d-4d03-aa99-aead420f983d None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:48.620467 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc97b2-350d-4d03-aa99-aead420f983d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:48.620759 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc97b2-350d-4d03-aa99-aead420f983d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:48.634619 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-43f63fb4-19fa-4c4c-923c-24af3476c836 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:48.638081 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-43f63fb4-19fa-4c4c-923c-24af3476c836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:48.663646 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-abbc97b2-350d-4d03-aa99-aead420f983d None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:48.665171 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-abbc97b2-350d-4d03-aa99-aead420f983d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:48.670386 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 941/1861] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:48.671487 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f63fb4-19fa-4c4c-923c-24af3476c836 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:48.674649 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-43f63fb4-19fa-4c4c-923c-24af3476c836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:48.680251 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 921/1862] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:48.680251 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc97b2-350d-4d03-aa99-aead420f983d None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:48.682184 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-abbc97b2-350d-4d03-aa99-aead420f983d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:48.699770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f63fb4-19fa-4c4c-923c-24af3476c836 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:48.704731 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:48.711391 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7243e2-8f90-4967-983c-f636d96e4eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:48.712294 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7243e2-8f90-4967-983c-f636d96e4eb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:48.712588 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7243e2-8f90-4967-983c-f636d96e4eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:48.712872 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7243e2-8f90-4967-983c-f636d96e4eb1 admin admin] PATH_INFO: `/v3/projects/bdf2575a52724110bc7ee464560336b0` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:48.715407 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7243e2-8f90-4967-983c-f636d96e4eb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdf2575a52724110bc7ee464560336b0)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:48.721858 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7243e2-8f90-4967-983c-f636d96e4eb1 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:48.755933 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc97b2-350d-4d03-aa99-aead420f983d None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:48.763755 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58019a-fc65-4b46-a1fe-cfaa4010e16c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:48.764436 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58019a-fc65-4b46-a1fe-cfaa4010e16c service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:48.764712 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58019a-fc65-4b46-a1fe-cfaa4010e16c service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:48.764991 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58019a-fc65-4b46-a1fe-cfaa4010e16c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:48.781748 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58019a-fc65-4b46-a1fe-cfaa4010e16c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:48.782582 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8f7243e2-8f90-4967-983c-f636d96e4eb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdf2575a52724110bc7ee464560336b0', 'request_id': 'req-8f7243e2-8f90-4967-983c-f636d96e4eb1'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:48.783579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58019a-fc65-4b46-a1fe-cfaa4010e16c service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:48.789693 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8f7243e2-8f90-4967-983c-f636d96e4eb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdf2575a52724110bc7ee464560336b0', 'request_id': 'req-8f7243e2-8f90-4967-983c-f636d96e4eb1'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:48.796167 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8f7243e2-8f90-4967-983c-f636d96e4eb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdf2575a52724110bc7ee464560336b0', 'request_id': 'req-8f7243e2-8f90-4967-983c-f636d96e4eb1'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:48.797136 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 922/1863] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:48.797999 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58019a-fc65-4b46-a1fe-cfaa4010e16c service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:48.809950 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58019a-fc65-4b46-a1fe-cfaa4010e16c service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:48.815739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8f7243e2-8f90-4967-983c-f636d96e4eb1 admin admin] The token cache is being invalidate because project bdf2575a52724110bc7ee464560336b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:11:48.816091 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8f7243e2-8f90-4967-983c-f636d96e4eb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:48.816857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8f7243e2-8f90-4967-983c-f636d96e4eb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:48.823533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 942/1864] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:11:48 2022] DELETE /identity/v3/projects/bdf2575a52724110bc7ee464560336b0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:48.825796 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd445897-684f-4d21-97f8-b4d7d9669593 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:48.826095 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd445897-684f-4d21-97f8-b4d7d9669593 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:48.826651 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd445897-684f-4d21-97f8-b4d7d9669593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:48.851768 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-bd445897-684f-4d21-97f8-b4d7d9669593 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:48.853258 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-bd445897-684f-4d21-97f8-b4d7d9669593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:48.888760 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c09479-42c1-4553-a222-058586910fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:48.890047 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c09479-42c1-4553-a222-058586910fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:48.890379 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c09479-42c1-4553-a222-058586910fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:48.890666 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c09479-42c1-4553-a222-058586910fe3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:48.891622 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c09479-42c1-4553-a222-058586910fe3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:11:48.892014 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c09479-42c1-4553-a222-058586910fe3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:48.893670 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c09479-42c1-4553-a222-058586910fe3 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:48.905209 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:48.907286 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 923/1865] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:11:48.913061 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c09479-42c1-4553-a222-058586910fe3 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:48.917431 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b9c09479-42c1-4553-a222-058586910fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:48.930263 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c09479-42c1-4553-a222-058586910fe3 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:48.942699 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6f877-0b35-4d21-b68e-2513ab6f49fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:48.942699 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6f877-0b35-4d21-b68e-2513ab6f49fd admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:48.942699 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6f877-0b35-4d21-b68e-2513ab6f49fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:48.942699 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6f877-0b35-4d21-b68e-2513ab6f49fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:48.943122 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc6f877-0b35-4d21-b68e-2513ab6f49fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:48.943122 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc6f877-0b35-4d21-b68e-2513ab6f49fd admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:48.944074 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 943/1866] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:11:48.945927 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f85124-8b1a-4557-95a6-7af75060e9e7 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:48.946410 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f85124-8b1a-4557-95a6-7af75060e9e7 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:48.946848 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f85124-8b1a-4557-95a6-7af75060e9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:48.968312 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-b1f85124-8b1a-4557-95a6-7af75060e9e7 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:48.969477 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b1f85124-8b1a-4557-95a6-7af75060e9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:48.981898 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 944/1867] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:48.988822 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 924/1868] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:11:48 2022] POST /identity/v3/projects => generated 387 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:48.988967 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f85124-8b1a-4557-95a6-7af75060e9e7 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:48.989762 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6f877-0b35-4d21-b68e-2513ab6f49fd admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:48.996612 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f85124-8b1a-4557-95a6-7af75060e9e7 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:49.058417 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8542a-ab24-49a8-b0ca-4daf217042c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:49.059216 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8542a-ab24-49a8-b0ca-4daf217042c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:49.059630 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8542a-ab24-49a8-b0ca-4daf217042c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:49.060414 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8542a-ab24-49a8-b0ca-4daf217042c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:49.060831 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8542a-ab24-49a8-b0ca-4daf217042c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:11:49.061222 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8542a-ab24-49a8-b0ca-4daf217042c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:49.062983 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8542a-ab24-49a8-b0ca-4daf217042c0 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:49.069126 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6f877-0b35-4d21-b68e-2513ab6f49fd admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:49.076590 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73602b7-cf61-488e-9b1f-b3ca6eff15a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:49.077382 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73602b7-cf61-488e-9b1f-b3ca6eff15a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:49.077674 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73602b7-cf61-488e-9b1f-b3ca6eff15a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:49.078125 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73602b7-cf61-488e-9b1f-b3ca6eff15a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:49.079425 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73602b7-cf61-488e-9b1f-b3ca6eff15a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:49.083110 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 945/1869] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:11:49.083236 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73602b7-cf61-488e-9b1f-b3ca6eff15a8 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:49.084117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8542a-ab24-49a8-b0ca-4daf217042c0 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:49.095918 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8542a-ab24-49a8-b0ca-4daf217042c0 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:49.102197 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4dac59-75fc-40b9-a194-837b226d6c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:49.103052 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4dac59-75fc-40b9-a194-837b226d6c57 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:49.103226 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4dac59-75fc-40b9-a194-837b226d6c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:49.103515 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4dac59-75fc-40b9-a194-837b226d6c57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:49.104254 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4dac59-75fc-40b9-a194-837b226d6c57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:49.109809 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 925/1870] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:11:48 2022] POST /identity/v3/users => generated 294 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:49.110007 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4dac59-75fc-40b9-a194-837b226d6c57 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:49.111525 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73602b7-cf61-488e-9b1f-b3ca6eff15a8 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:49.124516 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73602b7-cf61-488e-9b1f-b3ca6eff15a8 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:49.130011 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e0dc9-c54b-4809-9509-47374988d32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:49.130940 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e0dc9-c54b-4809-9509-47374988d32e admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:49.131132 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e0dc9-c54b-4809-9509-47374988d32e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:49.131392 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e0dc9-c54b-4809-9509-47374988d32e admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:49.132169 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e0dc9-c54b-4809-9509-47374988d32e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:49.134280 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e0dc9-c54b-4809-9509-47374988d32e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:49.150596 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 946/1871] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:11:49 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 04:11:49.150821 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 926/1872] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 04:11:49.150924 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4dac59-75fc-40b9-a194-837b226d6c57 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:49.160343 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e0dc9-c54b-4809-9509-47374988d32e admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:49.183500 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e0dc9-c54b-4809-9509-47374988d32e admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:49.198475 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:49.265381 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4dac59-75fc-40b9-a194-837b226d6c57 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:49.273506 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e23e0-602f-45a1-b2e0-ee61495c9895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:49.274283 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbbc18-b195-425a-a788-741a8ad09fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:49.274983 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e23e0-602f-45a1-b2e0-ee61495c9895 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:49.275238 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbbc18-b195-425a-a788-741a8ad09fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:49.275585 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e23e0-602f-45a1-b2e0-ee61495c9895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:49.275796 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbbc18-b195-425a-a788-741a8ad09fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:49.276301 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e23e0-602f-45a1-b2e0-ee61495c9895 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:49.276598 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbbc18-b195-425a-a788-741a8ad09fb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:49.277468 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbbc18-b195-425a-a788-741a8ad09fb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:49.277611 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e23e0-602f-45a1-b2e0-ee61495c9895 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:49.279441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbbc18-b195-425a-a788-741a8ad09fb2 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:49.281341 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e23e0-602f-45a1-b2e0-ee61495c9895 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:49.297900 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 927/1873] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:49.298495 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a9b5c-fea6-49d3-a5f5-ac71759ba3b8 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:49.298934 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a9b5c-fea6-49d3-a5f5-ac71759ba3b8 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:49.299277 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a9b5c-fea6-49d3-a5f5-ac71759ba3b8 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:49.302056 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 928/1874] 10.222.0.49 () {54 vars in 921 bytes} [Mon Jul 4 04:11:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:11:49.303444 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a9b5c-fea6-49d3-a5f5-ac71759ba3b8 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:49.320606 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a9b5c-fea6-49d3-a5f5-ac71759ba3b8 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:49.323762 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 947/1875] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:11:49 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:49.325554 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb164f15-0348-4d2a-9555-d1190895f528 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:49.326054 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb164f15-0348-4d2a-9555-d1190895f528 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:49.326651 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb164f15-0348-4d2a-9555-d1190895f528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:49.330505 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf456e6-4fce-4e22-a3ce-afdb9ace72fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:49.331466 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf456e6-4fce-4e22-a3ce-afdb9ace72fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:49.331729 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf456e6-4fce-4e22-a3ce-afdb9ace72fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:49.332000 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf456e6-4fce-4e22-a3ce-afdb9ace72fa admin admin] PATH_INFO: `/v3/projects/240fe43004674c8a850b9ae2cc87eff8/users/cf8f1c6347fb4dd392382baf6d69d01f/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:49.353611 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf456e6-4fce-4e22-a3ce-afdb9ace72fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=240fe43004674c8a850b9ae2cc87eff8, user_id=cf8f1c6347fb4dd392382baf6d69d01f, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:49.362042 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-fb164f15-0348-4d2a-9555-d1190895f528 None None] MFA Rules not processed for user `c2a18591461343c3a0a1b0e317734ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:49.362457 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf456e6-4fce-4e22-a3ce-afdb9ace72fa admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:49.364136 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-fb164f15-0348-4d2a-9555-d1190895f528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:49.384032 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 929/1876] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:49 2022] PUT /identity/v3/projects/240fe43004674c8a850b9ae2cc87eff8/users/cf8f1c6347fb4dd392382baf6d69d01f/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:49.385091 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf456e6-4fce-4e22-a3ce-afdb9ace72fa admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:49.433043 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:49.483298 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf456e6-4fce-4e22-a3ce-afdb9ace72fa admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:49.494366 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f46e33-936c-4872-afb2-705e330d7a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:49.497088 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f46e33-936c-4872-afb2-705e330d7a1b admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:49.497586 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f46e33-936c-4872-afb2-705e330d7a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:49.497939 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f46e33-936c-4872-afb2-705e330d7a1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:49.498816 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f46e33-936c-4872-afb2-705e330d7a1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:49.501015 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f46e33-936c-4872-afb2-705e330d7a1b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:49.501456 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 948/1877] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Jul 4 04:11:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:49.502887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667ea94-f08f-48eb-9f16-d00160ba6f49 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:49.503185 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667ea94-f08f-48eb-9f16-d00160ba6f49 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:49.503467 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667ea94-f08f-48eb-9f16-d00160ba6f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:49.515736 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 930/1878] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:49.521749 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f46e33-936c-4872-afb2-705e330d7a1b admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:49.540547 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f46e33-936c-4872-afb2-705e330d7a1b admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:49.546540 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4188d5-d3e8-471b-91d1-dce9edc4b18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:49.547236 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4188d5-d3e8-471b-91d1-dce9edc4b18c admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:49.547526 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4188d5-d3e8-471b-91d1-dce9edc4b18c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:49.547813 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4188d5-d3e8-471b-91d1-dce9edc4b18c admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:49.548562 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4188d5-d3e8-471b-91d1-dce9edc4b18c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:49.550711 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4188d5-d3e8-471b-91d1-dce9edc4b18c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:49.558861 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-3667ea94-f08f-48eb-9f16-d00160ba6f49 None None] MFA Rules not processed for user `cf8f1c6347fb4dd392382baf6d69d01f`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:49.560125 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3667ea94-f08f-48eb-9f16-d00160ba6f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:49.567301 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 931/1879] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:49.568277 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4188d5-d3e8-471b-91d1-dce9edc4b18c admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:49.571105 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ec4188d5-d3e8-471b-91d1-dce9edc4b18c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:49.682660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 949/1880] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:49.683556 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667ea94-f08f-48eb-9f16-d00160ba6f49 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:49.713166 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667ea94-f08f-48eb-9f16-d00160ba6f49 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:49.727350 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87c15d-d1bd-4b38-8891-1a7d718833aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:49.729818 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87c15d-d1bd-4b38-8891-1a7d718833aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:49.730104 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87c15d-d1bd-4b38-8891-1a7d718833aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:49.732768 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87c15d-d1bd-4b38-8891-1a7d718833aa admin admin] PATH_INFO: `/v3/projects/13b111b739954a00bc3b530946517742/users/77ab88ca47174b3ba6f8e2ecd0bca95c/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:49.739309 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4188d5-d3e8-471b-91d1-dce9edc4b18c admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:49.748919 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9afad-6d6f-4522-8043-4dc539a72720 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a18591461343c3a0a1b0e317734ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:49.749598 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9afad-6d6f-4522-8043-4dc539a72720 service placement] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:49.749888 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9afad-6d6f-4522-8043-4dc539a72720 service placement] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:49.750279 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9afad-6d6f-4522-8043-4dc539a72720 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:49.760364 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9afad-6d6f-4522-8043-4dc539a72720 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:49.761926 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b87c15d-d1bd-4b38-8891-1a7d718833aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=13b111b739954a00bc3b530946517742, user_id=77ab88ca47174b3ba6f8e2ecd0bca95c, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:49.762190 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9afad-6d6f-4522-8043-4dc539a72720 service placement] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:49.764824 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b87c15d-d1bd-4b38-8891-1a7d718833aa admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:49.766947 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:49.775935 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 932/1881] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:49.777407 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9afad-6d6f-4522-8043-4dc539a72720 service placement] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:49.783157 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 950/1882] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:49 2022] PUT /identity/v3/projects/13b111b739954a00bc3b530946517742/users/77ab88ca47174b3ba6f8e2ecd0bca95c/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:49.784367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87c15d-d1bd-4b38-8891-1a7d718833aa admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:49.785921 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5dd9afad-6d6f-4522-8043-4dc539a72720 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:49.811284 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9afad-6d6f-4522-8043-4dc539a72720 service placement] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:49.875801 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87c15d-d1bd-4b38-8891-1a7d718833aa admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:49.884579 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb39e0a-8395-4e44-949d-01c44e04e3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:49.885414 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb39e0a-8395-4e44-949d-01c44e04e3da admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:49.885709 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb39e0a-8395-4e44-949d-01c44e04e3da admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:49.885996 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb39e0a-8395-4e44-949d-01c44e04e3da admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:49.886091 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d961d12-170b-4a98-869f-4ead1255311b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:49.886880 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb39e0a-8395-4e44-949d-01c44e04e3da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:49.887464 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d961d12-170b-4a98-869f-4ead1255311b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:49.888094 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d961d12-170b-4a98-869f-4ead1255311b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:49.888420 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d961d12-170b-4a98-869f-4ead1255311b admin admin] PATH_INFO: `/v3/projects/2aeadd97e6514844b867b4cec569b9d9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:49.888858 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb39e0a-8395-4e44-949d-01c44e04e3da admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:49.890183 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d961d12-170b-4a98-869f-4ead1255311b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aeadd97e6514844b867b4cec569b9d9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:49.893110 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d961d12-170b-4a98-869f-4ead1255311b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:49.924853 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 951/1883] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:11:49 2022] POST /identity/v3/projects => generated 387 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:49.926325 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74034a2-fce1-4017-90fd-ab55d239330d None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:49.926325 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74034a2-fce1-4017-90fd-ab55d239330d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:49.926325 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74034a2-fce1-4017-90fd-ab55d239330d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:49.952611 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3d961d12-170b-4a98-869f-4ead1255311b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aeadd97e6514844b867b4cec569b9d9', 'request_id': 'req-3d961d12-170b-4a98-869f-4ead1255311b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:49.954866 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-e74034a2-fce1-4017-90fd-ab55d239330d None None] MFA Rules not processed for user `77ab88ca47174b3ba6f8e2ecd0bca95c`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:49.956194 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e74034a2-fce1-4017-90fd-ab55d239330d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:49.959415 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3d961d12-170b-4a98-869f-4ead1255311b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aeadd97e6514844b867b4cec569b9d9', 'request_id': 'req-3d961d12-170b-4a98-869f-4ead1255311b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:49.975385 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3d961d12-170b-4a98-869f-4ead1255311b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aeadd97e6514844b867b4cec569b9d9', 'request_id': 'req-3d961d12-170b-4a98-869f-4ead1255311b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:49.976791 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:49.999051 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3d961d12-170b-4a98-869f-4ead1255311b admin admin] The token cache is being invalidate because project 2aeadd97e6514844b867b4cec569b9d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:11:49.999051 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3d961d12-170b-4a98-869f-4ead1255311b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:50.000343 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3d961d12-170b-4a98-869f-4ead1255311b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:50.002443 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 933/1884] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:11:49 2022] DELETE /identity/v3/projects/2aeadd97e6514844b867b4cec569b9d9 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:50.003451 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d961d12-170b-4a98-869f-4ead1255311b admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:50.005898 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3d961d12-170b-4a98-869f-4ead1255311b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:50.052351 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 952/1885] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:50.053077 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74034a2-fce1-4017-90fd-ab55d239330d None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:50.054447 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e74034a2-fce1-4017-90fd-ab55d239330d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:50.115670 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d961d12-170b-4a98-869f-4ead1255311b admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:50.121690 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8692de1-88de-4a65-b0b5-5f9255b21918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:50.122128 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8692de1-88de-4a65-b0b5-5f9255b21918 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:50.122444 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8692de1-88de-4a65-b0b5-5f9255b21918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:50.122718 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8692de1-88de-4a65-b0b5-5f9255b21918 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:50.123428 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8692de1-88de-4a65-b0b5-5f9255b21918 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:50.125508 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8692de1-88de-4a65-b0b5-5f9255b21918 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:50.141841 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74034a2-fce1-4017-90fd-ab55d239330d None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:50.147001 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de9520-5a69-4840-b15e-9efb39e7e5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:50.148157 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de9520-5a69-4840-b15e-9efb39e7e5b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:50.148660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de9520-5a69-4840-b15e-9efb39e7e5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:50.149040 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de9520-5a69-4840-b15e-9efb39e7e5b5 admin admin] PATH_INFO: `/v3/users/9944b3d82f2c42eb8c1388f09fd95471` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:50.150948 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de9520-5a69-4840-b15e-9efb39e7e5b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9944b3d82f2c42eb8c1388f09fd95471)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:50.152460 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de9520-5a69-4840-b15e-9efb39e7e5b5 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:50.156389 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 934/1886] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:11:50 2022] POST /identity/v3/users => generated 300 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:50.157036 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8692de1-88de-4a65-b0b5-5f9255b21918 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:50.158789 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a8692de1-88de-4a65-b0b5-5f9255b21918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:50.179009 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8692de1-88de-4a65-b0b5-5f9255b21918 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:50.184367 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7beba-b8c8-4176-a700-8f227a4b287a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:50.185059 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7beba-b8c8-4176-a700-8f227a4b287a admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:50.185347 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7beba-b8c8-4176-a700-8f227a4b287a admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:50.185693 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7beba-b8c8-4176-a700-8f227a4b287a admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:50.186931 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7beba-b8c8-4176-a700-8f227a4b287a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:50.188325 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7beba-b8c8-4176-a700-8f227a4b287a admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:50.209489 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:50.229964 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 935/1887] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:11:50 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:50.229964 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7beba-b8c8-4176-a700-8f227a4b287a admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:50.266643 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-41de9520-5a69-4840-b15e-9efb39e7e5b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9944b3d82f2c42eb8c1388f09fd95471'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:50.278351 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-41de9520-5a69-4840-b15e-9efb39e7e5b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9944b3d82f2c42eb8c1388f09fd95471'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:50.279504 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-41de9520-5a69-4840-b15e-9efb39e7e5b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9944b3d82f2c42eb8c1388f09fd95471'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:50.292935 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-41de9520-5a69-4840-b15e-9efb39e7e5b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9944b3d82f2c42eb8c1388f09fd95471'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:50.294339 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-41de9520-5a69-4840-b15e-9efb39e7e5b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9944b3d82f2c42eb8c1388f09fd95471'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:50.310136 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 953/1888] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:11:50 2022] DELETE /identity/v3/users/9944b3d82f2c42eb8c1388f09fd95471 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:50.313048 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45f4f8-a448-44de-ace0-28a73df676c9 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:50.313583 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45f4f8-a448-44de-ace0-28a73df676c9 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:50.314327 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45f4f8-a448-44de-ace0-28a73df676c9 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:50.315033 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7beba-b8c8-4176-a700-8f227a4b287a admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:50.316282 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 954/1889] 10.222.0.49 () {54 vars in 921 bytes} [Mon Jul 4 04:11:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:11:50.317922 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45f4f8-a448-44de-ace0-28a73df676c9 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:50.320830 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4b45f4f8-a448-44de-ace0-28a73df676c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:50.385525 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:50.390956 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf6406-a2ea-4a83-aa13-b61f7c7ab2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:50.391660 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf6406-a2ea-4a83-aa13-b61f7c7ab2c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:50.391951 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf6406-a2ea-4a83-aa13-b61f7c7ab2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:50.392238 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf6406-a2ea-4a83-aa13-b61f7c7ab2c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:50.393036 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf6406-a2ea-4a83-aa13-b61f7c7ab2c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:50.394799 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf6406-a2ea-4a83-aa13-b61f7c7ab2c0 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:50.418213 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 936/1890] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:50.419719 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf6406-a2ea-4a83-aa13-b61f7c7ab2c0 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:50.421748 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ffcf6406-a2ea-4a83-aa13-b61f7c7ab2c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:50.439151 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45f4f8-a448-44de-ace0-28a73df676c9 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:50.444850 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3aaabe-573e-422f-b369-07a59a734b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:50.445624 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3aaabe-573e-422f-b369-07a59a734b24 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:50.445910 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3aaabe-573e-422f-b369-07a59a734b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:50.446236 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf6406-a2ea-4a83-aa13-b61f7c7ab2c0 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:50.446344 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3aaabe-573e-422f-b369-07a59a734b24 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:50.446992 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3aaabe-573e-422f-b369-07a59a734b24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:50.448973 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3aaabe-573e-422f-b369-07a59a734b24 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:50.451268 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec2de4-7bd3-468a-923d-eff7c1bbe941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:50.452177 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec2de4-7bd3-468a-923d-eff7c1bbe941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:50.452465 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec2de4-7bd3-468a-923d-eff7c1bbe941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:50.452748 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec2de4-7bd3-468a-923d-eff7c1bbe941 admin admin] PATH_INFO: `/v3/users/141f52692a9c47ddbd16459b28a9c0ce` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:50.454405 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec2de4-7bd3-468a-923d-eff7c1bbe941 admin admin] RBAC: Authorizing `identity:delete_user(user_id=141f52692a9c47ddbd16459b28a9c0ce)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:50.456947 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec2de4-7bd3-468a-923d-eff7c1bbe941 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:50.472697 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 955/1891] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:11:50 2022] POST /identity/v3/users => generated 299 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:50.474272 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe56ff4-fd14-4461-8ec3-b32d04a8e559 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:50.474569 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe56ff4-fd14-4461-8ec3-b32d04a8e559 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:50.474871 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe56ff4-fd14-4461-8ec3-b32d04a8e559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:50.500145 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-2fe56ff4-fd14-4461-8ec3-b32d04a8e559 None None] MFA Rules not processed for user `c2a18591461343c3a0a1b0e317734ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:50.501801 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-2fe56ff4-fd14-4461-8ec3-b32d04a8e559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:50.519316 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3fec2de4-7bd3-468a-923d-eff7c1bbe941 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '141f52692a9c47ddbd16459b28a9c0ce'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:50.520751 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3fec2de4-7bd3-468a-923d-eff7c1bbe941 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '141f52692a9c47ddbd16459b28a9c0ce'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:50.531782 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3fec2de4-7bd3-468a-923d-eff7c1bbe941 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '141f52692a9c47ddbd16459b28a9c0ce'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:50.551394 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3fec2de4-7bd3-468a-923d-eff7c1bbe941 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '141f52692a9c47ddbd16459b28a9c0ce'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:50.552226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3fec2de4-7bd3-468a-923d-eff7c1bbe941 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '141f52692a9c47ddbd16459b28a9c0ce'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:50.571406 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 937/1892] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:11:50 2022] DELETE /identity/v3/users/141f52692a9c47ddbd16459b28a9c0ce => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:50.571406 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec2de4-7bd3-468a-923d-eff7c1bbe941 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:50.571406 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3fec2de4-7bd3-468a-923d-eff7c1bbe941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:50.589471 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 956/1893] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Jul 4 04:11:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:50.590023 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:50.590431 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe56ff4-fd14-4461-8ec3-b32d04a8e559 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:50.592309 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-2fe56ff4-fd14-4461-8ec3-b32d04a8e559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:50.608232 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe56ff4-fd14-4461-8ec3-b32d04a8e559 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:50.683599 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec2de4-7bd3-468a-923d-eff7c1bbe941 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:50.684127 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4da15a-d66f-4e66-9bef-99eb4fe1b631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:50.684975 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4da15a-d66f-4e66-9bef-99eb4fe1b631 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:50.685348 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4da15a-d66f-4e66-9bef-99eb4fe1b631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:50.685783 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4da15a-d66f-4e66-9bef-99eb4fe1b631 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:50.686926 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4da15a-d66f-4e66-9bef-99eb4fe1b631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:50.688772 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17094142-e12f-4ff6-b4a1-68360654ee42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:50.689059 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4da15a-d66f-4e66-9bef-99eb4fe1b631 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:50.689895 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17094142-e12f-4ff6-b4a1-68360654ee42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:50.690198 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17094142-e12f-4ff6-b4a1-68360654ee42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:50.690486 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17094142-e12f-4ff6-b4a1-68360654ee42 admin admin] PATH_INFO: `/v3/projects/2685b44defd0425387310e4a658e4cdc/users/97bca3b7ef46459e8787d1c2087a073d/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:50.706208 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 957/1894] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:50.707323 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4da15a-d66f-4e66-9bef-99eb4fe1b631 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:50.708057 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17094142-e12f-4ff6-b4a1-68360654ee42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2685b44defd0425387310e4a658e4cdc, user_id=97bca3b7ef46459e8787d1c2087a073d, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:50.710758 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1c4da15a-d66f-4e66-9bef-99eb4fe1b631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:50.712017 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17094142-e12f-4ff6-b4a1-68360654ee42 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:50.738217 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 938/1895] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:50 2022] PUT /identity/v3/projects/2685b44defd0425387310e4a658e4cdc/users/97bca3b7ef46459e8787d1c2087a073d/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:50.738217 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17094142-e12f-4ff6-b4a1-68360654ee42 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:50.792058 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:50.816483 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4da15a-d66f-4e66-9bef-99eb4fe1b631 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:50.828710 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17094142-e12f-4ff6-b4a1-68360654ee42 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:50.850005 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531fa2b-b2a1-4caa-8a47-2d49c4dc88c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:50.851308 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531fa2b-b2a1-4caa-8a47-2d49c4dc88c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:50.851799 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531fa2b-b2a1-4caa-8a47-2d49c4dc88c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:50.853065 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531fa2b-b2a1-4caa-8a47-2d49c4dc88c6 admin admin] PATH_INFO: `/v3/projects/5fbc2e931ec64df7bcc3e30538d44a66/users/271feeb0419349c992eae0ddb26c05c6/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:50.875173 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531fa2b-b2a1-4caa-8a47-2d49c4dc88c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fbc2e931ec64df7bcc3e30538d44a66, user_id=271feeb0419349c992eae0ddb26c05c6, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:50.878648 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531fa2b-b2a1-4caa-8a47-2d49c4dc88c6 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:50.897873 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 939/1896] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:50 2022] PUT /identity/v3/projects/5fbc2e931ec64df7bcc3e30538d44a66/users/271feeb0419349c992eae0ddb26c05c6/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:50.899575 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531fa2b-b2a1-4caa-8a47-2d49c4dc88c6 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:50.923785 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89b2b9-2ffe-40db-b301-857a8a4d524b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a18591461343c3a0a1b0e317734ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:50.924406 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89b2b9-2ffe-40db-b301-857a8a4d524b service placement] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:50.924803 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89b2b9-2ffe-40db-b301-857a8a4d524b service placement] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:50.925183 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89b2b9-2ffe-40db-b301-857a8a4d524b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:50.936396 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89b2b9-2ffe-40db-b301-857a8a4d524b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:50.938321 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89b2b9-2ffe-40db-b301-857a8a4d524b service placement] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:50.952120 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 958/1897] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:50.953395 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89b2b9-2ffe-40db-b301-857a8a4d524b service placement] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:50.974393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89b2b9-2ffe-40db-b301-857a8a4d524b service placement] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:50.994596 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531fa2b-b2a1-4caa-8a47-2d49c4dc88c6 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:51.000627 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c61e09-ce04-4463-8350-06f845352e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:51.001626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c61e09-ce04-4463-8350-06f845352e2f admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:51.002255 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c61e09-ce04-4463-8350-06f845352e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:51.002751 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c61e09-ce04-4463-8350-06f845352e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:51.003765 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c61e09-ce04-4463-8350-06f845352e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:51.005842 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c61e09-ce04-4463-8350-06f845352e2f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:51.021675 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 940/1898] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:51.023020 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c61e09-ce04-4463-8350-06f845352e2f admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:51.036236 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c61e09-ce04-4463-8350-06f845352e2f admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:51.044128 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899b95c-1dae-4a96-95ad-f4a6f19f6ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:51.045660 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899b95c-1dae-4a96-95ad-f4a6f19f6ec2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:51.046234 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899b95c-1dae-4a96-95ad-f4a6f19f6ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:51.046721 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899b95c-1dae-4a96-95ad-f4a6f19f6ec2 admin admin] PATH_INFO: `/v3/projects/2685b44defd0425387310e4a658e4cdc/users/97bca3b7ef46459e8787d1c2087a073d/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:51.049413 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3899b95c-1dae-4a96-95ad-f4a6f19f6ec2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2685b44defd0425387310e4a658e4cdc, user_id=97bca3b7ef46459e8787d1c2087a073d, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:51.058183 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3899b95c-1dae-4a96-95ad-f4a6f19f6ec2 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:51.072889 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:51.086280 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 941/1899] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:51 2022] PUT /identity/v3/projects/2685b44defd0425387310e4a658e4cdc/users/97bca3b7ef46459e8787d1c2087a073d/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:51.100541 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89bcbf-612a-4288-98bd-09f5d7b45300 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:51.100541 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89bcbf-612a-4288-98bd-09f5d7b45300 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:51.107951 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89bcbf-612a-4288-98bd-09f5d7b45300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:51.108137 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c558e96-086f-475d-9cf0-d2d78232ccb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:51.108829 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c558e96-086f-475d-9cf0-d2d78232ccb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:51.109107 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c558e96-086f-475d-9cf0-d2d78232ccb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:51.109714 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c558e96-086f-475d-9cf0-d2d78232ccb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:51.110143 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c558e96-086f-475d-9cf0-d2d78232ccb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:51.113305 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c558e96-086f-475d-9cf0-d2d78232ccb8 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:51.139992 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 959/1900] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:51.144018 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c558e96-086f-475d-9cf0-d2d78232ccb8 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:51.156101 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-5c89bcbf-612a-4288-98bd-09f5d7b45300 None None] MFA Rules not processed for user `97bca3b7ef46459e8787d1c2087a073d`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:51.158857 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5c89bcbf-612a-4288-98bd-09f5d7b45300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:51.161792 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c558e96-086f-475d-9cf0-d2d78232ccb8 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:51.251938 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 942/1901] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:51 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:51.270317 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89bcbf-612a-4288-98bd-09f5d7b45300 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:51.274302 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5c89bcbf-612a-4288-98bd-09f5d7b45300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:51.275937 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ce85b-b0c0-4154-ae4e-98a434d7f444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:51.277635 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ce85b-b0c0-4154-ae4e-98a434d7f444 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:51.279294 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ce85b-b0c0-4154-ae4e-98a434d7f444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:51.280019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ce85b-b0c0-4154-ae4e-98a434d7f444 admin admin] PATH_INFO: `/v3/projects/5fbc2e931ec64df7bcc3e30538d44a66/users/271feeb0419349c992eae0ddb26c05c6/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:51.285108 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0ce85b-b0c0-4154-ae4e-98a434d7f444 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fbc2e931ec64df7bcc3e30538d44a66, user_id=271feeb0419349c992eae0ddb26c05c6, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:51.292273 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0ce85b-b0c0-4154-ae4e-98a434d7f444 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:51.312125 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 960/1902] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:51 2022] PUT /identity/v3/projects/5fbc2e931ec64df7bcc3e30538d44a66/users/271feeb0419349c992eae0ddb26c05c6/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:51.326420 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21872e59-95d5-4a20-beaa-bfcd53faa780 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:51.327209 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21872e59-95d5-4a20-beaa-bfcd53faa780 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:51.327768 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21872e59-95d5-4a20-beaa-bfcd53faa780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:51.379741 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-21872e59-95d5-4a20-beaa-bfcd53faa780 None None] MFA Rules not processed for user `271feeb0419349c992eae0ddb26c05c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:51.381549 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-21872e59-95d5-4a20-beaa-bfcd53faa780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:51.390747 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:51.396196 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89bcbf-612a-4288-98bd-09f5d7b45300 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:51.466327 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb1ba3-0c63-4a62-a14d-856287860094 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:51.467119 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 961/1903] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:51.467241 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb1ba3-0c63-4a62-a14d-856287860094 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:51.467471 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb1ba3-0c63-4a62-a14d-856287860094 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:51.467756 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb1ba3-0c63-4a62-a14d-856287860094 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:51.489440 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21872e59-95d5-4a20-beaa-bfcd53faa780 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:51.493396 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-21872e59-95d5-4a20-beaa-bfcd53faa780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:51.521631 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21872e59-95d5-4a20-beaa-bfcd53faa780 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:51.533075 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd975093-09f4-4ad5-b087-d2d0b1b0b831 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:51.534775 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd975093-09f4-4ad5-b087-d2d0b1b0b831 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:51.535181 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd975093-09f4-4ad5-b087-d2d0b1b0b831 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:51.535636 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd975093-09f4-4ad5-b087-d2d0b1b0b831 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:51.539228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-bd975093-09f4-4ad5-b087-d2d0b1b0b831 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:51.556958 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:51.572668 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb1ba3-0c63-4a62-a14d-856287860094 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:51.574983 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb1ba3-0c63-4a62-a14d-856287860094 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:51.598688 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 943/1904] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:51 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:51.639461 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd975093-09f4-4ad5-b087-d2d0b1b0b831 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:51.649177 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd975093-09f4-4ad5-b087-d2d0b1b0b831 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:51.667201 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 962/1905] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 04:11:51.713896 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb1ba3-0c63-4a62-a14d-856287860094 service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:51.713896 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-fadb1ba3-0c63-4a62-a14d-856287860094 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:51.796678 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd975093-09f4-4ad5-b087-d2d0b1b0b831 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:51.823618 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb1ba3-0c63-4a62-a14d-856287860094 service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:51.833214 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c20c667-bc00-4984-8fa2-a2519986decf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:51.834214 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20c667-bc00-4984-8fa2-a2519986decf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:51.835079 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20c667-bc00-4984-8fa2-a2519986decf admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:51.835079 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20c667-bc00-4984-8fa2-a2519986decf admin admin] PATH_INFO: `/v3/projects/2b953a430b9a4156b0d69a3331dbffff` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:51.836804 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c20c667-bc00-4984-8fa2-a2519986decf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b953a430b9a4156b0d69a3331dbffff)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:51.840841 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c20c667-bc00-4984-8fa2-a2519986decf admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:51.927691 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd975093-09f4-4ad5-b087-d2d0b1b0b831 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:51.944660 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8c20c667-bc00-4984-8fa2-a2519986decf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b953a430b9a4156b0d69a3331dbffff', 'request_id': 'req-8c20c667-bc00-4984-8fa2-a2519986decf'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:51.953660 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8c20c667-bc00-4984-8fa2-a2519986decf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b953a430b9a4156b0d69a3331dbffff', 'request_id': 'req-8c20c667-bc00-4984-8fa2-a2519986decf'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:51.989714 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8c20c667-bc00-4984-8fa2-a2519986decf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b953a430b9a4156b0d69a3331dbffff', 'request_id': 'req-8c20c667-bc00-4984-8fa2-a2519986decf'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:52.020716 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8c20c667-bc00-4984-8fa2-a2519986decf admin admin] The token cache is being invalidate because project 2b953a430b9a4156b0d69a3331dbffff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:11:52.021055 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8c20c667-bc00-4984-8fa2-a2519986decf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:52.025929 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8c20c667-bc00-4984-8fa2-a2519986decf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:52.029112 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 944/1906] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:11:51 2022] DELETE /identity/v3/projects/2b953a430b9a4156b0d69a3331dbffff => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:52.033954 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c20c667-bc00-4984-8fa2-a2519986decf admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:52.035980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-8c20c667-bc00-4984-8fa2-a2519986decf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:52.048173 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:52.079225 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec6e9b-61d9-4765-93e3-c139466362e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:52.080205 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec6e9b-61d9-4765-93e3-c139466362e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:52.080488 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec6e9b-61d9-4765-93e3-c139466362e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:52.080768 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec6e9b-61d9-4765-93e3-c139466362e0 admin admin] PATH_INFO: `/v3/users/cf8f1c6347fb4dd392382baf6d69d01f` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:52.082085 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec6e9b-61d9-4765-93e3-c139466362e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf8f1c6347fb4dd392382baf6d69d01f)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:52.084565 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec6e9b-61d9-4765-93e3-c139466362e0 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:52.141591 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c20c667-bc00-4984-8fa2-a2519986decf admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:52.158201 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76ced3-f2dc-4078-a2a1-b8ece73d13b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:52.158201 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76ced3-f2dc-4078-a2a1-b8ece73d13b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:52.158201 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76ced3-f2dc-4078-a2a1-b8ece73d13b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:52.158201 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76ced3-f2dc-4078-a2a1-b8ece73d13b2 admin admin] PATH_INFO: `/v3/projects/b822a91c7d1d4bf79e0fa6bee1ae4bda` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:52.161185 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae76ced3-f2dc-4078-a2a1-b8ece73d13b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b822a91c7d1d4bf79e0fa6bee1ae4bda)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:52.165300 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae76ced3-f2dc-4078-a2a1-b8ece73d13b2 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:52.174888 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-42ec6e9b-61d9-4765-93e3-c139466362e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf8f1c6347fb4dd392382baf6d69d01f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:52.190111 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-42ec6e9b-61d9-4765-93e3-c139466362e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf8f1c6347fb4dd392382baf6d69d01f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:52.190936 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-42ec6e9b-61d9-4765-93e3-c139466362e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf8f1c6347fb4dd392382baf6d69d01f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:52.201459 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:52.215175 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-42ec6e9b-61d9-4765-93e3-c139466362e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf8f1c6347fb4dd392382baf6d69d01f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:52.217842 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-42ec6e9b-61d9-4765-93e3-c139466362e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf8f1c6347fb4dd392382baf6d69d01f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:52.241764 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ae76ced3-f2dc-4078-a2a1-b8ece73d13b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b822a91c7d1d4bf79e0fa6bee1ae4bda', 'request_id': 'req-ae76ced3-f2dc-4078-a2a1-b8ece73d13b2'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:52.242780 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 963/1907] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:11:51 2022] DELETE /identity/v3/users/cf8f1c6347fb4dd392382baf6d69d01f => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:52.243860 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec6e9b-61d9-4765-93e3-c139466362e0 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:52.245713 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-42ec6e9b-61d9-4765-93e3-c139466362e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:52.251332 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ae76ced3-f2dc-4078-a2a1-b8ece73d13b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b822a91c7d1d4bf79e0fa6bee1ae4bda', 'request_id': 'req-ae76ced3-f2dc-4078-a2a1-b8ece73d13b2'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:52.260230 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ae76ced3-f2dc-4078-a2a1-b8ece73d13b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b822a91c7d1d4bf79e0fa6bee1ae4bda', 'request_id': 'req-ae76ced3-f2dc-4078-a2a1-b8ece73d13b2'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:52.280258 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ae76ced3-f2dc-4078-a2a1-b8ece73d13b2 admin admin] The token cache is being invalidate because project b822a91c7d1d4bf79e0fa6bee1ae4bda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:11:52.280568 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ae76ced3-f2dc-4078-a2a1-b8ece73d13b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:52.281609 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ae76ced3-f2dc-4078-a2a1-b8ece73d13b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:52.284581 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 945/1908] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:11:52 2022] DELETE /identity/v3/projects/b822a91c7d1d4bf79e0fa6bee1ae4bda => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:52.285908 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb02c1-0935-419c-9eae-c710c9db54d2 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:52.286372 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb02c1-0935-419c-9eae-c710c9db54d2 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:52.286663 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb02c1-0935-419c-9eae-c710c9db54d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:52.306204 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-74eb02c1-0935-419c-9eae-c710c9db54d2 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:52.307441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-74eb02c1-0935-419c-9eae-c710c9db54d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:52.326071 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec6e9b-61d9-4765-93e3-c139466362e0 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:52.331809 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe1968-933f-407f-a680-9a94513a4ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:52.332734 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe1968-933f-407f-a680-9a94513a4ac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:52.333083 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe1968-933f-407f-a680-9a94513a4ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:52.333421 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe1968-933f-407f-a680-9a94513a4ac4 admin admin] PATH_INFO: `/v3/users/bdbd4d8876ae4adbaca6bf975cf16521` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:52.334800 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe1968-933f-407f-a680-9a94513a4ac4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdbd4d8876ae4adbaca6bf975cf16521)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:52.337095 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe1968-933f-407f-a680-9a94513a4ac4 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:52.377244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 946/1909] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:52.378611 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d207ca-f540-4be1-975c-69ac5a2f7088 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:52.378910 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d207ca-f540-4be1-975c-69ac5a2f7088 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:52.379251 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d207ca-f540-4be1-975c-69ac5a2f7088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:52.395848 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0cbe1968-933f-407f-a680-9a94513a4ac4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdbd4d8876ae4adbaca6bf975cf16521'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:52.399678 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e5d207ca-f540-4be1-975c-69ac5a2f7088 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:52.401147 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e5d207ca-f540-4be1-975c-69ac5a2f7088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:52.405013 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0cbe1968-933f-407f-a680-9a94513a4ac4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdbd4d8876ae4adbaca6bf975cf16521'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:52.405670 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0cbe1968-933f-407f-a680-9a94513a4ac4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdbd4d8876ae4adbaca6bf975cf16521'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:52.410334 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 947/1910] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:52.411334 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d207ca-f540-4be1-975c-69ac5a2f7088 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:52.417065 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e5d207ca-f540-4be1-975c-69ac5a2f7088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:52.423603 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:52.425386 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0cbe1968-933f-407f-a680-9a94513a4ac4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdbd4d8876ae4adbaca6bf975cf16521'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:52.426591 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0cbe1968-933f-407f-a680-9a94513a4ac4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdbd4d8876ae4adbaca6bf975cf16521'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:52.443738 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 964/1911] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:11:52 2022] DELETE /identity/v3/users/bdbd4d8876ae4adbaca6bf975cf16521 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:52.445211 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a62062-59a3-4788-84af-ff8bccce3ce4 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:52.445576 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a62062-59a3-4788-84af-ff8bccce3ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:52.446040 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a62062-59a3-4788-84af-ff8bccce3ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:52.490930 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-54a62062-59a3-4788-84af-ff8bccce3ce4 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:52.492991 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-54a62062-59a3-4788-84af-ff8bccce3ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:52.501306 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d207ca-f540-4be1-975c-69ac5a2f7088 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:52.573330 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce1b75-724b-46cc-ac19-f2a1c90b7a10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:52.575033 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce1b75-724b-46cc-ac19-f2a1c90b7a10 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:52.575520 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce1b75-724b-46cc-ac19-f2a1c90b7a10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:52.575902 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce1b75-724b-46cc-ac19-f2a1c90b7a10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:52.577537 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 965/1912] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:52.578758 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a62062-59a3-4788-84af-ff8bccce3ce4 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:52.578912 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ebce1b75-724b-46cc-ac19-f2a1c90b7a10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:52.588667 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a62062-59a3-4788-84af-ff8bccce3ce4 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:52.600190 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce1b75-724b-46cc-ac19-f2a1c90b7a10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:52.600811 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc6a01-7c17-4dfd-b34b-0ecd172a2b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:52.601530 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc6a01-7c17-4dfd-b34b-0ecd172a2b38 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:52.601919 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce1b75-724b-46cc-ac19-f2a1c90b7a10 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:52.602348 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc6a01-7c17-4dfd-b34b-0ecd172a2b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:52.602661 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc6a01-7c17-4dfd-b34b-0ecd172a2b38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:52.603351 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc6a01-7c17-4dfd-b34b-0ecd172a2b38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:11:52.603963 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc6a01-7c17-4dfd-b34b-0ecd172a2b38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:52.606559 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc6a01-7c17-4dfd-b34b-0ecd172a2b38 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:52.617650 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 948/1913] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:52.624169 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 966/1914] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:11:52.628648 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce1b75-724b-46cc-ac19-f2a1c90b7a10 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:52.634882 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:52.640413 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce1b75-724b-46cc-ac19-f2a1c90b7a10 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:52.647460 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acbfb8d-2da4-40b0-85da-5f9160e3e2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:52.648135 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbfb8d-2da4-40b0-85da-5f9160e3e2b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:52.649150 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbfb8d-2da4-40b0-85da-5f9160e3e2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:52.649533 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbfb8d-2da4-40b0-85da-5f9160e3e2b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:52.650572 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acbfb8d-2da4-40b0-85da-5f9160e3e2b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:52.653276 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acbfb8d-2da4-40b0-85da-5f9160e3e2b2 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:52.693720 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 949/1915] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:11:52 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 04:11:52.695187 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc6a01-7c17-4dfd-b34b-0ecd172a2b38 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:52.704758 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acbfb8d-2da4-40b0-85da-5f9160e3e2b2 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:52.707288 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5acbfb8d-2da4-40b0-85da-5f9160e3e2b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:52.707920 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc6a01-7c17-4dfd-b34b-0ecd172a2b38 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:52.792682 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acbfb8d-2da4-40b0-85da-5f9160e3e2b2 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:52.798292 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f97bda1-4229-496f-8836-0e7154b3e333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:52.799211 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97bda1-4229-496f-8836-0e7154b3e333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:52.808699 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97bda1-4229-496f-8836-0e7154b3e333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:52.809287 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97bda1-4229-496f-8836-0e7154b3e333 admin admin] PATH_INFO: `/v3/projects/4d8cc6a1029a455fb15511ada976a452` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:52.811952 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f97bda1-4229-496f-8836-0e7154b3e333 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d8cc6a1029a455fb15511ada976a452)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:52.814462 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f97bda1-4229-496f-8836-0e7154b3e333 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:52.814731 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd9085-e540-478f-a791-cbb763d7a7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:52.815523 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd9085-e540-478f-a791-cbb763d7a7e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:52.815883 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd9085-e540-478f-a791-cbb763d7a7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:52.816324 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd9085-e540-478f-a791-cbb763d7a7e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:52.817287 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd9085-e540-478f-a791-cbb763d7a7e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:52.819934 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd9085-e540-478f-a791-cbb763d7a7e1 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:52.849584 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 967/1916] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:11:52 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 04:11:52.853594 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd9085-e540-478f-a791-cbb763d7a7e1 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:52.869484 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd9085-e540-478f-a791-cbb763d7a7e1 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:52.877548 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf09bd-fb2c-4102-a980-c236e77f92a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:52.878441 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf09bd-fb2c-4102-a980-c236e77f92a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:52.883027 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf09bd-fb2c-4102-a980-c236e77f92a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:52.883474 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf09bd-fb2c-4102-a980-c236e77f92a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:52.885685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf09bd-fb2c-4102-a980-c236e77f92a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:52.888254 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf09bd-fb2c-4102-a980-c236e77f92a4 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:52.904889 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 968/1917] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 04:11:52.908650 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf09bd-fb2c-4102-a980-c236e77f92a4 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:52.923119 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf09bd-fb2c-4102-a980-c236e77f92a4 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:52.934932 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0f97bda1-4229-496f-8836-0e7154b3e333 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d8cc6a1029a455fb15511ada976a452', 'request_id': 'req-0f97bda1-4229-496f-8836-0e7154b3e333'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:52.979277 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0f97bda1-4229-496f-8836-0e7154b3e333 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d8cc6a1029a455fb15511ada976a452', 'request_id': 'req-0f97bda1-4229-496f-8836-0e7154b3e333'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:53.011773 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0f97bda1-4229-496f-8836-0e7154b3e333 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d8cc6a1029a455fb15511ada976a452', 'request_id': 'req-0f97bda1-4229-496f-8836-0e7154b3e333'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:53.114995 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0f97bda1-4229-496f-8836-0e7154b3e333 admin admin] The token cache is being invalidate because project 4d8cc6a1029a455fb15511ada976a452 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:11:53.115234 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0f97bda1-4229-496f-8836-0e7154b3e333 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:53.116141 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0f97bda1-4229-496f-8836-0e7154b3e333 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:53.119470 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 950/1918] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:11:52 2022] DELETE /identity/v3/projects/4d8cc6a1029a455fb15511ada976a452 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 04:11:53.127301 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:53.129524 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aea9ad-e627-4572-8476-162f5b5a3aab None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:53.129862 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aea9ad-e627-4572-8476-162f5b5a3aab None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:53.130143 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aea9ad-e627-4572-8476-162f5b5a3aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:53.140710 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6f1ef-d3c3-43f0-b540-2630ecf9b3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:53.141680 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6f1ef-d3c3-43f0-b540-2630ecf9b3f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:53.142401 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6f1ef-d3c3-43f0-b540-2630ecf9b3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:53.142827 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6f1ef-d3c3-43f0-b540-2630ecf9b3f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:53.144112 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e6f1ef-d3c3-43f0-b540-2630ecf9b3f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:53.145957 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e6f1ef-d3c3-43f0-b540-2630ecf9b3f9 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:53.163757 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 969/1919] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 04:11:53.164720 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6f1ef-d3c3-43f0-b540-2630ecf9b3f9 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:53.167749 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-16e6f1ef-d3c3-43f0-b540-2630ecf9b3f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:53.172483 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-31aea9ad-e627-4572-8476-162f5b5a3aab None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:53.173875 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-31aea9ad-e627-4572-8476-162f5b5a3aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:53.183996 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 951/1920] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:53.184885 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aea9ad-e627-4572-8476-162f5b5a3aab None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:53.188003 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-31aea9ad-e627-4572-8476-162f5b5a3aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:53.203677 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6f1ef-d3c3-43f0-b540-2630ecf9b3f9 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:53.209965 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aea9ad-e627-4572-8476-162f5b5a3aab None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:53.213749 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e6865-7014-48c6-8cb6-4c9b97c4d243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:53.215825 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e6865-7014-48c6-8cb6-4c9b97c4d243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:53.216336 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e6865-7014-48c6-8cb6-4c9b97c4d243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:53.216763 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e6865-7014-48c6-8cb6-4c9b97c4d243 admin admin] PATH_INFO: `/v3/projects/240fe43004674c8a850b9ae2cc87eff8` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:53.218041 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3622bc-f5ba-47d8-8a13-106adb24c731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:53.218521 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e6865-7014-48c6-8cb6-4c9b97c4d243 admin admin] RBAC: Authorizing `identity:delete_project(project_id=240fe43004674c8a850b9ae2cc87eff8)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:53.219400 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3622bc-f5ba-47d8-8a13-106adb24c731 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:53.219961 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3622bc-f5ba-47d8-8a13-106adb24c731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:53.220397 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3622bc-f5ba-47d8-8a13-106adb24c731 admin admin] PATH_INFO: `/v3/projects/8087104beb3c47779f11a93dc14218a1/users/fe90515f6a854bd686afbaed727d0d39/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:53.221086 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e6865-7014-48c6-8cb6-4c9b97c4d243 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:53.257386 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3622bc-f5ba-47d8-8a13-106adb24c731 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8087104beb3c47779f11a93dc14218a1, user_id=fe90515f6a854bd686afbaed727d0d39, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:53.260370 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3622bc-f5ba-47d8-8a13-106adb24c731 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:53.298204 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 952/1921] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:53 2022] PUT /identity/v3/projects/8087104beb3c47779f11a93dc14218a1/users/fe90515f6a854bd686afbaed727d0d39/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:53.298204 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84beb27b-7176-487e-a451-03c2a869b017 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:53.298204 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84beb27b-7176-487e-a451-03c2a869b017 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:53.298204 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84beb27b-7176-487e-a451-03c2a869b017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:53.328009 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-84beb27b-7176-487e-a451-03c2a869b017 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:53.329257 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-84beb27b-7176-487e-a451-03c2a869b017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:53.345907 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-858e6865-7014-48c6-8cb6-4c9b97c4d243 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '240fe43004674c8a850b9ae2cc87eff8', 'request_id': 'req-858e6865-7014-48c6-8cb6-4c9b97c4d243'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:53.353135 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-858e6865-7014-48c6-8cb6-4c9b97c4d243 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '240fe43004674c8a850b9ae2cc87eff8', 'request_id': 'req-858e6865-7014-48c6-8cb6-4c9b97c4d243'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:53.363136 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-858e6865-7014-48c6-8cb6-4c9b97c4d243 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '240fe43004674c8a850b9ae2cc87eff8', 'request_id': 'req-858e6865-7014-48c6-8cb6-4c9b97c4d243'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:53.389761 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-858e6865-7014-48c6-8cb6-4c9b97c4d243 admin admin] The token cache is being invalidate because project 240fe43004674c8a850b9ae2cc87eff8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:11:53.390220 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-858e6865-7014-48c6-8cb6-4c9b97c4d243 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:53.390940 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-858e6865-7014-48c6-8cb6-4c9b97c4d243 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:53.395942 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 970/1922] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:11:53 2022] DELETE /identity/v3/projects/240fe43004674c8a850b9ae2cc87eff8 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:53.406558 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4570a4-507a-4ff9-912c-08dc772b5de3 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:53.406783 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4570a4-507a-4ff9-912c-08dc772b5de3 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:53.407081 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4570a4-507a-4ff9-912c-08dc772b5de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:53.407868 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:53.449228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 953/1923] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:53.449975 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84beb27b-7176-487e-a451-03c2a869b017 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:53.451443 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-84beb27b-7176-487e-a451-03c2a869b017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:53.460924 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-df4570a4-507a-4ff9-912c-08dc772b5de3 None None] MFA Rules not processed for user `fe90515f6a854bd686afbaed727d0d39`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:53.462081 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-df4570a4-507a-4ff9-912c-08dc772b5de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:53.465062 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84beb27b-7176-487e-a451-03c2a869b017 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:53.471394 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd887b-94b7-4980-8a87-9853402f45af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:53.472527 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd887b-94b7-4980-8a87-9853402f45af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:53.472899 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd887b-94b7-4980-8a87-9853402f45af admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:53.473280 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd887b-94b7-4980-8a87-9853402f45af admin admin] PATH_INFO: `/v3/users/97bca3b7ef46459e8787d1c2087a073d` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:53.475354 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd887b-94b7-4980-8a87-9853402f45af admin admin] RBAC: Authorizing `identity:delete_user(user_id=97bca3b7ef46459e8787d1c2087a073d)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:53.478003 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd887b-94b7-4980-8a87-9853402f45af admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:53.545529 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-26bd887b-94b7-4980-8a87-9853402f45af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97bca3b7ef46459e8787d1c2087a073d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:53.546267 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-26bd887b-94b7-4980-8a87-9853402f45af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97bca3b7ef46459e8787d1c2087a073d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:53.557053 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 971/1924] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:53.558126 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4570a4-507a-4ff9-912c-08dc772b5de3 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:53.563131 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-26bd887b-94b7-4980-8a87-9853402f45af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97bca3b7ef46459e8787d1c2087a073d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:53.581710 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-26bd887b-94b7-4980-8a87-9853402f45af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97bca3b7ef46459e8787d1c2087a073d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:53.581854 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4570a4-507a-4ff9-912c-08dc772b5de3 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:53.582999 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-26bd887b-94b7-4980-8a87-9853402f45af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97bca3b7ef46459e8787d1c2087a073d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:53.588697 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1036156c-493e-4cb3-bcad-6f96a9bc837d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:53.589498 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036156c-493e-4cb3-bcad-6f96a9bc837d admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:53.589786 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036156c-493e-4cb3-bcad-6f96a9bc837d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:53.590242 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036156c-493e-4cb3-bcad-6f96a9bc837d admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:53.591145 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1036156c-493e-4cb3-bcad-6f96a9bc837d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:11:53.591688 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1036156c-493e-4cb3-bcad-6f96a9bc837d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:53.594060 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1036156c-493e-4cb3-bcad-6f96a9bc837d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:53.607798 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 954/1925] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:11:53 2022] DELETE /identity/v3/users/97bca3b7ef46459e8787d1c2087a073d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:53.608725 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd887b-94b7-4980-8a87-9853402f45af admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:53.610730 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-26bd887b-94b7-4980-8a87-9853402f45af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:53.615816 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 972/1926] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:11:53.616815 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1036156c-493e-4cb3-bcad-6f96a9bc837d admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:53.619061 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1036156c-493e-4cb3-bcad-6f96a9bc837d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:53.637781 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1036156c-493e-4cb3-bcad-6f96a9bc837d admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:53.726039 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:53.747720 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e32a3-a330-46c9-b8d5-e9dbe2d3260a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:53.749517 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e32a3-a330-46c9-b8d5-e9dbe2d3260a admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:53.750020 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e32a3-a330-46c9-b8d5-e9dbe2d3260a admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:53.750438 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e32a3-a330-46c9-b8d5-e9dbe2d3260a admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:53.751661 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e32a3-a330-46c9-b8d5-e9dbe2d3260a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:53.755943 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e32a3-a330-46c9-b8d5-e9dbe2d3260a admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:53.780831 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd887b-94b7-4980-8a87-9853402f45af admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:53.785721 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd8f2a-bf89-4064-94d0-15cdaa46c943 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:53.786871 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd8f2a-bf89-4064-94d0-15cdaa46c943 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:53.787011 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd8f2a-bf89-4064-94d0-15cdaa46c943 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:53.787892 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd8f2a-bf89-4064-94d0-15cdaa46c943 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:53.791271 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-19fd8f2a-bf89-4064-94d0-15cdaa46c943 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:53.801278 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 973/1927] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:11:53 2022] POST /identity/v3/projects => generated 373 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:53.808314 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e32a3-a330-46c9-b8d5-e9dbe2d3260a admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:53.876142 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd8f2a-bf89-4064-94d0-15cdaa46c943 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:53.877761 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd8f2a-bf89-4064-94d0-15cdaa46c943 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:53.908374 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 955/1928] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:53.939257 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e32a3-a330-46c9-b8d5-e9dbe2d3260a admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:53.940361 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd8f2a-bf89-4064-94d0-15cdaa46c943 service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:53.944416 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-19fd8f2a-bf89-4064-94d0-15cdaa46c943 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:53.962525 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd8f2a-bf89-4064-94d0-15cdaa46c943 service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:53.963092 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff951371-a653-42b5-850e-300eca9d9e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:53.964334 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff951371-a653-42b5-850e-300eca9d9e4c admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:53.965864 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff951371-a653-42b5-850e-300eca9d9e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:53.966566 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff951371-a653-42b5-850e-300eca9d9e4c admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:53.967542 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff951371-a653-42b5-850e-300eca9d9e4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:53.968225 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8a29e-283d-459a-aac3-a743a7b069f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:53.969284 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8a29e-283d-459a-aac3-a743a7b069f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:53.969575 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8a29e-283d-459a-aac3-a743a7b069f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:53.969848 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8a29e-283d-459a-aac3-a743a7b069f3 admin admin] PATH_INFO: `/v3/users/fe90515f6a854bd686afbaed727d0d39` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:53.969957 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff951371-a653-42b5-850e-300eca9d9e4c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:53.971140 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f8a29e-283d-459a-aac3-a743a7b069f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe90515f6a854bd686afbaed727d0d39)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:53.973512 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f8a29e-283d-459a-aac3-a743a7b069f3 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:53.976991 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:54.007375 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 974/1929] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:11:53 2022] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 04:11:54.011732 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff951371-a653-42b5-850e-300eca9d9e4c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:54.023994 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff951371-a653-42b5-850e-300eca9d9e4c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:54.029661 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49db5e9-b28d-4dcb-9691-1bf2d17f05cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:54.030387 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49db5e9-b28d-4dcb-9691-1bf2d17f05cc admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:54.030788 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49db5e9-b28d-4dcb-9691-1bf2d17f05cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:54.031019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49db5e9-b28d-4dcb-9691-1bf2d17f05cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:54.031706 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49db5e9-b28d-4dcb-9691-1bf2d17f05cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:54.033349 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49db5e9-b28d-4dcb-9691-1bf2d17f05cc admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:54.044676 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-50f8a29e-283d-459a-aac3-a743a7b069f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe90515f6a854bd686afbaed727d0d39'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:54.048390 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 975/1930] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 04:11:54.048539 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-50f8a29e-283d-459a-aac3-a743a7b069f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe90515f6a854bd686afbaed727d0d39'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:54.049076 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49db5e9-b28d-4dcb-9691-1bf2d17f05cc admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:54.058255 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-50f8a29e-283d-459a-aac3-a743a7b069f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe90515f6a854bd686afbaed727d0d39'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:54.061150 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49db5e9-b28d-4dcb-9691-1bf2d17f05cc admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:54.066395 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba22ed-176a-4d80-a907-c8e3117159e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:54.067322 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba22ed-176a-4d80-a907-c8e3117159e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:54.067741 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba22ed-176a-4d80-a907-c8e3117159e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:54.068032 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba22ed-176a-4d80-a907-c8e3117159e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:54.069282 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba22ed-176a-4d80-a907-c8e3117159e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:54.070929 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba22ed-176a-4d80-a907-c8e3117159e3 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:54.073903 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-50f8a29e-283d-459a-aac3-a743a7b069f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe90515f6a854bd686afbaed727d0d39'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:54.074790 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-50f8a29e-283d-459a-aac3-a743a7b069f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe90515f6a854bd686afbaed727d0d39'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:54.083048 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 976/1931] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:54.088371 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba22ed-176a-4d80-a907-c8e3117159e3 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:54.090820 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ccba22ed-176a-4d80-a907-c8e3117159e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:54.097570 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 956/1932] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:11:53 2022] DELETE /identity/v3/users/fe90515f6a854bd686afbaed727d0d39 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:54.102300 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9661e-196e-4b60-a705-7dabdc2a3005 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:54.104198 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9661e-196e-4b60-a705-7dabdc2a3005 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:54.104667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9661e-196e-4b60-a705-7dabdc2a3005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:54.110406 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba22ed-176a-4d80-a907-c8e3117159e3 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:54.138797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-11c9661e-196e-4b60-a705-7dabdc2a3005 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:54.140035 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-11c9661e-196e-4b60-a705-7dabdc2a3005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:54.175139 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b888af-5c3d-41a4-a2b4-d09b0e324aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:54.176051 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b888af-5c3d-41a4-a2b4-d09b0e324aba admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:54.176341 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b888af-5c3d-41a4-a2b4-d09b0e324aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:54.176657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b888af-5c3d-41a4-a2b4-d09b0e324aba admin admin] PATH_INFO: `/v3/projects/d5ae3eb123794aa496aef3efa6bdc963/users/28e74e4925144a77b53447f3f581b984/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:54.192460 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b888af-5c3d-41a4-a2b4-d09b0e324aba admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5ae3eb123794aa496aef3efa6bdc963, user_id=28e74e4925144a77b53447f3f581b984, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:54.195655 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b888af-5c3d-41a4-a2b4-d09b0e324aba admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:54.202474 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 957/1933] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:54.206673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9661e-196e-4b60-a705-7dabdc2a3005 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:54.208006 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-11c9661e-196e-4b60-a705-7dabdc2a3005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:54.210880 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 977/1934] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:54 2022] PUT /identity/v3/projects/d5ae3eb123794aa496aef3efa6bdc963/users/28e74e4925144a77b53447f3f581b984/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:54.215419 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b888af-5c3d-41a4-a2b4-d09b0e324aba admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:54.217169 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-60b888af-5c3d-41a4-a2b4-d09b0e324aba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:54.224774 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9661e-196e-4b60-a705-7dabdc2a3005 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:54.244854 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:54.274671 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b888af-5c3d-41a4-a2b4-d09b0e324aba admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:54.278351 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de89d990-fb5a-423a-86ec-11d33b42a026 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:54.279012 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89d990-fb5a-423a-86ec-11d33b42a026 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:54.279286 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89d990-fb5a-423a-86ec-11d33b42a026 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:54.279564 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89d990-fb5a-423a-86ec-11d33b42a026 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:54.282347 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df321e-7e4d-4eaa-bd67-babd7658e8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:54.283235 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df321e-7e4d-4eaa-bd67-babd7658e8f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:54.283524 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df321e-7e4d-4eaa-bd67-babd7658e8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:54.283842 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df321e-7e4d-4eaa-bd67-babd7658e8f0 admin admin] PATH_INFO: `/v3/projects/2685b44defd0425387310e4a658e4cdc` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:54.285182 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df321e-7e4d-4eaa-bd67-babd7658e8f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2685b44defd0425387310e4a658e4cdc)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:54.287181 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df321e-7e4d-4eaa-bd67-babd7658e8f0 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:54.288806 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de89d990-fb5a-423a-86ec-11d33b42a026 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:54.290386 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de89d990-fb5a-423a-86ec-11d33b42a026 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:54.300121 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 978/1935] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 04:11:54.301353 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731d6ef-0698-43a7-8800-95e54a7aa40d None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:54.301641 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731d6ef-0698-43a7-8800-95e54a7aa40d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:54.301920 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731d6ef-0698-43a7-8800-95e54a7aa40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:54.312465 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:54.332589 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-b731d6ef-0698-43a7-8800-95e54a7aa40d None None] MFA Rules not processed for user `28e74e4925144a77b53447f3f581b984`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:54.333903 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b731d6ef-0698-43a7-8800-95e54a7aa40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:54.341116 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-23df321e-7e4d-4eaa-bd67-babd7658e8f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2685b44defd0425387310e4a658e4cdc', 'request_id': 'req-23df321e-7e4d-4eaa-bd67-babd7658e8f0'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:54.347406 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-23df321e-7e4d-4eaa-bd67-babd7658e8f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2685b44defd0425387310e4a658e4cdc', 'request_id': 'req-23df321e-7e4d-4eaa-bd67-babd7658e8f0'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:54.359893 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-23df321e-7e4d-4eaa-bd67-babd7658e8f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2685b44defd0425387310e4a658e4cdc', 'request_id': 'req-23df321e-7e4d-4eaa-bd67-babd7658e8f0'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:54.385275 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-23df321e-7e4d-4eaa-bd67-babd7658e8f0 admin admin] The token cache is being invalidate because project 2685b44defd0425387310e4a658e4cdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:11:54.385574 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-23df321e-7e4d-4eaa-bd67-babd7658e8f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:54.386899 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-23df321e-7e4d-4eaa-bd67-babd7658e8f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:54.388980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 958/1936] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:11:54 2022] DELETE /identity/v3/projects/2685b44defd0425387310e4a658e4cdc => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:54.394426 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd578e-2b15-4378-a1d7-28f7f6264e39 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:54.394719 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd578e-2b15-4378-a1d7-28f7f6264e39 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:54.395043 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd578e-2b15-4378-a1d7-28f7f6264e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:54.417489 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-5bcd578e-2b15-4378-a1d7-28f7f6264e39 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:54.419085 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5bcd578e-2b15-4378-a1d7-28f7f6264e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:54.433300 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 979/1937] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:54.434389 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731d6ef-0698-43a7-8800-95e54a7aa40d None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:54.435798 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b731d6ef-0698-43a7-8800-95e54a7aa40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:54.528863 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731d6ef-0698-43a7-8800-95e54a7aa40d None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:54.532427 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 959/1938] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:54.541025 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea520b-86ef-4e91-bb9d-de2fb224eaf8 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:54.541497 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea520b-86ef-4e91-bb9d-de2fb224eaf8 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:54.541795 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea520b-86ef-4e91-bb9d-de2fb224eaf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:54.542479 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762bca15-e8f1-481d-b62f-ad22c84292b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:54.543910 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762bca15-e8f1-481d-b62f-ad22c84292b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:54.545044 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762bca15-e8f1-481d-b62f-ad22c84292b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:54.545520 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762bca15-e8f1-481d-b62f-ad22c84292b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:54.546581 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762bca15-e8f1-481d-b62f-ad22c84292b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:54.550730 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762bca15-e8f1-481d-b62f-ad22c84292b8 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:54.562464 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-d1ea520b-86ef-4e91-bb9d-de2fb224eaf8 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:54.563711 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d1ea520b-86ef-4e91-bb9d-de2fb224eaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:54.573946 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 960/1939] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:54.578284 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea520b-86ef-4e91-bb9d-de2fb224eaf8 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:54.589705 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea520b-86ef-4e91-bb9d-de2fb224eaf8 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:54.595600 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c180e-f01e-4f1b-86b3-f47ff6832e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:54.597038 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 980/1940] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:11:54 2022] POST /identity/v3/projects => generated 373 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 04:11:54.598434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c180e-f01e-4f1b-86b3-f47ff6832e67 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:54.599357 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c180e-f01e-4f1b-86b3-f47ff6832e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:54.600188 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c180e-f01e-4f1b-86b3-f47ff6832e67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:54.600307 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762bca15-e8f1-481d-b62f-ad22c84292b8 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:54.601653 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c180e-f01e-4f1b-86b3-f47ff6832e67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:11:54.602316 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c180e-f01e-4f1b-86b3-f47ff6832e67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:54.605451 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c180e-f01e-4f1b-86b3-f47ff6832e67 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:54.640017 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 961/1941] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 04:11:54.645613 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c180e-f01e-4f1b-86b3-f47ff6832e67 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:54.667353 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c180e-f01e-4f1b-86b3-f47ff6832e67 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:54.705619 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:54.727826 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762bca15-e8f1-481d-b62f-ad22c84292b8 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:54.732811 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72966248-5b6b-48be-9bbd-a4c5edf7c55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:54.733574 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72966248-5b6b-48be-9bbd-a4c5edf7c55a admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:54.733942 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72966248-5b6b-48be-9bbd-a4c5edf7c55a admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:54.734428 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72966248-5b6b-48be-9bbd-a4c5edf7c55a admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:54.735107 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72966248-5b6b-48be-9bbd-a4c5edf7c55a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:54.737136 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72966248-5b6b-48be-9bbd-a4c5edf7c55a admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:54.752098 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621abcef-625d-464c-ba91-afe37cd5712a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:54.753150 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621abcef-625d-464c-ba91-afe37cd5712a admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:54.753664 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621abcef-625d-464c-ba91-afe37cd5712a admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:54.754123 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621abcef-625d-464c-ba91-afe37cd5712a admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:54.755326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621abcef-625d-464c-ba91-afe37cd5712a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:54.758354 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621abcef-625d-464c-ba91-afe37cd5712a admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:54.762667 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 981/1942] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:11:54 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 04:11:54.763462 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72966248-5b6b-48be-9bbd-a4c5edf7c55a admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:54.765199 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-72966248-5b6b-48be-9bbd-a4c5edf7c55a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:54.799262 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72966248-5b6b-48be-9bbd-a4c5edf7c55a admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:54.806625 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a78851-d257-4ae5-bebf-80b3c49bb4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:54.807781 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a78851-d257-4ae5-bebf-80b3c49bb4dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:54.808295 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a78851-d257-4ae5-bebf-80b3c49bb4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:54.808914 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a78851-d257-4ae5-bebf-80b3c49bb4dd admin admin] PATH_INFO: `/v3/projects/8087104beb3c47779f11a93dc14218a1` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:54.811461 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a78851-d257-4ae5-bebf-80b3c49bb4dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8087104beb3c47779f11a93dc14218a1)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:54.813655 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a78851-d257-4ae5-bebf-80b3c49bb4dd admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:54.816848 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 962/1943] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:11:54 2022] POST /identity/v3/projects => generated 409 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:54.816848 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621abcef-625d-464c-ba91-afe37cd5712a admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:54.854435 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:54.879546 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-04a78851-d257-4ae5-bebf-80b3c49bb4dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8087104beb3c47779f11a93dc14218a1', 'request_id': 'req-04a78851-d257-4ae5-bebf-80b3c49bb4dd'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:54.892783 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-04a78851-d257-4ae5-bebf-80b3c49bb4dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8087104beb3c47779f11a93dc14218a1', 'request_id': 'req-04a78851-d257-4ae5-bebf-80b3c49bb4dd'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:54.893618 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-04a78851-d257-4ae5-bebf-80b3c49bb4dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8087104beb3c47779f11a93dc14218a1', 'request_id': 'req-04a78851-d257-4ae5-bebf-80b3c49bb4dd'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:54.910754 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621abcef-625d-464c-ba91-afe37cd5712a admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:54.911098 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-04a78851-d257-4ae5-bebf-80b3c49bb4dd admin admin] The token cache is being invalidate because project 8087104beb3c47779f11a93dc14218a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:11:54.911493 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-04a78851-d257-4ae5-bebf-80b3c49bb4dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:54.912267 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-04a78851-d257-4ae5-bebf-80b3c49bb4dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:54.917204 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 982/1944] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:11:54 2022] DELETE /identity/v3/projects/8087104beb3c47779f11a93dc14218a1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:54.917204 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a78851-d257-4ae5-bebf-80b3c49bb4dd admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:54.917204 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-04a78851-d257-4ae5-bebf-80b3c49bb4dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:54.989814 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad68fc-1370-4ec2-a8dd-e2db07c3d2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:54.990709 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad68fc-1370-4ec2-a8dd-e2db07c3d2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:54.991071 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad68fc-1370-4ec2-a8dd-e2db07c3d2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:54.991426 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad68fc-1370-4ec2-a8dd-e2db07c3d2e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:54.992786 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad68fc-1370-4ec2-a8dd-e2db07c3d2e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:54.994821 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad68fc-1370-4ec2-a8dd-e2db07c3d2e2 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:55.009432 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 963/1945] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:55.011495 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012eabf-7df7-465c-b4dc-1695734078dd None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:55.011928 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012eabf-7df7-465c-b4dc-1695734078dd None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:55.012241 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012eabf-7df7-465c-b4dc-1695734078dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:55.013571 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a78851-d257-4ae5-bebf-80b3c49bb4dd admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:55.019631 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b051306-f4df-4dfc-94d5-e51793e90139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:55.020348 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b051306-f4df-4dfc-94d5-e51793e90139 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:55.021008 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b051306-f4df-4dfc-94d5-e51793e90139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:55.021149 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b051306-f4df-4dfc-94d5-e51793e90139 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:55.022103 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b051306-f4df-4dfc-94d5-e51793e90139 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:55.024983 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b051306-f4df-4dfc-94d5-e51793e90139 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:55.039128 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-7012eabf-7df7-465c-b4dc-1695734078dd None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:55.041153 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-7012eabf-7df7-465c-b4dc-1695734078dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:55.056544 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 983/1946] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:11:54 2022] POST /identity/v3/users => generated 305 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:55.056752 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 964/1947] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:55.057177 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b051306-f4df-4dfc-94d5-e51793e90139 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:55.057700 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012eabf-7df7-465c-b4dc-1695734078dd None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:55.057811 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0b051306-f4df-4dfc-94d5-e51793e90139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:55.070368 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012eabf-7df7-465c-b4dc-1695734078dd None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:55.072157 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b051306-f4df-4dfc-94d5-e51793e90139 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:55.080173 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668de9ee-127f-4458-9cb7-2aba54739ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:55.080961 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668de9ee-127f-4458-9cb7-2aba54739ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:55.081321 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668de9ee-127f-4458-9cb7-2aba54739ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:55.081810 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668de9ee-127f-4458-9cb7-2aba54739ac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:55.082675 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668de9ee-127f-4458-9cb7-2aba54739ac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:55.084241 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244ce2c-8869-4d54-b9a4-19a145083a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:55.085358 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668de9ee-127f-4458-9cb7-2aba54739ac8 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:55.085562 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244ce2c-8869-4d54-b9a4-19a145083a9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:55.085948 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244ce2c-8869-4d54-b9a4-19a145083a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:55.086428 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244ce2c-8869-4d54-b9a4-19a145083a9c admin admin] PATH_INFO: `/v3/projects/dfc39ef63681446a82bc098157529340/users/cbea1cd44b514627a1ded2a5fb198ff1/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:55.105122 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b244ce2c-8869-4d54-b9a4-19a145083a9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfc39ef63681446a82bc098157529340, user_id=cbea1cd44b514627a1ded2a5fb198ff1, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:55.106215 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 965/1948] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 04:11:55.107781 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fbd3a-ed29-4b30-854d-c6ac12627477 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:55.108079 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fbd3a-ed29-4b30-854d-c6ac12627477 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:55.108347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b244ce2c-8869-4d54-b9a4-19a145083a9c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:55.108441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fbd3a-ed29-4b30-854d-c6ac12627477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:55.128007 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 984/1949] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:55 2022] PUT /identity/v3/projects/dfc39ef63681446a82bc098157529340/users/cbea1cd44b514627a1ded2a5fb198ff1/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:55.131362 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244ce2c-8869-4d54-b9a4-19a145083a9c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:55.132788 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c38fbd3a-ed29-4b30-854d-c6ac12627477 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:55.134107 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c38fbd3a-ed29-4b30-854d-c6ac12627477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:55.174525 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=85,keystone:INSERT=8,keystone:DELETE=7 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:55.224908 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244ce2c-8869-4d54-b9a4-19a145083a9c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:55.229999 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13343a-de41-4ce9-96a7-635822968d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:55.230713 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13343a-de41-4ce9-96a7-635822968d06 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:55.231000 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13343a-de41-4ce9-96a7-635822968d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:55.231281 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13343a-de41-4ce9-96a7-635822968d06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:55.232024 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c13343a-de41-4ce9-96a7-635822968d06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:55.236023 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 966/1950] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:55.236170 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c13343a-de41-4ce9-96a7-635822968d06 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:55.236251 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38fbd3a-ed29-4b30-854d-c6ac12627477 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:55.244269 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38fbd3a-ed29-4b30-854d-c6ac12627477 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:55.246269 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 985/1951] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:55.246269 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13343a-de41-4ce9-96a7-635822968d06 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:55.250794 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0eabf4-b1e9-4950-9a28-5a4460ebea74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:55.251500 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0eabf4-b1e9-4950-9a28-5a4460ebea74 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:55.251917 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0eabf4-b1e9-4950-9a28-5a4460ebea74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:55.252212 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0eabf4-b1e9-4950-9a28-5a4460ebea74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:55.253010 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0eabf4-b1e9-4950-9a28-5a4460ebea74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:55.254700 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0eabf4-b1e9-4950-9a28-5a4460ebea74 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:55.257386 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13343a-de41-4ce9-96a7-635822968d06 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:55.263306 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec7587-7cd4-4af5-9ac2-fd666b89ceb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:55.263976 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec7587-7cd4-4af5-9ac2-fd666b89ceb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:55.264260 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec7587-7cd4-4af5-9ac2-fd666b89ceb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:55.264545 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec7587-7cd4-4af5-9ac2-fd666b89ceb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:55.265288 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec7587-7cd4-4af5-9ac2-fd666b89ceb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:11:55.265599 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec7587-7cd4-4af5-9ac2-fd666b89ceb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:55.267050 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 967/1952] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:55.267273 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec7587-7cd4-4af5-9ac2-fd666b89ceb5 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:55.271227 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0eabf4-b1e9-4950-9a28-5a4460ebea74 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:55.286277 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 986/1953] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:11:55.286277 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec7587-7cd4-4af5-9ac2-fd666b89ceb5 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:55.286563 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0eabf4-b1e9-4950-9a28-5a4460ebea74 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:55.289109 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7bc9ea-811e-4d38-8478-4cdde5d91c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:55.290104 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7bc9ea-811e-4d38-8478-4cdde5d91c61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:55.290437 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7bc9ea-811e-4d38-8478-4cdde5d91c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:55.290867 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7bc9ea-811e-4d38-8478-4cdde5d91c61 admin admin] PATH_INFO: `/v3/projects/8823aa9286034238bbc915ea2ea50ad3/users/80828a2580b648df9e37c4a52738470e/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:55.295899 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec7587-7cd4-4af5-9ac2-fd666b89ceb5 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:55.300901 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afbdfdb-f797-4ebb-b15c-a98e90400ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:55.301873 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afbdfdb-f797-4ebb-b15c-a98e90400ee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:55.302195 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afbdfdb-f797-4ebb-b15c-a98e90400ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:55.302466 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afbdfdb-f797-4ebb-b15c-a98e90400ee0 admin admin] PATH_INFO: `/v3/projects/dfc39ef63681446a82bc098157529340/users/cbea1cd44b514627a1ded2a5fb198ff1/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:55.304551 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afbdfdb-f797-4ebb-b15c-a98e90400ee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfc39ef63681446a82bc098157529340, user_id=cbea1cd44b514627a1ded2a5fb198ff1, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:55.307354 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afbdfdb-f797-4ebb-b15c-a98e90400ee0 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:55.309043 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7bc9ea-811e-4d38-8478-4cdde5d91c61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8823aa9286034238bbc915ea2ea50ad3, user_id=80828a2580b648df9e37c4a52738470e, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:55.312030 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7bc9ea-811e-4d38-8478-4cdde5d91c61 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:55.320733 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 987/1954] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:55 2022] PUT /identity/v3/projects/dfc39ef63681446a82bc098157529340/users/cbea1cd44b514627a1ded2a5fb198ff1/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:55.321329 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afbdfdb-f797-4ebb-b15c-a98e90400ee0 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:55.325662 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 968/1955] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:55 2022] PUT /identity/v3/projects/8823aa9286034238bbc915ea2ea50ad3/users/80828a2580b648df9e37c4a52738470e/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:55.332695 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c687e44-a463-4796-8994-9b1eaaecd27d None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:55.333057 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c687e44-a463-4796-8994-9b1eaaecd27d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:55.333426 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c687e44-a463-4796-8994-9b1eaaecd27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:55.351061 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:55.362069 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-8c687e44-a463-4796-8994-9b1eaaecd27d None None] MFA Rules not processed for user `cbea1cd44b514627a1ded2a5fb198ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:55.363847 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-8c687e44-a463-4796-8994-9b1eaaecd27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:55.392076 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afbdfdb-f797-4ebb-b15c-a98e90400ee0 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:55.434347 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 969/1956] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:55 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:11:55.435956 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0566cb-3e0d-4744-a7fc-ed0c0e67c0c9 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:55.436163 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0566cb-3e0d-4744-a7fc-ed0c0e67c0c9 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:55.436469 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0566cb-3e0d-4744-a7fc-ed0c0e67c0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:55.449773 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b1c33-fccb-4ad1-8cfd-305294da92fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:55.450495 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b1c33-fccb-4ad1-8cfd-305294da92fc admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:55.450875 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b1c33-fccb-4ad1-8cfd-305294da92fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:55.451213 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b1c33-fccb-4ad1-8cfd-305294da92fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:55.452284 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b1c33-fccb-4ad1-8cfd-305294da92fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:55.454052 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b1c33-fccb-4ad1-8cfd-305294da92fc admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:55.467140 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-0b0566cb-3e0d-4744-a7fc-ed0c0e67c0c9 None None] MFA Rules not processed for user `80828a2580b648df9e37c4a52738470e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:55.468364 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0b0566cb-3e0d-4744-a7fc-ed0c0e67c0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:55.483810 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 988/1957] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:11:55 2022] POST /identity/v3/projects => generated 391 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:55.483810 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b1c33-fccb-4ad1-8cfd-305294da92fc admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:55.483810 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-2f3b1c33-fccb-4ad1-8cfd-305294da92fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:55.508959 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:55.538436 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 970/1958] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:55 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:55.539363 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0566cb-3e0d-4744-a7fc-ed0c0e67c0c9 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:55.546382 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b1c33-fccb-4ad1-8cfd-305294da92fc admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:55.549555 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0566cb-3e0d-4744-a7fc-ed0c0e67c0c9 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:55.550806 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f672a-af00-4257-93dd-592c2fff9b43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:55.551998 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f672a-af00-4257-93dd-592c2fff9b43 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:55.552521 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f672a-af00-4257-93dd-592c2fff9b43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:55.552841 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f672a-af00-4257-93dd-592c2fff9b43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:55.606828 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede84d11-4ee6-40f9-bbdc-cece56727020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:55.607554 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede84d11-4ee6-40f9-bbdc-cece56727020 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:55.607844 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede84d11-4ee6-40f9-bbdc-cece56727020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:55.608125 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede84d11-4ee6-40f9-bbdc-cece56727020 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:55.608835 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede84d11-4ee6-40f9-bbdc-cece56727020 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:55.610834 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede84d11-4ee6-40f9-bbdc-cece56727020 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:55.618851 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f672a-af00-4257-93dd-592c2fff9b43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:55.620257 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f672a-af00-4257-93dd-592c2fff9b43 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:55.636166 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 971/1959] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:11:55 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:55.636323 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 989/1960] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:55 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:55.636416 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede84d11-4ee6-40f9-bbdc-cece56727020 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:55.639247 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f672a-af00-4257-93dd-592c2fff9b43 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:55.645614 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede84d11-4ee6-40f9-bbdc-cece56727020 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:55.652340 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3301a-2571-4a58-aa7e-ca3ed63db111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:55.653177 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3301a-2571-4a58-aa7e-ca3ed63db111 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:55.653569 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3301a-2571-4a58-aa7e-ca3ed63db111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:55.653852 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3301a-2571-4a58-aa7e-ca3ed63db111 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:55.654606 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f3301a-2571-4a58-aa7e-ca3ed63db111 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:55.655801 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f672a-af00-4257-93dd-592c2fff9b43 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:55.657702 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f3301a-2571-4a58-aa7e-ca3ed63db111 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:55.672239 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:55.680947 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad85ed-e772-46bf-8674-18a464bd48b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:55.682179 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad85ed-e772-46bf-8674-18a464bd48b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:55.682585 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad85ed-e772-46bf-8674-18a464bd48b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:55.684187 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad85ed-e772-46bf-8674-18a464bd48b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:55.685094 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad85ed-e772-46bf-8674-18a464bd48b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:55.689308 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad85ed-e772-46bf-8674-18a464bd48b3 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:55.696924 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 972/1961] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:11:55 2022] POST /identity/v3/projects => generated 407 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:55.700815 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3301a-2571-4a58-aa7e-ca3ed63db111 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:55.717673 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 990/1962] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:55.721997 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad85ed-e772-46bf-8674-18a464bd48b3 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:55.748103 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad85ed-e772-46bf-8674-18a464bd48b3 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:55.861865 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3301a-2571-4a58-aa7e-ca3ed63db111 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:55.877668 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5a343-514e-4479-a942-830a9f6b7be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:55.878702 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5a343-514e-4479-a942-830a9f6b7be8 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:55.879020 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5a343-514e-4479-a942-830a9f6b7be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:55.879388 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5a343-514e-4479-a942-830a9f6b7be8 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:55.880753 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a5a343-514e-4479-a942-830a9f6b7be8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:55.881624 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d3dc02-e4e2-4663-9557-ecf93f2a4489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:55.883472 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3dc02-e4e2-4663-9557-ecf93f2a4489 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:55.883591 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a5a343-514e-4479-a942-830a9f6b7be8 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:55.884050 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3dc02-e4e2-4663-9557-ecf93f2a4489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:55.884542 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3dc02-e4e2-4663-9557-ecf93f2a4489 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:55.885627 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d3dc02-e4e2-4663-9557-ecf93f2a4489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:55.887940 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d3dc02-e4e2-4663-9557-ecf93f2a4489 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:55.919793 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 991/1963] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 04:11:55.925143 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d3dc02-e4e2-4663-9557-ecf93f2a4489 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:55.928886 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 973/1964] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:11:55 2022] POST /identity/v3/users => generated 310 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:55.932432 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5a343-514e-4479-a942-830a9f6b7be8 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:55.953194 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5a343-514e-4479-a942-830a9f6b7be8 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:55.957126 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d3dc02-e4e2-4663-9557-ecf93f2a4489 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:55.978675 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825cbae-5593-49d8-98f8-56528c7a12d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:55.979584 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825cbae-5593-49d8-98f8-56528c7a12d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:55.979977 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825cbae-5593-49d8-98f8-56528c7a12d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:55.980378 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825cbae-5593-49d8-98f8-56528c7a12d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:55.981243 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5825cbae-5593-49d8-98f8-56528c7a12d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:55.981414 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce45be7-f6da-47e9-8c37-778fe8258ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:55.982794 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce45be7-f6da-47e9-8c37-778fe8258ba0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:55.983234 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce45be7-f6da-47e9-8c37-778fe8258ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:55.983864 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce45be7-f6da-47e9-8c37-778fe8258ba0 admin admin] PATH_INFO: `/v3/projects/575a951acdf84cc685721ff60978a58e/users/f4f65fe82d214a0db7e0aaac2fc6d7f9/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:55.984016 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5825cbae-5593-49d8-98f8-56528c7a12d5 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:56.000623 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 974/1965] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:56.005474 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825cbae-5593-49d8-98f8-56528c7a12d5 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:56.010916 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce45be7-f6da-47e9-8c37-778fe8258ba0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=575a951acdf84cc685721ff60978a58e, user_id=f4f65fe82d214a0db7e0aaac2fc6d7f9, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:56.013721 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce45be7-f6da-47e9-8c37-778fe8258ba0 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:56.032203 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825cbae-5593-49d8-98f8-56528c7a12d5 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:56.039701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d6076-b2ab-424d-8372-bad58ccdd069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:56.041248 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d6076-b2ab-424d-8372-bad58ccdd069 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:56.041547 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d6076-b2ab-424d-8372-bad58ccdd069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:56.042964 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d6076-b2ab-424d-8372-bad58ccdd069 admin admin] PATH_INFO: `/v3/projects/74ac5b58d01f434c9f12b5d23b498f1f/users/ba922628f67644379edb5f693574313e/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:56.051383 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 992/1966] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:55 2022] PUT /identity/v3/projects/575a951acdf84cc685721ff60978a58e/users/f4f65fe82d214a0db7e0aaac2fc6d7f9/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:56.066617 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514be38e-b19a-45ad-85e7-50f22ae842f2 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:56.066617 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514be38e-b19a-45ad-85e7-50f22ae842f2 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:56.066617 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514be38e-b19a-45ad-85e7-50f22ae842f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:56.092512 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d6076-b2ab-424d-8372-bad58ccdd069 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74ac5b58d01f434c9f12b5d23b498f1f, user_id=ba922628f67644379edb5f693574313e, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:56.095886 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d6076-b2ab-424d-8372-bad58ccdd069 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:56.109891 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-514be38e-b19a-45ad-85e7-50f22ae842f2 None None] MFA Rules not processed for user `f4f65fe82d214a0db7e0aaac2fc6d7f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:56.112096 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-514be38e-b19a-45ad-85e7-50f22ae842f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:56.117925 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 975/1967] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:56 2022] PUT /identity/v3/projects/74ac5b58d01f434c9f12b5d23b498f1f/users/ba922628f67644379edb5f693574313e/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:56.119131 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d6076-b2ab-424d-8372-bad58ccdd069 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:56.154907 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:56.241731 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 993/1968] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:56.243682 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514be38e-b19a-45ad-85e7-50f22ae842f2 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:56.249372 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d6076-b2ab-424d-8372-bad58ccdd069 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:56.254954 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be6de0-0b7d-4c5d-ba62-408c1c48a5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:56.255652 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be6de0-0b7d-4c5d-ba62-408c1c48a5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:56.256123 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be6de0-0b7d-4c5d-ba62-408c1c48a5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:56.256405 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be6de0-0b7d-4c5d-ba62-408c1c48a5f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:56.257154 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be6de0-0b7d-4c5d-ba62-408c1c48a5f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:56.259373 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be6de0-0b7d-4c5d-ba62-408c1c48a5f6 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:56.264426 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514be38e-b19a-45ad-85e7-50f22ae842f2 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:56.269962 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce0a2c-84f9-496a-a4d8-ab2c75b35467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:56.271164 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce0a2c-84f9-496a-a4d8-ab2c75b35467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:56.271668 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce0a2c-84f9-496a-a4d8-ab2c75b35467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:56.272019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce0a2c-84f9-496a-a4d8-ab2c75b35467 admin admin] PATH_INFO: `/v3/users/28e74e4925144a77b53447f3f581b984` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:56.274702 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 976/1969] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 04:11:56.275931 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce0a2c-84f9-496a-a4d8-ab2c75b35467 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28e74e4925144a77b53447f3f581b984)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:56.277941 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce0a2c-84f9-496a-a4d8-ab2c75b35467 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:56.279027 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be6de0-0b7d-4c5d-ba62-408c1c48a5f6 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:56.281819 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-66be6de0-0b7d-4c5d-ba62-408c1c48a5f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:56.338092 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-d5ce0a2c-84f9-496a-a4d8-ab2c75b35467 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28e74e4925144a77b53447f3f581b984'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:56.339561 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:56.348013 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-d5ce0a2c-84f9-496a-a4d8-ab2c75b35467 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28e74e4925144a77b53447f3f581b984'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:56.349629 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-d5ce0a2c-84f9-496a-a4d8-ab2c75b35467 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28e74e4925144a77b53447f3f581b984'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:56.354655 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be6de0-0b7d-4c5d-ba62-408c1c48a5f6 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:56.360654 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8571b72-5db5-40f2-8809-10afdb39e390 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:56.361204 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8571b72-5db5-40f2-8809-10afdb39e390 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:56.361574 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8571b72-5db5-40f2-8809-10afdb39e390 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:56.361923 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8571b72-5db5-40f2-8809-10afdb39e390 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:56.362716 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-d5ce0a2c-84f9-496a-a4d8-ab2c75b35467 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28e74e4925144a77b53447f3f581b984'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:56.363419 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-d5ce0a2c-84f9-496a-a4d8-ab2c75b35467 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28e74e4925144a77b53447f3f581b984'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:56.373816 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8571b72-5db5-40f2-8809-10afdb39e390 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:56.375331 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8571b72-5db5-40f2-8809-10afdb39e390 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:56.378961 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 994/1970] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:11:56 2022] DELETE /identity/v3/users/28e74e4925144a77b53447f3f581b984 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:56.379941 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce0a2c-84f9-496a-a4d8-ab2c75b35467 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:56.381336 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d5ce0a2c-84f9-496a-a4d8-ab2c75b35467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:56.387432 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 977/1971] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:56 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:56.388265 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8571b72-5db5-40f2-8809-10afdb39e390 service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:56.396702 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8571b72-5db5-40f2-8809-10afdb39e390 service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:56.453528 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce0a2c-84f9-496a-a4d8-ab2c75b35467 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:56.458909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccecfa5-53ea-433d-bcd2-84bfbb072e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:56.459387 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6418d-c6c9-4594-aaf8-36c28be6fcbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:56.459833 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccecfa5-53ea-433d-bcd2-84bfbb072e9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:56.460147 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccecfa5-53ea-433d-bcd2-84bfbb072e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:56.460400 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccecfa5-53ea-433d-bcd2-84bfbb072e9d admin admin] PATH_INFO: `/v3/projects/74ac5b58d01f434c9f12b5d23b498f1f/users/ba922628f67644379edb5f693574313e/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:56.460526 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6418d-c6c9-4594-aaf8-36c28be6fcbb service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:56.460726 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6418d-c6c9-4594-aaf8-36c28be6fcbb service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:56.461008 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6418d-c6c9-4594-aaf8-36c28be6fcbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:56.462548 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccecfa5-53ea-433d-bcd2-84bfbb072e9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=74ac5b58d01f434c9f12b5d23b498f1f, user_id=ba922628f67644379edb5f693574313e, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:56.462842 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-28f6418d-c6c9-4594-aaf8-36c28be6fcbb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:56.465273 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccecfa5-53ea-433d-bcd2-84bfbb072e9d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:56.486911 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 995/1972] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:56 2022] PUT /identity/v3/projects/74ac5b58d01f434c9f12b5d23b498f1f/users/ba922628f67644379edb5f693574313e/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:56.486911 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d5bb9-5421-4a5d-9a94-74f124957fc3 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:56.486911 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d5bb9-5421-4a5d-9a94-74f124957fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:56.486911 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d5bb9-5421-4a5d-9a94-74f124957fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:56.502450 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-7d1d5bb9-5421-4a5d-9a94-74f124957fc3 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:56.504170 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7d1d5bb9-5421-4a5d-9a94-74f124957fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:56.533891 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:56.554387 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f6418d-c6c9-4594-aaf8-36c28be6fcbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:56.555913 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f6418d-c6c9-4594-aaf8-36c28be6fcbb service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:56.567053 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 978/1973] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:56.572034 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c05d39-992f-476d-be84-3272bd02cb7a None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:56.572435 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c05d39-992f-476d-be84-3272bd02cb7a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:56.573177 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c05d39-992f-476d-be84-3272bd02cb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:56.580682 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 996/1974] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:56.592538 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d5bb9-5421-4a5d-9a94-74f124957fc3 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:56.594608 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7d1d5bb9-5421-4a5d-9a94-74f124957fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:56.613876 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-46c05d39-992f-476d-be84-3272bd02cb7a None None] MFA Rules not processed for user `ba922628f67644379edb5f693574313e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:56.615604 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-46c05d39-992f-476d-be84-3272bd02cb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:56.663543 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d5bb9-5421-4a5d-9a94-74f124957fc3 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:56.668524 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a034a8-06c7-42fd-8c45-43c062cd733f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:56.669412 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a034a8-06c7-42fd-8c45-43c062cd733f service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:56.669716 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a034a8-06c7-42fd-8c45-43c062cd733f service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:56.670002 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a034a8-06c7-42fd-8c45-43c062cd733f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:56.687033 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a034a8-06c7-42fd-8c45-43c062cd733f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:56.687033 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a034a8-06c7-42fd-8c45-43c062cd733f service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:56.693822 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 997/1975] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:56.733721 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 979/1976] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:56 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:56.774839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a034a8-06c7-42fd-8c45-43c062cd733f service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:56.776420 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-63a034a8-06c7-42fd-8c45-43c062cd733f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:56.863858 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a034a8-06c7-42fd-8c45-43c062cd733f service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:56.868978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2194a99-16c1-48c8-9596-12d3fb988b91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:56.869612 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2194a99-16c1-48c8-9596-12d3fb988b91 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:56.869995 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2194a99-16c1-48c8-9596-12d3fb988b91 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:56.870257 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2194a99-16c1-48c8-9596-12d3fb988b91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:56.882189 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2194a99-16c1-48c8-9596-12d3fb988b91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:56.883775 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2194a99-16c1-48c8-9596-12d3fb988b91 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:56.895793 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 998/1977] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:56 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:57.147311 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c05d39-992f-476d-be84-3272bd02cb7a None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:57.161643 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c05d39-992f-476d-be84-3272bd02cb7a None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:57.174185 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4b241-7211-4177-8900-8e680dea2140 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:57.174922 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4b241-7211-4177-8900-8e680dea2140 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:57.175240 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4b241-7211-4177-8900-8e680dea2140 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:57.175548 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4b241-7211-4177-8900-8e680dea2140 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:57.177505 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-36c4b241-7211-4177-8900-8e680dea2140 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:57.202923 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:57.251675 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4b241-7211-4177-8900-8e680dea2140 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:57.253503 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4b241-7211-4177-8900-8e680dea2140 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:57.274371 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 980/1978] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:57 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:11:57.292854 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2194a99-16c1-48c8-9596-12d3fb988b91 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:57.294490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d2194a99-16c1-48c8-9596-12d3fb988b91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:57.317899 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2194a99-16c1-48c8-9596-12d3fb988b91 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:57.323598 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac861375-41b1-45ab-ada7-bcf29230bba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:57.324648 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac861375-41b1-45ab-ada7-bcf29230bba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:57.325001 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac861375-41b1-45ab-ada7-bcf29230bba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:57.325291 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac861375-41b1-45ab-ada7-bcf29230bba5 admin admin] PATH_INFO: `/v3/projects/d5ae3eb123794aa496aef3efa6bdc963` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:57.326725 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac861375-41b1-45ab-ada7-bcf29230bba5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5ae3eb123794aa496aef3efa6bdc963)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:57.330055 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac861375-41b1-45ab-ada7-bcf29230bba5 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:57.392826 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ac861375-41b1-45ab-ada7-bcf29230bba5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5ae3eb123794aa496aef3efa6bdc963', 'request_id': 'req-ac861375-41b1-45ab-ada7-bcf29230bba5'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:57.402427 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ac861375-41b1-45ab-ada7-bcf29230bba5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5ae3eb123794aa496aef3efa6bdc963', 'request_id': 'req-ac861375-41b1-45ab-ada7-bcf29230bba5'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:57.410974 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ac861375-41b1-45ab-ada7-bcf29230bba5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5ae3eb123794aa496aef3efa6bdc963', 'request_id': 'req-ac861375-41b1-45ab-ada7-bcf29230bba5'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:57.420799 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:57.426460 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ac861375-41b1-45ab-ada7-bcf29230bba5 admin admin] The token cache is being invalidate because project d5ae3eb123794aa496aef3efa6bdc963 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:11:57.427205 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ac861375-41b1-45ab-ada7-bcf29230bba5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:57.428085 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ac861375-41b1-45ab-ada7-bcf29230bba5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:57.429960 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 999/1979] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:11:57 2022] DELETE /identity/v3/projects/d5ae3eb123794aa496aef3efa6bdc963 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:57.435213 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4b241-7211-4177-8900-8e680dea2140 service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:57.449856 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4b241-7211-4177-8900-8e680dea2140 service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:57.522749 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910dac0-9e36-4a6a-a472-24f14a2b35c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:57.524449 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910dac0-9e36-4a6a-a472-24f14a2b35c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:57.524806 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910dac0-9e36-4a6a-a472-24f14a2b35c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:57.525133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910dac0-9e36-4a6a-a472-24f14a2b35c1 admin admin] PATH_INFO: `/v3/users/cbea1cd44b514627a1ded2a5fb198ff1` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:57.526441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9910dac0-9e36-4a6a-a472-24f14a2b35c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbea1cd44b514627a1ded2a5fb198ff1)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:57.528446 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9910dac0-9e36-4a6a-a472-24f14a2b35c1 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:57.586386 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-9910dac0-9e36-4a6a-a472-24f14a2b35c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbea1cd44b514627a1ded2a5fb198ff1'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:57.587155 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-9910dac0-9e36-4a6a-a472-24f14a2b35c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbea1cd44b514627a1ded2a5fb198ff1'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:57.601620 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-9910dac0-9e36-4a6a-a472-24f14a2b35c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbea1cd44b514627a1ded2a5fb198ff1'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:57.616343 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-9910dac0-9e36-4a6a-a472-24f14a2b35c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbea1cd44b514627a1ded2a5fb198ff1'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:57.617462 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-9910dac0-9e36-4a6a-a472-24f14a2b35c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbea1cd44b514627a1ded2a5fb198ff1'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:57.633340 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 981/1980] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:11:57 2022] DELETE /identity/v3/users/cbea1cd44b514627a1ded2a5fb198ff1 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:57.918055 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac861375-41b1-45ab-ada7-bcf29230bba5 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:57.919573 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ac861375-41b1-45ab-ada7-bcf29230bba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:57.935340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac861375-41b1-45ab-ada7-bcf29230bba5 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:58.017967 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a86bc70-2365-4b3b-bcba-ed05a04090cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:58.020635 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86bc70-2365-4b3b-bcba-ed05a04090cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:58.021123 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86bc70-2365-4b3b-bcba-ed05a04090cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:58.021410 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86bc70-2365-4b3b-bcba-ed05a04090cb admin admin] PATH_INFO: `/v3/projects/dfc39ef63681446a82bc098157529340` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:58.023299 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a86bc70-2365-4b3b-bcba-ed05a04090cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfc39ef63681446a82bc098157529340)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:58.026378 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a86bc70-2365-4b3b-bcba-ed05a04090cb admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:58.098285 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6a86bc70-2365-4b3b-bcba-ed05a04090cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfc39ef63681446a82bc098157529340', 'request_id': 'req-6a86bc70-2365-4b3b-bcba-ed05a04090cb'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:58.107496 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6a86bc70-2365-4b3b-bcba-ed05a04090cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfc39ef63681446a82bc098157529340', 'request_id': 'req-6a86bc70-2365-4b3b-bcba-ed05a04090cb'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:58.122319 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6a86bc70-2365-4b3b-bcba-ed05a04090cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfc39ef63681446a82bc098157529340', 'request_id': 'req-6a86bc70-2365-4b3b-bcba-ed05a04090cb'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:58.138009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6a86bc70-2365-4b3b-bcba-ed05a04090cb admin admin] The token cache is being invalidate because project dfc39ef63681446a82bc098157529340 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:11:58.138335 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6a86bc70-2365-4b3b-bcba-ed05a04090cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:58.138983 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6a86bc70-2365-4b3b-bcba-ed05a04090cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:11:58.140706 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1000/1981] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:11:57 2022] DELETE /identity/v3/projects/dfc39ef63681446a82bc098157529340 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:58.148342 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc36792-3732-4202-b650-4afd2cafd0a0 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:58.148342 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc36792-3732-4202-b650-4afd2cafd0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:58.148919 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc36792-3732-4202-b650-4afd2cafd0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:58.172210 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-2cc36792-3732-4202-b650-4afd2cafd0a0 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:58.173600 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-2cc36792-3732-4202-b650-4afd2cafd0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:58.212566 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:58.267933 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 982/1982] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:58.271574 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867435fa-a920-4b3f-880a-b202a4a8ab1f None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:58.271890 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867435fa-a920-4b3f-880a-b202a4a8ab1f None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:58.272134 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867435fa-a920-4b3f-880a-b202a4a8ab1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:58.331131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-867435fa-a920-4b3f-880a-b202a4a8ab1f None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:58.336460 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-867435fa-a920-4b3f-880a-b202a4a8ab1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:58.355095 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1001/1983] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:58.359165 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc36792-3732-4202-b650-4afd2cafd0a0 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:58.373078 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc36792-3732-4202-b650-4afd2cafd0a0 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:58.383547 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a374271-ee88-4008-99b2-71b995afdf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:58.384318 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a374271-ee88-4008-99b2-71b995afdf2e admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:58.384668 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a374271-ee88-4008-99b2-71b995afdf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:58.385243 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a374271-ee88-4008-99b2-71b995afdf2e admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:58.387800 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a374271-ee88-4008-99b2-71b995afdf2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:11:58.387800 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a374271-ee88-4008-99b2-71b995afdf2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:58.387998 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a374271-ee88-4008-99b2-71b995afdf2e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:58.417424 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 983/1984] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:11:58.419567 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867435fa-a920-4b3f-880a-b202a4a8ab1f None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:58.433300 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867435fa-a920-4b3f-880a-b202a4a8ab1f None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:58.447876 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacab059-15ec-4716-bba8-1b8a1b7775c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:58.448660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacab059-15ec-4716-bba8-1b8a1b7775c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:58.449042 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacab059-15ec-4716-bba8-1b8a1b7775c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:58.449414 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacab059-15ec-4716-bba8-1b8a1b7775c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:58.450239 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacab059-15ec-4716-bba8-1b8a1b7775c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:58.453743 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacab059-15ec-4716-bba8-1b8a1b7775c7 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:58.502218 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1002/1985] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:11:58 2022] POST /identity/v3/projects => generated 375 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:58.504433 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a374271-ee88-4008-99b2-71b995afdf2e admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:58.524861 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204e622-6b18-4aee-9968-6ce4e6e991c6 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:58.525782 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a374271-ee88-4008-99b2-71b995afdf2e admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:58.526608 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204e622-6b18-4aee-9968-6ce4e6e991c6 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:58.527426 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204e622-6b18-4aee-9968-6ce4e6e991c6 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:58.537658 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1003/1986] 10.222.0.49 () {54 vars in 921 bytes} [Mon Jul 4 04:11:58 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:11:58.564113 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de846c-eb3d-4ef6-835b-abb4c8d8527d None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:58.567171 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de846c-eb3d-4ef6-835b-abb4c8d8527d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:58.567489 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de846c-eb3d-4ef6-835b-abb4c8d8527d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:58.611445 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-d3de846c-eb3d-4ef6-835b-abb4c8d8527d None None] MFA Rules not processed for user `8334e75253f843a980b01c6f0cda6015`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:58.613754 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d3de846c-eb3d-4ef6-835b-abb4c8d8527d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:58.660236 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d9232-95e9-4edd-9c82-406fa2739316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:58.661036 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d9232-95e9-4edd-9c82-406fa2739316 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:58.661330 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d9232-95e9-4edd-9c82-406fa2739316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:58.661610 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d9232-95e9-4edd-9c82-406fa2739316 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:58.662700 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d9232-95e9-4edd-9c82-406fa2739316 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:58.665065 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d9232-95e9-4edd-9c82-406fa2739316 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:58.703066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 984/1987] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:11:58 2022] POST /identity/v3/users => generated 288 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:58.705635 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d9232-95e9-4edd-9c82-406fa2739316 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:58.740545 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d9232-95e9-4edd-9c82-406fa2739316 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:58.747480 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:58.752844 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41296f0a-84d1-4b26-88cf-b1704c8336d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:58.753472 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41296f0a-84d1-4b26-88cf-b1704c8336d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:58.753729 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41296f0a-84d1-4b26-88cf-b1704c8336d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:58.754029 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41296f0a-84d1-4b26-88cf-b1704c8336d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:58.754834 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41296f0a-84d1-4b26-88cf-b1704c8336d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:58.757485 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41296f0a-84d1-4b26-88cf-b1704c8336d9 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:58.773374 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 985/1988] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 04:11:58.774507 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41296f0a-84d1-4b26-88cf-b1704c8336d9 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:58.784337 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1004/1989] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Jul 4 04:11:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:58.787608 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41296f0a-84d1-4b26-88cf-b1704c8336d9 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:58.792920 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d4aa3f-50a3-4a91-8deb-d976d1517f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:58.793402 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d4aa3f-50a3-4a91-8deb-d976d1517f77 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:58.793682 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d4aa3f-50a3-4a91-8deb-d976d1517f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:58.794028 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d4aa3f-50a3-4a91-8deb-d976d1517f77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:58.795245 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d4aa3f-50a3-4a91-8deb-d976d1517f77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:58.796766 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d4aa3f-50a3-4a91-8deb-d976d1517f77 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:58.800852 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de846c-eb3d-4ef6-835b-abb4c8d8527d None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:58.802951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d3de846c-eb3d-4ef6-835b-abb4c8d8527d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:58.812451 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 986/1990] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:58.816429 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d4aa3f-50a3-4a91-8deb-d976d1517f77 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:58.826638 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de846c-eb3d-4ef6-835b-abb4c8d8527d None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:58.829296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d4aa3f-50a3-4a91-8deb-d976d1517f77 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:58.834426 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77a2e7-c25d-47fc-85b5-2a59af927882 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:58.834687 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8848fcf-93ea-463c-a3b9-29a01276e112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:58.835495 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77a2e7-c25d-47fc-85b5-2a59af927882 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:58.835739 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8848fcf-93ea-463c-a3b9-29a01276e112 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:58.835837 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77a2e7-c25d-47fc-85b5-2a59af927882 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:58.836035 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8848fcf-93ea-463c-a3b9-29a01276e112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:58.836131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77a2e7-c25d-47fc-85b5-2a59af927882 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:58.836316 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8848fcf-93ea-463c-a3b9-29a01276e112 admin admin] PATH_INFO: `/v3/projects/1af657c8a5944c209eeacaac4bf9a6ae/users/e43cfb2abe424678a128c12f8b2df6dc/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:58.846605 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77a2e7-c25d-47fc-85b5-2a59af927882 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:58.848228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77a2e7-c25d-47fc-85b5-2a59af927882 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:58.853257 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8848fcf-93ea-463c-a3b9-29a01276e112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af657c8a5944c209eeacaac4bf9a6ae, user_id=e43cfb2abe424678a128c12f8b2df6dc, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:58.856316 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8848fcf-93ea-463c-a3b9-29a01276e112 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:58.859895 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1005/1991] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 04:11:58.872780 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 987/1992] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:58 2022] PUT /identity/v3/projects/1af657c8a5944c209eeacaac4bf9a6ae/users/e43cfb2abe424678a128c12f8b2df6dc/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:58.883892 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c13e3c-fcf6-4835-970b-bd5045ac1437 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:58.884295 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c13e3c-fcf6-4835-970b-bd5045ac1437 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:58.884589 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c13e3c-fcf6-4835-970b-bd5045ac1437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:58.915939 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-85c13e3c-fcf6-4835-970b-bd5045ac1437 None None] MFA Rules not processed for user `e43cfb2abe424678a128c12f8b2df6dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:58.917200 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-85c13e3c-fcf6-4835-970b-bd5045ac1437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:58.993587 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1006/1993] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:11:58.998496 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8848fcf-93ea-463c-a3b9-29a01276e112 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:59.062372 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8848fcf-93ea-463c-a3b9-29a01276e112 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:59.068773 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27490c7f-9926-4608-8618-64d6ebf20c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:59.069462 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27490c7f-9926-4608-8618-64d6ebf20c38 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:59.069747 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27490c7f-9926-4608-8618-64d6ebf20c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:59.070047 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27490c7f-9926-4608-8618-64d6ebf20c38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:59.070788 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27490c7f-9926-4608-8618-64d6ebf20c38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:59.072789 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27490c7f-9926-4608-8618-64d6ebf20c38 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:59.087282 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:59.105654 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 988/1994] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:11:58 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:59.106821 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c13e3c-fcf6-4835-970b-bd5045ac1437 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:59.118767 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c13e3c-fcf6-4835-970b-bd5045ac1437 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:59.181171 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a98ec-3311-4d3b-bc8f-2347b8e76ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:59.181864 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a98ec-3311-4d3b-bc8f-2347b8e76ea3 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:59.182164 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a98ec-3311-4d3b-bc8f-2347b8e76ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:59.182466 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a98ec-3311-4d3b-bc8f-2347b8e76ea3 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:59.183181 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a98ec-3311-4d3b-bc8f-2347b8e76ea3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:59.185210 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a98ec-3311-4d3b-bc8f-2347b8e76ea3 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:59.206024 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1007/1995] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:11:59 2022] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:11:59.210090 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27490c7f-9926-4608-8618-64d6ebf20c38 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:59.220705 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27490c7f-9926-4608-8618-64d6ebf20c38 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:59.226446 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c2072f-d838-4ef8-a458-8fd6235e3c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:59.227160 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2072f-d838-4ef8-a458-8fd6235e3c22 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:59.227469 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2072f-d838-4ef8-a458-8fd6235e3c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:59.227725 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2072f-d838-4ef8-a458-8fd6235e3c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:59.228528 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c2072f-d838-4ef8-a458-8fd6235e3c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:59.230569 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c2072f-d838-4ef8-a458-8fd6235e3c22 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:59.249356 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 989/1996] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 04:11:59.253661 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a98ec-3311-4d3b-bc8f-2347b8e76ea3 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:59.264344 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a98ec-3311-4d3b-bc8f-2347b8e76ea3 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:59.275393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0974255-e6bd-4584-87da-c45457dc9ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:59.276354 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0974255-e6bd-4584-87da-c45457dc9ee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:59.276639 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0974255-e6bd-4584-87da-c45457dc9ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:59.276919 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0974255-e6bd-4584-87da-c45457dc9ee0 admin admin] PATH_INFO: `/v3/projects/3183bba81bbf47688ee570bdf14d5390/users/304f1c25a7014027919faed5535af15f/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:59.293735 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0974255-e6bd-4584-87da-c45457dc9ee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3183bba81bbf47688ee570bdf14d5390, user_id=304f1c25a7014027919faed5535af15f, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:59.296577 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0974255-e6bd-4584-87da-c45457dc9ee0 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:59.311718 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1008/1997] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:59 2022] PUT /identity/v3/projects/3183bba81bbf47688ee570bdf14d5390/users/304f1c25a7014027919faed5535af15f/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:59.316016 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c2072f-d838-4ef8-a458-8fd6235e3c22 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:59.327628 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c2072f-d838-4ef8-a458-8fd6235e3c22 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:59.386798 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da43533-547f-4ce6-9757-b2bea02fc7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:59.387549 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da43533-547f-4ce6-9757-b2bea02fc7ab admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:59.387832 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da43533-547f-4ce6-9757-b2bea02fc7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:59.388111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da43533-547f-4ce6-9757-b2bea02fc7ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:59.388860 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da43533-547f-4ce6-9757-b2bea02fc7ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:59.390544 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da43533-547f-4ce6-9757-b2bea02fc7ab admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:59.401807 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 990/1998] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:11:59.406478 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0974255-e6bd-4584-87da-c45457dc9ee0 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:59.419634 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0974255-e6bd-4584-87da-c45457dc9ee0 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:59.424958 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888dd00b-37f6-462c-b78b-828851d6f1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:59.425897 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dd00b-37f6-462c-b78b-828851d6f1a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:59.426237 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dd00b-37f6-462c-b78b-828851d6f1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:59.426505 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dd00b-37f6-462c-b78b-828851d6f1a8 admin admin] PATH_INFO: `/v3/projects/3183bba81bbf47688ee570bdf14d5390/users/304f1c25a7014027919faed5535af15f/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:59.428726 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888dd00b-37f6-462c-b78b-828851d6f1a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3183bba81bbf47688ee570bdf14d5390, user_id=304f1c25a7014027919faed5535af15f, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:59.431513 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888dd00b-37f6-462c-b78b-828851d6f1a8 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:59.444327 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1009/1999] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:11:59 2022] PUT /identity/v3/projects/3183bba81bbf47688ee570bdf14d5390/users/304f1c25a7014027919faed5535af15f/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:11:59.456403 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9caa9d3-672b-4ab3-a7b3-87cf562e513a None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:59.456762 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9caa9d3-672b-4ab3-a7b3-87cf562e513a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:59.457097 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9caa9d3-672b-4ab3-a7b3-87cf562e513a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:59.489284 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-a9caa9d3-672b-4ab3-a7b3-87cf562e513a None None] MFA Rules not processed for user `304f1c25a7014027919faed5535af15f`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:11:59.489753 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a9caa9d3-672b-4ab3-a7b3-87cf562e513a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:59.569930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 991/2000] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:11:59 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:11:59.591539 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888dd00b-37f6-462c-b78b-828851d6f1a8 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:11:59.593686 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-888dd00b-37f6-462c-b78b-828851d6f1a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:11:59.620116 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:11:59.657104 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888dd00b-37f6-462c-b78b-828851d6f1a8 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:11:59.661514 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20d903-869e-497d-987c-9adebe388d2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:11:59.662325 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20d903-869e-497d-987c-9adebe388d2d service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:11:59.662687 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20d903-869e-497d-987c-9adebe388d2d service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:11:59.662975 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20d903-869e-497d-987c-9adebe388d2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:11:59.750021 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d20d903-869e-497d-987c-9adebe388d2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:11:59.753458 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d20d903-869e-497d-987c-9adebe388d2d service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:11:59.763873 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1010/2001] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:11:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:12:01.785074 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9caa9d3-672b-4ab3-a7b3-87cf562e513a None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:01.786812 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a9caa9d3-672b-4ab3-a7b3-87cf562e513a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:01.887545 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9caa9d3-672b-4ab3-a7b3-87cf562e513a None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:01.894182 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa5c97-4e48-4903-bbb2-b29f57d7b3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:01.895194 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa5c97-4e48-4903-bbb2-b29f57d7b3db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:01.895426 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa5c97-4e48-4903-bbb2-b29f57d7b3db admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:01.895763 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa5c97-4e48-4903-bbb2-b29f57d7b3db admin admin] PATH_INFO: `/v3/users/77ab88ca47174b3ba6f8e2ecd0bca95c` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:01.897201 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caa5c97-4e48-4903-bbb2-b29f57d7b3db admin admin] RBAC: Authorizing `identity:delete_user(user_id=77ab88ca47174b3ba6f8e2ecd0bca95c)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:01.899367 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caa5c97-4e48-4903-bbb2-b29f57d7b3db admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:01.908543 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:01.981463 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5caa5c97-4e48-4903-bbb2-b29f57d7b3db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77ab88ca47174b3ba6f8e2ecd0bca95c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:01.982144 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5caa5c97-4e48-4903-bbb2-b29f57d7b3db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77ab88ca47174b3ba6f8e2ecd0bca95c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:01.995357 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5caa5c97-4e48-4903-bbb2-b29f57d7b3db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77ab88ca47174b3ba6f8e2ecd0bca95c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:02.011255 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5caa5c97-4e48-4903-bbb2-b29f57d7b3db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77ab88ca47174b3ba6f8e2ecd0bca95c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:02.012062 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5caa5c97-4e48-4903-bbb2-b29f57d7b3db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77ab88ca47174b3ba6f8e2ecd0bca95c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:02.029520 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 992/2002] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:12:01 2022] DELETE /identity/v3/users/77ab88ca47174b3ba6f8e2ecd0bca95c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:02.031465 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d379b8a-ebf7-49dc-b4b3-ee23b74e5852 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:02.031951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d379b8a-ebf7-49dc-b4b3-ee23b74e5852 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:02.032042 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d379b8a-ebf7-49dc-b4b3-ee23b74e5852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:02.055715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-8d379b8a-ebf7-49dc-b4b3-ee23b74e5852 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:02.056937 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-8d379b8a-ebf7-49dc-b4b3-ee23b74e5852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:02.151123 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1011/2003] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:12:02.161010 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa5c97-4e48-4903-bbb2-b29f57d7b3db admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:02.162493 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5caa5c97-4e48-4903-bbb2-b29f57d7b3db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:02.227100 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa5c97-4e48-4903-bbb2-b29f57d7b3db admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:02.231069 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aab46b-e66a-4fd7-a27b-aa2e20ecadf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:02.231808 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aab46b-e66a-4fd7-a27b-aa2e20ecadf8 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:02.232159 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aab46b-e66a-4fd7-a27b-aa2e20ecadf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:02.232502 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aab46b-e66a-4fd7-a27b-aa2e20ecadf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:02.245781 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aab46b-e66a-4fd7-a27b-aa2e20ecadf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:02.247920 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aab46b-e66a-4fd7-a27b-aa2e20ecadf8 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:02.260313 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 993/2004] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:12:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:12:02.430947 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d379b8a-ebf7-49dc-b4b3-ee23b74e5852 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:02.432603 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-8d379b8a-ebf7-49dc-b4b3-ee23b74e5852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:02.499343 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d379b8a-ebf7-49dc-b4b3-ee23b74e5852 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:02.503221 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5e5b0-c01a-4116-93ef-7e518cab35d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:02.503889 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5e5b0-c01a-4116-93ef-7e518cab35d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:02.504175 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5e5b0-c01a-4116-93ef-7e518cab35d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:02.504457 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5e5b0-c01a-4116-93ef-7e518cab35d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:02.506766 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-53e5e5b0-c01a-4116-93ef-7e518cab35d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:02.540247 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:02.580655 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e5e5b0-c01a-4116-93ef-7e518cab35d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:02.582432 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e5e5b0-c01a-4116-93ef-7e518cab35d3 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:02.594236 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1012/2005] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:12:02 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:12:02.654636 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aab46b-e66a-4fd7-a27b-aa2e20ecadf8 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:02.656996 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e4aab46b-e66a-4fd7-a27b-aa2e20ecadf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:02.681233 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aab46b-e66a-4fd7-a27b-aa2e20ecadf8 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:02.686758 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893a507-bedc-4fa6-a9f0-3deab4c39479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:02.687670 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893a507-bedc-4fa6-a9f0-3deab4c39479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:02.687966 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893a507-bedc-4fa6-a9f0-3deab4c39479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:02.688246 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893a507-bedc-4fa6-a9f0-3deab4c39479 admin admin] PATH_INFO: `/v3/projects/13b111b739954a00bc3b530946517742` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:02.689975 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1893a507-bedc-4fa6-a9f0-3deab4c39479 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13b111b739954a00bc3b530946517742)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:02.692058 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1893a507-bedc-4fa6-a9f0-3deab4c39479 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:02.775170 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-1893a507-bedc-4fa6-a9f0-3deab4c39479 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13b111b739954a00bc3b530946517742', 'request_id': 'req-1893a507-bedc-4fa6-a9f0-3deab4c39479'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:02.786098 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-1893a507-bedc-4fa6-a9f0-3deab4c39479 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13b111b739954a00bc3b530946517742', 'request_id': 'req-1893a507-bedc-4fa6-a9f0-3deab4c39479'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:02.796769 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-1893a507-bedc-4fa6-a9f0-3deab4c39479 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13b111b739954a00bc3b530946517742', 'request_id': 'req-1893a507-bedc-4fa6-a9f0-3deab4c39479'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:02.823887 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-1893a507-bedc-4fa6-a9f0-3deab4c39479 admin admin] The token cache is being invalidate because project 13b111b739954a00bc3b530946517742 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:12:02.824448 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-1893a507-bedc-4fa6-a9f0-3deab4c39479 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:02.825662 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-1893a507-bedc-4fa6-a9f0-3deab4c39479 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:02.828205 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 994/2006] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:12:02 2022] DELETE /identity/v3/projects/13b111b739954a00bc3b530946517742 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:02.833066 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5e5b0-c01a-4116-93ef-7e518cab35d3 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:02.853488 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5e5b0-c01a-4116-93ef-7e518cab35d3 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:02.927523 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb14dce-0e8f-4f03-94ed-55c1c06528a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:02.929620 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb14dce-0e8f-4f03-94ed-55c1c06528a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:02.930136 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb14dce-0e8f-4f03-94ed-55c1c06528a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:02.930602 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb14dce-0e8f-4f03-94ed-55c1c06528a2 admin admin] PATH_INFO: `/v3/users/271feeb0419349c992eae0ddb26c05c6` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:02.932338 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb14dce-0e8f-4f03-94ed-55c1c06528a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=271feeb0419349c992eae0ddb26c05c6)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:02.934978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb14dce-0e8f-4f03-94ed-55c1c06528a2 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:03.026714 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-cbb14dce-0e8f-4f03-94ed-55c1c06528a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '271feeb0419349c992eae0ddb26c05c6'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:03.045672 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-cbb14dce-0e8f-4f03-94ed-55c1c06528a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '271feeb0419349c992eae0ddb26c05c6'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:03.046901 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-cbb14dce-0e8f-4f03-94ed-55c1c06528a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '271feeb0419349c992eae0ddb26c05c6'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:03.066334 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-cbb14dce-0e8f-4f03-94ed-55c1c06528a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '271feeb0419349c992eae0ddb26c05c6'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:03.067243 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-cbb14dce-0e8f-4f03-94ed-55c1c06528a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '271feeb0419349c992eae0ddb26c05c6'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:03.086971 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1013/2007] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:12:02 2022] DELETE /identity/v3/users/271feeb0419349c992eae0ddb26c05c6 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:03.098662 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893a507-bedc-4fa6-a9f0-3deab4c39479 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:03.100180 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1893a507-bedc-4fa6-a9f0-3deab4c39479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:03.119665 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893a507-bedc-4fa6-a9f0-3deab4c39479 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:03.134680 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:03.221994 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fdbe2-2728-412b-bd72-3fe7bfc63b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:03.223084 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fdbe2-2728-412b-bd72-3fe7bfc63b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:03.223695 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fdbe2-2728-412b-bd72-3fe7bfc63b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:03.223980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fdbe2-2728-412b-bd72-3fe7bfc63b69 admin admin] PATH_INFO: `/v3/users/80828a2580b648df9e37c4a52738470e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:03.225280 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903fdbe2-2728-412b-bd72-3fe7bfc63b69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80828a2580b648df9e37c4a52738470e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:03.227504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903fdbe2-2728-412b-bd72-3fe7bfc63b69 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:03.289192 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-903fdbe2-2728-412b-bd72-3fe7bfc63b69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80828a2580b648df9e37c4a52738470e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:03.292869 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-903fdbe2-2728-412b-bd72-3fe7bfc63b69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80828a2580b648df9e37c4a52738470e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:03.306687 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-903fdbe2-2728-412b-bd72-3fe7bfc63b69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80828a2580b648df9e37c4a52738470e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:03.324073 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-903fdbe2-2728-412b-bd72-3fe7bfc63b69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80828a2580b648df9e37c4a52738470e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:03.325075 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-903fdbe2-2728-412b-bd72-3fe7bfc63b69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80828a2580b648df9e37c4a52738470e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:03.345332 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 995/2008] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:12:03 2022] DELETE /identity/v3/users/80828a2580b648df9e37c4a52738470e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:03.349888 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf44cf-e999-4114-a0a6-e64d11dd18c5 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:03.350208 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf44cf-e999-4114-a0a6-e64d11dd18c5 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:03.350503 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf44cf-e999-4114-a0a6-e64d11dd18c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:03.372885 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-e9bf44cf-e999-4114-a0a6-e64d11dd18c5 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:03.374127 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e9bf44cf-e999-4114-a0a6-e64d11dd18c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:03.439783 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:03.468416 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1014/2009] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:03.489322 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fdbe2-2728-412b-bd72-3fe7bfc63b69 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:03.490825 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-903fdbe2-2728-412b-bd72-3fe7bfc63b69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:03.570018 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf44cf-e999-4114-a0a6-e64d11dd18c5 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:03.572074 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e9bf44cf-e999-4114-a0a6-e64d11dd18c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:03.590246 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fdbe2-2728-412b-bd72-3fe7bfc63b69 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:03.590991 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf44cf-e999-4114-a0a6-e64d11dd18c5 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:03.594616 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd272a-db10-4345-a9bd-d86f0762c1b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:03.595585 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd272a-db10-4345-a9bd-d86f0762c1b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:03.595887 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd272a-db10-4345-a9bd-d86f0762c1b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:03.596173 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd272a-db10-4345-a9bd-d86f0762c1b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:03.599496 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891ab43-c6a0-4485-bc7f-1f89b1d0a023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:03.600812 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891ab43-c6a0-4485-bc7f-1f89b1d0a023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:03.601139 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891ab43-c6a0-4485-bc7f-1f89b1d0a023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:03.601407 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891ab43-c6a0-4485-bc7f-1f89b1d0a023 admin admin] PATH_INFO: `/v3/projects/5fbc2e931ec64df7bcc3e30538d44a66` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:03.602896 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891ab43-c6a0-4485-bc7f-1f89b1d0a023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fbc2e931ec64df7bcc3e30538d44a66)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:03.606001 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891ab43-c6a0-4485-bc7f-1f89b1d0a023 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:03.615945 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd272a-db10-4345-a9bd-d86f0762c1b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:03.619828 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd272a-db10-4345-a9bd-d86f0762c1b0 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:03.634797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 996/2010] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:12:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:12:03.675640 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7891ab43-c6a0-4485-bc7f-1f89b1d0a023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fbc2e931ec64df7bcc3e30538d44a66', 'request_id': 'req-7891ab43-c6a0-4485-bc7f-1f89b1d0a023'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:03.684619 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7891ab43-c6a0-4485-bc7f-1f89b1d0a023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fbc2e931ec64df7bcc3e30538d44a66', 'request_id': 'req-7891ab43-c6a0-4485-bc7f-1f89b1d0a023'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:03.692499 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7891ab43-c6a0-4485-bc7f-1f89b1d0a023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fbc2e931ec64df7bcc3e30538d44a66', 'request_id': 'req-7891ab43-c6a0-4485-bc7f-1f89b1d0a023'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:03.707416 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7891ab43-c6a0-4485-bc7f-1f89b1d0a023 admin admin] The token cache is being invalidate because project 5fbc2e931ec64df7bcc3e30538d44a66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:12:03.707707 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7891ab43-c6a0-4485-bc7f-1f89b1d0a023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:03.708626 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7891ab43-c6a0-4485-bc7f-1f89b1d0a023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:03.710600 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1015/2011] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:12:03 2022] DELETE /identity/v3/projects/5fbc2e931ec64df7bcc3e30538d44a66 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:03.719110 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c422e8d-6af8-496b-a074-8444c7b05af4 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:03.719358 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c422e8d-6af8-496b-a074-8444c7b05af4 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:03.719698 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c422e8d-6af8-496b-a074-8444c7b05af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:03.739463 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-7c422e8d-6af8-496b-a074-8444c7b05af4 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:03.740712 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-7c422e8d-6af8-496b-a074-8444c7b05af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:03.769180 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:03.813035 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 997/2012] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:12:03.821575 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3e43f-c371-4725-b862-4b82afc79222 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:03.821938 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3e43f-c371-4725-b862-4b82afc79222 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:03.822284 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3e43f-c371-4725-b862-4b82afc79222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:03.841459 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-76e3e43f-c371-4725-b862-4b82afc79222 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:03.842719 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-76e3e43f-c371-4725-b862-4b82afc79222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:03.851487 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1016/2013] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:03.855612 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c422e8d-6af8-496b-a074-8444c7b05af4 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:03.865411 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c422e8d-6af8-496b-a074-8444c7b05af4 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:03.870513 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973ac93-2279-4b66-8a73-28dfa3b1e655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:03.871348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973ac93-2279-4b66-8a73-28dfa3b1e655 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:03.871647 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973ac93-2279-4b66-8a73-28dfa3b1e655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:03.871927 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973ac93-2279-4b66-8a73-28dfa3b1e655 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:03.872754 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973ac93-2279-4b66-8a73-28dfa3b1e655 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:12:03.873068 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973ac93-2279-4b66-8a73-28dfa3b1e655 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:03.875020 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973ac93-2279-4b66-8a73-28dfa3b1e655 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:03.888603 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 998/2014] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:12:03.893185 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3e43f-c371-4725-b862-4b82afc79222 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:03.904424 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3e43f-c371-4725-b862-4b82afc79222 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:03.909562 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b4c19-6d80-4b4c-a02a-0452982ac845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:03.910404 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b4c19-6d80-4b4c-a02a-0452982ac845 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:03.910707 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b4c19-6d80-4b4c-a02a-0452982ac845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:03.911002 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b4c19-6d80-4b4c-a02a-0452982ac845 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:03.911945 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36b4c19-6d80-4b4c-a02a-0452982ac845 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:03.914032 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36b4c19-6d80-4b4c-a02a-0452982ac845 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:03.920347 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973ac93-2279-4b66-8a73-28dfa3b1e655 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:03.922578 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-7973ac93-2279-4b66-8a73-28dfa3b1e655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:03.941327 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973ac93-2279-4b66-8a73-28dfa3b1e655 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:03.947861 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c38fb2-5821-47ef-94fd-c8c1719cba90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:03.948773 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c38fb2-5821-47ef-94fd-c8c1719cba90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:03.949231 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c38fb2-5821-47ef-94fd-c8c1719cba90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:03.949526 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c38fb2-5821-47ef-94fd-c8c1719cba90 admin admin] PATH_INFO: `/v3/projects/8823aa9286034238bbc915ea2ea50ad3` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:03.950923 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c38fb2-5821-47ef-94fd-c8c1719cba90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8823aa9286034238bbc915ea2ea50ad3)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:03.953609 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c38fb2-5821-47ef-94fd-c8c1719cba90 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:03.961160 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1017/2015] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:12:03 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:12:03.966491 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b4c19-6d80-4b4c-a02a-0452982ac845 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:04.011858 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-07c38fb2-5821-47ef-94fd-c8c1719cba90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8823aa9286034238bbc915ea2ea50ad3', 'request_id': 'req-07c38fb2-5821-47ef-94fd-c8c1719cba90'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:04.017347 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-07c38fb2-5821-47ef-94fd-c8c1719cba90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8823aa9286034238bbc915ea2ea50ad3', 'request_id': 'req-07c38fb2-5821-47ef-94fd-c8c1719cba90'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:04.024457 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-07c38fb2-5821-47ef-94fd-c8c1719cba90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8823aa9286034238bbc915ea2ea50ad3', 'request_id': 'req-07c38fb2-5821-47ef-94fd-c8c1719cba90'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:04.043983 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-07c38fb2-5821-47ef-94fd-c8c1719cba90 admin admin] The token cache is being invalidate because project 8823aa9286034238bbc915ea2ea50ad3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:12:04.044473 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-07c38fb2-5821-47ef-94fd-c8c1719cba90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:04.045091 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-07c38fb2-5821-47ef-94fd-c8c1719cba90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:04.045634 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b4c19-6d80-4b4c-a02a-0452982ac845 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:04.047722 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 999/2016] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:12:03 2022] DELETE /identity/v3/projects/8823aa9286034238bbc915ea2ea50ad3 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 04:12:04.052665 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c38fb2-5821-47ef-94fd-c8c1719cba90 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:04.055162 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-07c38fb2-5821-47ef-94fd-c8c1719cba90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:04.113778 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:04.132189 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d93b879-ff89-4bea-941f-c7e63216860d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:04.132982 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93b879-ff89-4bea-941f-c7e63216860d admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:04.133351 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93b879-ff89-4bea-941f-c7e63216860d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:04.133735 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93b879-ff89-4bea-941f-c7e63216860d admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:04.134795 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d93b879-ff89-4bea-941f-c7e63216860d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:04.136972 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d93b879-ff89-4bea-941f-c7e63216860d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:04.163949 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c38fb2-5821-47ef-94fd-c8c1719cba90 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:04.183652 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1018/2017] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:12:03 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:12:04.189102 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d93b879-ff89-4bea-941f-c7e63216860d admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:04.192050 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-2d93b879-ff89-4bea-941f-c7e63216860d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:04.193071 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be1595-fbce-438b-b7e8-009264aafc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:04.194993 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be1595-fbce-438b-b7e8-009264aafc6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:04.195296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be1595-fbce-438b-b7e8-009264aafc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:04.196276 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be1595-fbce-438b-b7e8-009264aafc6c admin admin] PATH_INFO: `/v3/users/ba922628f67644379edb5f693574313e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:04.198734 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be1595-fbce-438b-b7e8-009264aafc6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba922628f67644379edb5f693574313e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:04.206377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be1595-fbce-438b-b7e8-009264aafc6c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:04.220465 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d93b879-ff89-4bea-941f-c7e63216860d admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:04.226283 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93a324-a54b-401e-9292-838b07f471ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:04.227126 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93a324-a54b-401e-9292-838b07f471ac admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:04.227509 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93a324-a54b-401e-9292-838b07f471ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:04.227920 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93a324-a54b-401e-9292-838b07f471ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:04.228773 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d93a324-a54b-401e-9292-838b07f471ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:04.230566 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d93a324-a54b-401e-9292-838b07f471ac admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:04.246027 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1019/2018] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:12:04.247015 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93a324-a54b-401e-9292-838b07f471ac admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:04.265303 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93a324-a54b-401e-9292-838b07f471ac admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:04.274129 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902f203-6870-4c7a-beda-0b82dadeb634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:04.276382 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902f203-6870-4c7a-beda-0b82dadeb634 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:04.276382 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902f203-6870-4c7a-beda-0b82dadeb634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:04.278357 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902f203-6870-4c7a-beda-0b82dadeb634 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:04.279629 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902f203-6870-4c7a-beda-0b82dadeb634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:04.284959 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902f203-6870-4c7a-beda-0b82dadeb634 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:04.310869 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1020/2019] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:12:04.315974 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902f203-6870-4c7a-beda-0b82dadeb634 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:04.339906 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902f203-6870-4c7a-beda-0b82dadeb634 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:04.348402 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:04.357429 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d0be1595-fbce-438b-b7e8-009264aafc6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba922628f67644379edb5f693574313e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:04.359085 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e66704-551b-4ccc-8214-a5c3a5dd4b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:04.359622 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d0be1595-fbce-438b-b7e8-009264aafc6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba922628f67644379edb5f693574313e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:04.360015 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e66704-551b-4ccc-8214-a5c3a5dd4b19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:04.360654 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e66704-551b-4ccc-8214-a5c3a5dd4b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:04.360654 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e66704-551b-4ccc-8214-a5c3a5dd4b19 admin admin] PATH_INFO: `/v3/projects/67fed331761f4b6ca6ba9513001fff51/users/77116c0219514c7c8d6a160fca132284/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:04.377352 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d0be1595-fbce-438b-b7e8-009264aafc6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba922628f67644379edb5f693574313e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:04.393641 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e66704-551b-4ccc-8214-a5c3a5dd4b19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67fed331761f4b6ca6ba9513001fff51, user_id=77116c0219514c7c8d6a160fca132284, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:04.396066 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e66704-551b-4ccc-8214-a5c3a5dd4b19 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:04.414068 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d0be1595-fbce-438b-b7e8-009264aafc6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba922628f67644379edb5f693574313e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:04.418501 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1021/2020] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:12:04 2022] PUT /identity/v3/projects/67fed331761f4b6ca6ba9513001fff51/users/77116c0219514c7c8d6a160fca132284/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:04.418829 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d0be1595-fbce-438b-b7e8-009264aafc6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba922628f67644379edb5f693574313e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:04.431248 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22dfec-9942-419a-8d68-c614935a7542 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:04.431783 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22dfec-9942-419a-8d68-c614935a7542 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:04.432284 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22dfec-9942-419a-8d68-c614935a7542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:04.452360 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1000/2021] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:12:04 2022] DELETE /identity/v3/users/ba922628f67644379edb5f693574313e => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:04.518069 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-de22dfec-9942-419a-8d68-c614935a7542 None None] MFA Rules not processed for user `77116c0219514c7c8d6a160fca132284`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:04.519355 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-de22dfec-9942-419a-8d68-c614935a7542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:04.616520 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1022/2022] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:12:04.630106 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be1595-fbce-438b-b7e8-009264aafc6c admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:04.631993 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d0be1595-fbce-438b-b7e8-009264aafc6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:04.750449 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be1595-fbce-438b-b7e8-009264aafc6c admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:04.759158 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e1e92-96f4-4023-9ba1-8125b7959816 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:04.759848 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e1e92-96f4-4023-9ba1-8125b7959816 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:04.760141 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e1e92-96f4-4023-9ba1-8125b7959816 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:04.760427 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e1e92-96f4-4023-9ba1-8125b7959816 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:04.770229 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e1e92-96f4-4023-9ba1-8125b7959816 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:04.771769 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e1e92-96f4-4023-9ba1-8125b7959816 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:04.782634 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1001/2023] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:12:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:12:05.652939 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22dfec-9942-419a-8d68-c614935a7542 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:05.655449 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-de22dfec-9942-419a-8d68-c614935a7542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:05.762916 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22dfec-9942-419a-8d68-c614935a7542 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:05.770433 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a40d2-db15-441c-9217-e694b9dc5a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:05.771412 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a40d2-db15-441c-9217-e694b9dc5a15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:05.771773 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a40d2-db15-441c-9217-e694b9dc5a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:05.772114 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a40d2-db15-441c-9217-e694b9dc5a15 admin admin] PATH_INFO: `/v3/projects/74ac5b58d01f434c9f12b5d23b498f1f` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:05.773474 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a40d2-db15-441c-9217-e694b9dc5a15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74ac5b58d01f434c9f12b5d23b498f1f)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:05.775511 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a40d2-db15-441c-9217-e694b9dc5a15 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:05.804485 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:05.848145 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0c2a40d2-db15-441c-9217-e694b9dc5a15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74ac5b58d01f434c9f12b5d23b498f1f', 'request_id': 'req-0c2a40d2-db15-441c-9217-e694b9dc5a15'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:05.862642 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0c2a40d2-db15-441c-9217-e694b9dc5a15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74ac5b58d01f434c9f12b5d23b498f1f', 'request_id': 'req-0c2a40d2-db15-441c-9217-e694b9dc5a15'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:05.878302 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0c2a40d2-db15-441c-9217-e694b9dc5a15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74ac5b58d01f434c9f12b5d23b498f1f', 'request_id': 'req-0c2a40d2-db15-441c-9217-e694b9dc5a15'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:05.903796 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0c2a40d2-db15-441c-9217-e694b9dc5a15 admin admin] The token cache is being invalidate because project 74ac5b58d01f434c9f12b5d23b498f1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:12:05.904451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0c2a40d2-db15-441c-9217-e694b9dc5a15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:05.905489 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0c2a40d2-db15-441c-9217-e694b9dc5a15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:05.912336 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1023/2024] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:12:05 2022] DELETE /identity/v3/projects/74ac5b58d01f434c9f12b5d23b498f1f => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:05.913940 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f3fa4-9861-4fd5-87ec-990099b94e8f None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:05.914466 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f3fa4-9861-4fd5-87ec-990099b94e8f None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:05.914750 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f3fa4-9861-4fd5-87ec-990099b94e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:05.933753 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-821f3fa4-9861-4fd5-87ec-990099b94e8f None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:05.935050 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-821f3fa4-9861-4fd5-87ec-990099b94e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:05.997269 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1002/2025] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:12:06.005778 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0da5d-1473-4c50-9b28-f6914adbfc89 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:06.006009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0da5d-1473-4c50-9b28-f6914adbfc89 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:06.006943 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0da5d-1473-4c50-9b28-f6914adbfc89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:06.026386 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-9eb0da5d-1473-4c50-9b28-f6914adbfc89 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:06.027668 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9eb0da5d-1473-4c50-9b28-f6914adbfc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:06.036689 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1024/2026] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:06.041186 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f3fa4-9861-4fd5-87ec-990099b94e8f None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:06.052099 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f3fa4-9861-4fd5-87ec-990099b94e8f None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:06.057560 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282457e-f228-4d60-9b5f-7e49e8cb0f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:06.058271 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282457e-f228-4d60-9b5f-7e49e8cb0f22 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:06.058561 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282457e-f228-4d60-9b5f-7e49e8cb0f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:06.058845 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282457e-f228-4d60-9b5f-7e49e8cb0f22 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:06.059588 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282457e-f228-4d60-9b5f-7e49e8cb0f22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:12:06.059902 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282457e-f228-4d60-9b5f-7e49e8cb0f22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:06.061552 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282457e-f228-4d60-9b5f-7e49e8cb0f22 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:06.073777 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1003/2027] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:12:06.078138 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0da5d-1473-4c50-9b28-f6914adbfc89 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:06.087676 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0da5d-1473-4c50-9b28-f6914adbfc89 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:06.092712 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b3555-c511-45cb-a074-c993a817d78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:06.093363 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b3555-c511-45cb-a074-c993a817d78e admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:06.093656 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b3555-c511-45cb-a074-c993a817d78e admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:06.093930 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b3555-c511-45cb-a074-c993a817d78e admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:06.094664 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b3555-c511-45cb-a074-c993a817d78e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:06.096582 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b3555-c511-45cb-a074-c993a817d78e admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:06.127287 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1025/2028] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:12:06 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:12:06.131581 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282457e-f228-4d60-9b5f-7e49e8cb0f22 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:06.142443 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282457e-f228-4d60-9b5f-7e49e8cb0f22 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:06.193990 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:06.207374 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f4f71-7f10-4ece-b218-c46f62487480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:06.208093 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f4f71-7f10-4ece-b218-c46f62487480 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:06.208392 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f4f71-7f10-4ece-b218-c46f62487480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:06.208695 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f4f71-7f10-4ece-b218-c46f62487480 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:06.209678 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f4f71-7f10-4ece-b218-c46f62487480 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:06.211729 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f4f71-7f10-4ece-b218-c46f62487480 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:06.238332 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1004/2029] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:12:06 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:12:06.239581 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b3555-c511-45cb-a074-c993a817d78e admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:06.252330 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b3555-c511-45cb-a074-c993a817d78e admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:06.257053 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308cf55-c6a7-40fb-95d7-3d13d0e8c7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:06.257790 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308cf55-c6a7-40fb-95d7-3d13d0e8c7a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:06.258081 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308cf55-c6a7-40fb-95d7-3d13d0e8c7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:06.258400 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308cf55-c6a7-40fb-95d7-3d13d0e8c7a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:06.259145 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308cf55-c6a7-40fb-95d7-3d13d0e8c7a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:06.260775 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2308cf55-c6a7-40fb-95d7-3d13d0e8c7a1 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:06.272393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1026/2030] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:12:06.276663 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f4f71-7f10-4ece-b218-c46f62487480 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:06.287155 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f4f71-7f10-4ece-b218-c46f62487480 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:06.292448 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d4017-db20-41c5-a6d4-580e25b6634b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:06.293325 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d4017-db20-41c5-a6d4-580e25b6634b admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:06.293712 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d4017-db20-41c5-a6d4-580e25b6634b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:06.294090 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d4017-db20-41c5-a6d4-580e25b6634b admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:06.295013 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d4017-db20-41c5-a6d4-580e25b6634b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:06.296837 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d4017-db20-41c5-a6d4-580e25b6634b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:06.308999 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1005/2031] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:12:06.314045 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308cf55-c6a7-40fb-95d7-3d13d0e8c7a1 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:06.326994 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308cf55-c6a7-40fb-95d7-3d13d0e8c7a1 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:06.333322 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6e88d-3b00-4413-a2fb-bb3b4b16c4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:06.334372 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6e88d-3b00-4413-a2fb-bb3b4b16c4c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:06.334776 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6e88d-3b00-4413-a2fb-bb3b4b16c4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:06.335123 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6e88d-3b00-4413-a2fb-bb3b4b16c4c6 admin admin] PATH_INFO: `/v3/projects/ddfa7f29b8534c689bdeaeb943a0825f/users/b18924e103464eee8dd1849a86ff9a61/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:06.360849 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6e88d-3b00-4413-a2fb-bb3b4b16c4c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddfa7f29b8534c689bdeaeb943a0825f, user_id=b18924e103464eee8dd1849a86ff9a61, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:06.364423 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6e88d-3b00-4413-a2fb-bb3b4b16c4c6 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:06.394208 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1027/2032] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:12:06 2022] PUT /identity/v3/projects/ddfa7f29b8534c689bdeaeb943a0825f/users/b18924e103464eee8dd1849a86ff9a61/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:06.402713 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d37e0-6233-450d-a20e-38709d85e617 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:06.403130 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d37e0-6233-450d-a20e-38709d85e617 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:06.403515 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d37e0-6233-450d-a20e-38709d85e617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:06.434997 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-968d37e0-6233-450d-a20e-38709d85e617 None None] MFA Rules not processed for user `b18924e103464eee8dd1849a86ff9a61`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:06.436297 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-968d37e0-6233-450d-a20e-38709d85e617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:06.514292 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1006/2033] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:06.516696 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6e88d-3b00-4413-a2fb-bb3b4b16c4c6 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:06.596635 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6e88d-3b00-4413-a2fb-bb3b4b16c4c6 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:06.602133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98797bd-c33b-494c-8a6c-041f74e60bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:06.602840 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98797bd-c33b-494c-8a6c-041f74e60bf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:06.603131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98797bd-c33b-494c-8a6c-041f74e60bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:06.603417 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98797bd-c33b-494c-8a6c-041f74e60bf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:06.604136 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98797bd-c33b-494c-8a6c-041f74e60bf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:06.606075 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98797bd-c33b-494c-8a6c-041f74e60bf5 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:06.650507 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1028/2034] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:12:06 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:12:06.655492 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d37e0-6233-450d-a20e-38709d85e617 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:06.671022 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d37e0-6233-450d-a20e-38709d85e617 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:06.756904 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31ff7b-79cc-4128-b5cb-c462ac05c1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:06.757525 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31ff7b-79cc-4128-b5cb-c462ac05c1e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:06.757883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31ff7b-79cc-4128-b5cb-c462ac05c1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:06.758264 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31ff7b-79cc-4128-b5cb-c462ac05c1e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:06.758875 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31ff7b-79cc-4128-b5cb-c462ac05c1e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:06.761671 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31ff7b-79cc-4128-b5cb-c462ac05c1e6 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:06.802623 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1007/2035] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:12:06 2022] POST /identity/v3/users => generated 299 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:12:06.808302 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98797bd-c33b-494c-8a6c-041f74e60bf5 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:06.809826 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31ff7b-79cc-4128-b5cb-c462ac05c1e6 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:06.812736 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5b31ff7b-79cc-4128-b5cb-c462ac05c1e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:06.826441 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98797bd-c33b-494c-8a6c-041f74e60bf5 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:06.831160 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31ff7b-79cc-4128-b5cb-c462ac05c1e6 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:06.832533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b387f-4a7e-427f-affc-67835182f18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:06.833303 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b387f-4a7e-427f-affc-67835182f18f admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:06.833662 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b387f-4a7e-427f-affc-67835182f18f admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:06.834057 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b387f-4a7e-427f-affc-67835182f18f admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:06.834865 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b387f-4a7e-427f-affc-67835182f18f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:06.837155 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b387f-4a7e-427f-affc-67835182f18f admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:06.837634 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4bedc2-259b-4b97-9918-2cc764db566d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:06.839453 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4bedc2-259b-4b97-9918-2cc764db566d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:06.839852 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4bedc2-259b-4b97-9918-2cc764db566d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:06.840228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4bedc2-259b-4b97-9918-2cc764db566d admin admin] PATH_INFO: `/v3/users/f4f65fe82d214a0db7e0aaac2fc6d7f9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:06.841687 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4bedc2-259b-4b97-9918-2cc764db566d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4f65fe82d214a0db7e0aaac2fc6d7f9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:06.843945 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4bedc2-259b-4b97-9918-2cc764db566d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:06.863119 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1029/2036] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:12:06.864299 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b387f-4a7e-427f-affc-67835182f18f admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:06.890279 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b387f-4a7e-427f-affc-67835182f18f admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:06.899777 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84430fcb-93cc-4516-ae72-a4acc9e12e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:06.900959 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84430fcb-93cc-4516-ae72-a4acc9e12e58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:06.901251 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84430fcb-93cc-4516-ae72-a4acc9e12e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:06.901609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84430fcb-93cc-4516-ae72-a4acc9e12e58 admin admin] PATH_INFO: `/v3/projects/6bab0d12b40b41c1ba36ed99276d17a3/users/ec46b8ce3c7e425796b7f98f8adfc231/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:06.902317 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=88,keystone:INSERT=6,keystone:DELETE=6 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:06.905440 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2f4bedc2-259b-4b97-9918-2cc764db566d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4f65fe82d214a0db7e0aaac2fc6d7f9'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:06.906334 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2f4bedc2-259b-4b97-9918-2cc764db566d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4f65fe82d214a0db7e0aaac2fc6d7f9'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:06.918984 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2f4bedc2-259b-4b97-9918-2cc764db566d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4f65fe82d214a0db7e0aaac2fc6d7f9'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:06.925527 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84430fcb-93cc-4516-ae72-a4acc9e12e58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bab0d12b40b41c1ba36ed99276d17a3, user_id=ec46b8ce3c7e425796b7f98f8adfc231, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:06.929906 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84430fcb-93cc-4516-ae72-a4acc9e12e58 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:06.934111 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:06.937151 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2f4bedc2-259b-4b97-9918-2cc764db566d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4f65fe82d214a0db7e0aaac2fc6d7f9'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:06.938047 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2f4bedc2-259b-4b97-9918-2cc764db566d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4f65fe82d214a0db7e0aaac2fc6d7f9'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:06.958204 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1030/2038] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:12:06 2022] PUT /identity/v3/projects/6bab0d12b40b41c1ba36ed99276d17a3/users/ec46b8ce3c7e425796b7f98f8adfc231/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:06.958902 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1008/2038] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:12:06 2022] DELETE /identity/v3/users/f4f65fe82d214a0db7e0aaac2fc6d7f9 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 04:12:06.960413 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eefe35-ee94-4072-8154-8f06a112408e None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:06.960869 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eefe35-ee94-4072-8154-8f06a112408e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:06.961339 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eefe35-ee94-4072-8154-8f06a112408e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:06.961703 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4bedc2-259b-4b97-9918-2cc764db566d admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:06.963462 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-2f4bedc2-259b-4b97-9918-2cc764db566d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:07.001474 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-72eefe35-ee94-4072-8154-8f06a112408e None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:07.002035 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-72eefe35-ee94-4072-8154-8f06a112408e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:07.074713 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4bedc2-259b-4b97-9918-2cc764db566d admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:07.081619 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1dbe5-5e94-48f0-ad69-71edd91d7676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:07.082435 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1dbe5-5e94-48f0-ad69-71edd91d7676 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:07.082836 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1dbe5-5e94-48f0-ad69-71edd91d7676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:07.083192 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1dbe5-5e94-48f0-ad69-71edd91d7676 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:07.084014 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1dbe5-5e94-48f0-ad69-71edd91d7676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:07.085782 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1dbe5-5e94-48f0-ad69-71edd91d7676 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:07.101732 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1009/2039] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:12:07.102812 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1dbe5-5e94-48f0-ad69-71edd91d7676 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:07.115645 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1dbe5-5e94-48f0-ad69-71edd91d7676 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:07.123548 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21953f62-3e58-4458-867a-d286132016c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:07.127080 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21953f62-3e58-4458-867a-d286132016c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:07.127080 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21953f62-3e58-4458-867a-d286132016c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:07.127080 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21953f62-3e58-4458-867a-d286132016c1 admin admin] PATH_INFO: `/v3/projects/6bab0d12b40b41c1ba36ed99276d17a3/users/ec46b8ce3c7e425796b7f98f8adfc231/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:07.129368 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21953f62-3e58-4458-867a-d286132016c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bab0d12b40b41c1ba36ed99276d17a3, user_id=ec46b8ce3c7e425796b7f98f8adfc231, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:07.132878 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21953f62-3e58-4458-867a-d286132016c1 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:07.142284 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1031/2040] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:07.149518 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1010/2041] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:12:07 2022] PUT /identity/v3/projects/6bab0d12b40b41c1ba36ed99276d17a3/users/ec46b8ce3c7e425796b7f98f8adfc231/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:07.152039 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eefe35-ee94-4072-8154-8f06a112408e None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:07.159738 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-72eefe35-ee94-4072-8154-8f06a112408e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:07.161266 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aeb8f5-16f6-4b65-bf7c-5d426168ec7d None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:07.161775 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aeb8f5-16f6-4b65-bf7c-5d426168ec7d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:07.162096 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aeb8f5-16f6-4b65-bf7c-5d426168ec7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:07.191985 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e8aeb8f5-16f6-4b65-bf7c-5d426168ec7d None None] MFA Rules not processed for user `ec46b8ce3c7e425796b7f98f8adfc231`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:07.193211 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e8aeb8f5-16f6-4b65-bf7c-5d426168ec7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:07.233891 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eefe35-ee94-4072-8154-8f06a112408e None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:07.262723 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1011/2042] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:07.273898 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aeb8f5-16f6-4b65-bf7c-5d426168ec7d None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:07.275401 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e8aeb8f5-16f6-4b65-bf7c-5d426168ec7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:07.283407 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ff22f-5524-4015-bd52-c2e422d4baf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:07.284070 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ff22f-5524-4015-bd52-c2e422d4baf3 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:07.284358 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ff22f-5524-4015-bd52-c2e422d4baf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:07.284642 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ff22f-5524-4015-bd52-c2e422d4baf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:07.307888 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:07.334315 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aeb8f5-16f6-4b65-bf7c-5d426168ec7d None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:07.338005 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4f56b-bf7d-416b-abe7-0c1588ed93ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:07.338699 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4f56b-bf7d-416b-abe7-0c1588ed93ed service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:07.338986 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4f56b-bf7d-416b-abe7-0c1588ed93ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:07.339278 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4f56b-bf7d-416b-abe7-0c1588ed93ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:07.346141 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ff22f-5524-4015-bd52-c2e422d4baf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:07.347681 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ff22f-5524-4015-bd52-c2e422d4baf3 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:07.348275 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b4f56b-bf7d-416b-abe7-0c1588ed93ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:07.349739 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b4f56b-bf7d-416b-abe7-0c1588ed93ed service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:07.357359 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1032/2043] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:12:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:12:07.361735 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1012/2044] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:12:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 04:12:07.842196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ff22f-5524-4015-bd52-c2e422d4baf3 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:07.844523 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-375ff22f-5524-4015-bd52-c2e422d4baf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:07.860162 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:07.869745 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ff22f-5524-4015-bd52-c2e422d4baf3 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:07.876217 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31db5b-c077-4c84-bb59-89fd2ec28bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:07.877251 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31db5b-c077-4c84-bb59-89fd2ec28bf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:07.877607 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31db5b-c077-4c84-bb59-89fd2ec28bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:07.877959 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31db5b-c077-4c84-bb59-89fd2ec28bf6 admin admin] PATH_INFO: `/v3/projects/575a951acdf84cc685721ff60978a58e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:07.879440 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da31db5b-c077-4c84-bb59-89fd2ec28bf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=575a951acdf84cc685721ff60978a58e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:07.881639 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da31db5b-c077-4c84-bb59-89fd2ec28bf6 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:07.985296 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-da31db5b-c077-4c84-bb59-89fd2ec28bf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '575a951acdf84cc685721ff60978a58e', 'request_id': 'req-da31db5b-c077-4c84-bb59-89fd2ec28bf6'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:08.002462 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-da31db5b-c077-4c84-bb59-89fd2ec28bf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '575a951acdf84cc685721ff60978a58e', 'request_id': 'req-da31db5b-c077-4c84-bb59-89fd2ec28bf6'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:08.013445 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-da31db5b-c077-4c84-bb59-89fd2ec28bf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '575a951acdf84cc685721ff60978a58e', 'request_id': 'req-da31db5b-c077-4c84-bb59-89fd2ec28bf6'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:08.033627 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-da31db5b-c077-4c84-bb59-89fd2ec28bf6 admin admin] The token cache is being invalidate because project 575a951acdf84cc685721ff60978a58e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:12:08.033935 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-da31db5b-c077-4c84-bb59-89fd2ec28bf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:08.034744 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-da31db5b-c077-4c84-bb59-89fd2ec28bf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:08.036457 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1033/2045] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:12:07 2022] DELETE /identity/v3/projects/575a951acdf84cc685721ff60978a58e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:08.042619 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e22c65-fe24-4d11-87d0-0d27739ee94f None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:08.043104 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e22c65-fe24-4d11-87d0-0d27739ee94f None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:08.043204 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e22c65-fe24-4d11-87d0-0d27739ee94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:08.078299 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-99e22c65-fe24-4d11-87d0-0d27739ee94f None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:08.079530 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-99e22c65-fe24-4d11-87d0-0d27739ee94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:08.098046 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31db5b-c077-4c84-bb59-89fd2ec28bf6 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:08.100698 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-da31db5b-c077-4c84-bb59-89fd2ec28bf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:08.149199 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1013/2046] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:12:08.164811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14f76c-305d-448f-9f93-2b0f3ff2da13 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:08.164944 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14f76c-305d-448f-9f93-2b0f3ff2da13 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:08.165224 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14f76c-305d-448f-9f93-2b0f3ff2da13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:08.191529 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-6a14f76c-305d-448f-9f93-2b0f3ff2da13 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:08.192931 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6a14f76c-305d-448f-9f93-2b0f3ff2da13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:08.199578 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31db5b-c077-4c84-bb59-89fd2ec28bf6 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:08.205287 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1014/2047] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:08.209708 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14f76c-305d-448f-9f93-2b0f3ff2da13 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:08.216470 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f7418-2aff-43ea-baea-280f991531cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:08.216470 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f7418-2aff-43ea-baea-280f991531cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:08.216470 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f7418-2aff-43ea-baea-280f991531cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:08.216470 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f7418-2aff-43ea-baea-280f991531cb admin admin] PATH_INFO: `/v3/users/b18924e103464eee8dd1849a86ff9a61` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:08.219755 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f7418-2aff-43ea-baea-280f991531cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b18924e103464eee8dd1849a86ff9a61)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:08.223044 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f7418-2aff-43ea-baea-280f991531cb admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:08.225120 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14f76c-305d-448f-9f93-2b0f3ff2da13 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:08.231847 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551823f-c73d-4cd8-ae63-f6353ebae3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:08.233034 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551823f-c73d-4cd8-ae63-f6353ebae3d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:08.233624 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551823f-c73d-4cd8-ae63-f6353ebae3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:08.234061 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551823f-c73d-4cd8-ae63-f6353ebae3d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:08.234992 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551823f-c73d-4cd8-ae63-f6353ebae3d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:12:08.235594 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551823f-c73d-4cd8-ae63-f6353ebae3d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:08.237417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551823f-c73d-4cd8-ae63-f6353ebae3d6 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:08.257604 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1015/2048] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:12:08.258865 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551823f-c73d-4cd8-ae63-f6353ebae3d6 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:08.271650 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551823f-c73d-4cd8-ae63-f6353ebae3d6 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:08.278678 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b312cb-6a87-4145-8b23-1b229b4f4d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:08.279962 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b312cb-6a87-4145-8b23-1b229b4f4d88 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:08.280765 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b312cb-6a87-4145-8b23-1b229b4f4d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:08.281197 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b312cb-6a87-4145-8b23-1b229b4f4d88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:08.283391 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b312cb-6a87-4145-8b23-1b229b4f4d88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:08.286056 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b312cb-6a87-4145-8b23-1b229b4f4d88 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:08.322311 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-494f7418-2aff-43ea-baea-280f991531cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b18924e103464eee8dd1849a86ff9a61'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:08.328761 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1016/2049] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:12:08 2022] POST /identity/v3/projects => generated 397 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:12:08.332381 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b312cb-6a87-4145-8b23-1b229b4f4d88 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:08.333821 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-494f7418-2aff-43ea-baea-280f991531cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b18924e103464eee8dd1849a86ff9a61'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:08.334613 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-494f7418-2aff-43ea-baea-280f991531cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b18924e103464eee8dd1849a86ff9a61'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:08.356908 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-494f7418-2aff-43ea-baea-280f991531cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b18924e103464eee8dd1849a86ff9a61'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:08.357779 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-494f7418-2aff-43ea-baea-280f991531cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b18924e103464eee8dd1849a86ff9a61'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:08.372617 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1034/2050] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:12:08 2022] DELETE /identity/v3/users/b18924e103464eee8dd1849a86ff9a61 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 04:12:08.377095 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a008395-7a21-4cdb-9180-4d810fad8c3e None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:08.377441 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a008395-7a21-4cdb-9180-4d810fad8c3e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:08.377724 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a008395-7a21-4cdb-9180-4d810fad8c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:08.384765 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:08.403330 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-7a008395-7a21-4cdb-9180-4d810fad8c3e None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:08.404698 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7a008395-7a21-4cdb-9180-4d810fad8c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:08.452092 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b312cb-6a87-4145-8b23-1b229b4f4d88 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:08.532879 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:08.550951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1035/2051] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:12:08.582391 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0bb75-a831-4f0e-9e48-70824475e591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:08.584070 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0bb75-a831-4f0e-9e48-70824475e591 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:08.584464 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0bb75-a831-4f0e-9e48-70824475e591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:08.584765 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0bb75-a831-4f0e-9e48-70824475e591 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:08.586835 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a008395-7a21-4cdb-9180-4d810fad8c3e None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:08.588459 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7a008395-7a21-4cdb-9180-4d810fad8c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:08.591041 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d0bb75-a831-4f0e-9e48-70824475e591 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:08.606784 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d0bb75-a831-4f0e-9e48-70824475e591 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:08.664956 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1017/2052] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:12:08 2022] POST /identity/v3/users => generated 299 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:12:08.666345 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0bb75-a831-4f0e-9e48-70824475e591 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:08.669658 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-13d0bb75-a831-4f0e-9e48-70824475e591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:08.698729 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0bb75-a831-4f0e-9e48-70824475e591 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:08.711200 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5912a9-d49e-46f1-bede-dd8949ee29be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:08.711903 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5912a9-d49e-46f1-bede-dd8949ee29be admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:08.712193 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5912a9-d49e-46f1-bede-dd8949ee29be admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:08.712476 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5912a9-d49e-46f1-bede-dd8949ee29be admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:08.713229 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5912a9-d49e-46f1-bede-dd8949ee29be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:08.715299 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5912a9-d49e-46f1-bede-dd8949ee29be admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:08.729683 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a008395-7a21-4cdb-9180-4d810fad8c3e None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:08.735416 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079f2c3-ad5a-40c4-8fae-dcd391c29a31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:08.736102 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079f2c3-ad5a-40c4-8fae-dcd391c29a31 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:08.736394 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079f2c3-ad5a-40c4-8fae-dcd391c29a31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:08.736679 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079f2c3-ad5a-40c4-8fae-dcd391c29a31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:08.743673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1018/2053] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:12:08.744702 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5912a9-d49e-46f1-bede-dd8949ee29be admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:08.751631 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f079f2c3-ad5a-40c4-8fae-dcd391c29a31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:08.754084 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f079f2c3-ad5a-40c4-8fae-dcd391c29a31 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:08.757229 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5912a9-d49e-46f1-bede-dd8949ee29be admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:08.764194 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db884a5f-9d7a-45d3-9829-f1e1d8af1d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:08.765058 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db884a5f-9d7a-45d3-9829-f1e1d8af1d80 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:08.765696 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1036/2054] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:12:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 04:12:08.766377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db884a5f-9d7a-45d3-9829-f1e1d8af1d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:08.766766 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db884a5f-9d7a-45d3-9829-f1e1d8af1d80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:08.767736 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db884a5f-9d7a-45d3-9829-f1e1d8af1d80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:08.769711 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db884a5f-9d7a-45d3-9829-f1e1d8af1d80 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:08.782761 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1019/2055] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:12:08.787243 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079f2c3-ad5a-40c4-8fae-dcd391c29a31 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:08.801323 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079f2c3-ad5a-40c4-8fae-dcd391c29a31 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:08.807917 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85b202-4523-4f96-8682-55f295b53231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:08.808979 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85b202-4523-4f96-8682-55f295b53231 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:08.809427 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85b202-4523-4f96-8682-55f295b53231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:08.809707 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85b202-4523-4f96-8682-55f295b53231 admin admin] PATH_INFO: `/v3/projects/2dd6100c57b944ef9dc20223d3614232/users/a5324ed2f18b4119a505c13989554936/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:08.835357 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f85b202-4523-4f96-8682-55f295b53231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dd6100c57b944ef9dc20223d3614232, user_id=a5324ed2f18b4119a505c13989554936, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:08.840560 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f85b202-4523-4f96-8682-55f295b53231 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:08.868252 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1037/2056] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:12:08 2022] PUT /identity/v3/projects/2dd6100c57b944ef9dc20223d3614232/users/a5324ed2f18b4119a505c13989554936/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:08.879111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5675f-1a38-4324-a212-d441cc46b987 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:08.879410 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5675f-1a38-4324-a212-d441cc46b987 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:08.879724 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5675f-1a38-4324-a212-d441cc46b987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:08.909837 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-8ff5675f-1a38-4324-a212-d441cc46b987 None None] MFA Rules not processed for user `a5324ed2f18b4119a505c13989554936`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:08.911159 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-8ff5675f-1a38-4324-a212-d441cc46b987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:08.994599 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1020/2057] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:09.011432 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85b202-4523-4f96-8682-55f295b53231 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:09.014869 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6f85b202-4523-4f96-8682-55f295b53231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:09.129326 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85b202-4523-4f96-8682-55f295b53231 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:09.146649 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588cc82-4d58-4bc7-8465-260209e048cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:09.147336 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588cc82-4d58-4bc7-8465-260209e048cb service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:09.147626 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588cc82-4d58-4bc7-8465-260209e048cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:09.147983 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588cc82-4d58-4bc7-8465-260209e048cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:09.169211 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588cc82-4d58-4bc7-8465-260209e048cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:09.174094 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588cc82-4d58-4bc7-8465-260209e048cb service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:09.194809 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1038/2058] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:12:09 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:12:09.485502 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5675f-1a38-4324-a212-d441cc46b987 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:09.487087 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-8ff5675f-1a38-4324-a212-d441cc46b987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:09.605042 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5675f-1a38-4324-a212-d441cc46b987 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:09.618307 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d62457-e3ef-4bc1-be40-9ee385c4cff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:09.620580 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d62457-e3ef-4bc1-be40-9ee385c4cff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:09.620874 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d62457-e3ef-4bc1-be40-9ee385c4cff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:09.621225 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d62457-e3ef-4bc1-be40-9ee385c4cff5 admin admin] PATH_INFO: `/v3/projects/ddfa7f29b8534c689bdeaeb943a0825f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:09.623626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d62457-e3ef-4bc1-be40-9ee385c4cff5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddfa7f29b8534c689bdeaeb943a0825f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:09.625666 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d62457-e3ef-4bc1-be40-9ee385c4cff5 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:09.688803 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:09.708853 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-90d62457-e3ef-4bc1-be40-9ee385c4cff5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddfa7f29b8534c689bdeaeb943a0825f', 'request_id': 'req-90d62457-e3ef-4bc1-be40-9ee385c4cff5'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:09.716574 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-90d62457-e3ef-4bc1-be40-9ee385c4cff5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddfa7f29b8534c689bdeaeb943a0825f', 'request_id': 'req-90d62457-e3ef-4bc1-be40-9ee385c4cff5'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:09.723905 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-90d62457-e3ef-4bc1-be40-9ee385c4cff5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddfa7f29b8534c689bdeaeb943a0825f', 'request_id': 'req-90d62457-e3ef-4bc1-be40-9ee385c4cff5'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:09.756143 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-90d62457-e3ef-4bc1-be40-9ee385c4cff5 admin admin] The token cache is being invalidate because project ddfa7f29b8534c689bdeaeb943a0825f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:12:09.756447 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-90d62457-e3ef-4bc1-be40-9ee385c4cff5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:09.757155 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-90d62457-e3ef-4bc1-be40-9ee385c4cff5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:09.759630 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1021/2059] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:12:09 2022] DELETE /identity/v3/projects/ddfa7f29b8534c689bdeaeb943a0825f => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:09.763765 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588cc82-4d58-4bc7-8465-260209e048cb service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:09.784529 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588cc82-4d58-4bc7-8465-260209e048cb service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:09.815233 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:09.867771 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f32c0-56f9-4f59-9a3a-76fdda227e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:09.868250 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f32c0-56f9-4f59-9a3a-76fdda227e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:09.868543 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f32c0-56f9-4f59-9a3a-76fdda227e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:09.869115 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f32c0-56f9-4f59-9a3a-76fdda227e5d admin admin] PATH_INFO: `/v3/users/ec46b8ce3c7e425796b7f98f8adfc231` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:09.870357 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f32c0-56f9-4f59-9a3a-76fdda227e5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec46b8ce3c7e425796b7f98f8adfc231)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:09.872540 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f32c0-56f9-4f59-9a3a-76fdda227e5d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:09.925027 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8a9f32c0-56f9-4f59-9a3a-76fdda227e5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec46b8ce3c7e425796b7f98f8adfc231'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:09.934475 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8a9f32c0-56f9-4f59-9a3a-76fdda227e5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec46b8ce3c7e425796b7f98f8adfc231'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:09.935120 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8a9f32c0-56f9-4f59-9a3a-76fdda227e5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec46b8ce3c7e425796b7f98f8adfc231'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:09.948988 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8a9f32c0-56f9-4f59-9a3a-76fdda227e5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec46b8ce3c7e425796b7f98f8adfc231'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:09.949664 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8a9f32c0-56f9-4f59-9a3a-76fdda227e5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec46b8ce3c7e425796b7f98f8adfc231'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:09.967325 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1039/2060] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:12:09 2022] DELETE /identity/v3/users/ec46b8ce3c7e425796b7f98f8adfc231 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:10.264202 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d62457-e3ef-4bc1-be40-9ee385c4cff5 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:10.265733 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-90d62457-e3ef-4bc1-be40-9ee385c4cff5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:10.280419 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d62457-e3ef-4bc1-be40-9ee385c4cff5 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:10.345419 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a7662-163f-4ae7-a587-d80c26dfbec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:10.346364 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a7662-163f-4ae7-a587-d80c26dfbec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:10.346662 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a7662-163f-4ae7-a587-d80c26dfbec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:10.346938 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a7662-163f-4ae7-a587-d80c26dfbec9 admin admin] PATH_INFO: `/v3/projects/6bab0d12b40b41c1ba36ed99276d17a3` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:10.348162 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1a7662-163f-4ae7-a587-d80c26dfbec9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bab0d12b40b41c1ba36ed99276d17a3)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:10.350121 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1a7662-163f-4ae7-a587-d80c26dfbec9 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:10.400881 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3e1a7662-163f-4ae7-a587-d80c26dfbec9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bab0d12b40b41c1ba36ed99276d17a3', 'request_id': 'req-3e1a7662-163f-4ae7-a587-d80c26dfbec9'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:10.408635 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3e1a7662-163f-4ae7-a587-d80c26dfbec9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bab0d12b40b41c1ba36ed99276d17a3', 'request_id': 'req-3e1a7662-163f-4ae7-a587-d80c26dfbec9'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:10.418052 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3e1a7662-163f-4ae7-a587-d80c26dfbec9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bab0d12b40b41c1ba36ed99276d17a3', 'request_id': 'req-3e1a7662-163f-4ae7-a587-d80c26dfbec9'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:10.432985 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3e1a7662-163f-4ae7-a587-d80c26dfbec9 admin admin] The token cache is being invalidate because project 6bab0d12b40b41c1ba36ed99276d17a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:12:10.433278 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3e1a7662-163f-4ae7-a587-d80c26dfbec9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:10.434013 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3e1a7662-163f-4ae7-a587-d80c26dfbec9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:10.436050 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1022/2061] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:12:10 2022] DELETE /identity/v3/projects/6bab0d12b40b41c1ba36ed99276d17a3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:10.441145 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234ad1c-adc2-42f7-ace2-9a26c7f35301 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:10.441435 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234ad1c-adc2-42f7-ace2-9a26c7f35301 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:10.441721 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234ad1c-adc2-42f7-ace2-9a26c7f35301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:10.460994 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-9234ad1c-adc2-42f7-ace2-9a26c7f35301 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:10.462212 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9234ad1c-adc2-42f7-ace2-9a26c7f35301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:10.530295 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1040/2062] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:10.538582 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745cca6-87f0-437f-be79-d8fc2df144ee None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:10.539054 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745cca6-87f0-437f-be79-d8fc2df144ee None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:10.539157 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745cca6-87f0-437f-be79-d8fc2df144ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:10.558230 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-0745cca6-87f0-437f-be79-d8fc2df144ee None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:10.559435 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0745cca6-87f0-437f-be79-d8fc2df144ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:10.568387 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1023/2063] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:10.572831 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234ad1c-adc2-42f7-ace2-9a26c7f35301 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:10.583399 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234ad1c-adc2-42f7-ace2-9a26c7f35301 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:10.589040 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e9386-3c43-4ff4-84d9-d7c437ed079c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:10.589722 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e9386-3c43-4ff4-84d9-d7c437ed079c admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:10.590014 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e9386-3c43-4ff4-84d9-d7c437ed079c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:10.590333 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e9386-3c43-4ff4-84d9-d7c437ed079c admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:10.591242 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e9386-3c43-4ff4-84d9-d7c437ed079c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:12:10.591505 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e9386-3c43-4ff4-84d9-d7c437ed079c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:10.593181 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e9386-3c43-4ff4-84d9-d7c437ed079c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:10.613704 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1041/2064] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:12:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:12:10.618180 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745cca6-87f0-437f-be79-d8fc2df144ee None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:10.628667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745cca6-87f0-437f-be79-d8fc2df144ee None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:10.634862 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea57a9-7137-4071-9759-85e79ef21e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:10.636170 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea57a9-7137-4071-9759-85e79ef21e1e admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:10.636466 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea57a9-7137-4071-9759-85e79ef21e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:10.636755 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea57a9-7137-4071-9759-85e79ef21e1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:10.637508 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea57a9-7137-4071-9759-85e79ef21e1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:10.640230 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea57a9-7137-4071-9759-85e79ef21e1e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:10.690356 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1024/2065] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:12:10 2022] POST /identity/v3/projects => generated 371 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:12:10.696859 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e9386-3c43-4ff4-84d9-d7c437ed079c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:10.730448 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e9386-3c43-4ff4-84d9-d7c437ed079c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:10.798720 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:10.857094 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6c35f-6a5a-4133-98db-aea0e3e15568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:10.858100 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6c35f-6a5a-4133-98db-aea0e3e15568 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:10.858418 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6c35f-6a5a-4133-98db-aea0e3e15568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:10.858869 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6c35f-6a5a-4133-98db-aea0e3e15568 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:10.859592 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6c35f-6a5a-4133-98db-aea0e3e15568 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:10.877385 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6c35f-6a5a-4133-98db-aea0e3e15568 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:10.945891 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1042/2066] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:12:10 2022] POST /identity/v3/users => generated 286 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:12:10.950393 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea57a9-7137-4071-9759-85e79ef21e1e admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:10.963096 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea57a9-7137-4071-9759-85e79ef21e1e admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:10.968686 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c28d14-e036-47c8-b3a2-1a073d360f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:10.969400 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c28d14-e036-47c8-b3a2-1a073d360f7c admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:10.969693 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c28d14-e036-47c8-b3a2-1a073d360f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:10.970678 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c28d14-e036-47c8-b3a2-1a073d360f7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:10.971462 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c28d14-e036-47c8-b3a2-1a073d360f7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:10.973517 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c28d14-e036-47c8-b3a2-1a073d360f7c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:10.988291 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1025/2067] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:12:10.993989 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6c35f-6a5a-4133-98db-aea0e3e15568 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:11.011399 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6c35f-6a5a-4133-98db-aea0e3e15568 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:11.012931 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c28d14-e036-47c8-b3a2-1a073d360f7c admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:11.018961 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f1156-0aba-41ab-b7aa-a279771857dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:11.019315 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-60c28d14-e036-47c8-b3a2-1a073d360f7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:11.020337 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f1156-0aba-41ab-b7aa-a279771857dc admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:11.021017 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f1156-0aba-41ab-b7aa-a279771857dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:11.021756 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f1156-0aba-41ab-b7aa-a279771857dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:11.023188 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f1156-0aba-41ab-b7aa-a279771857dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:11.025948 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f1156-0aba-41ab-b7aa-a279771857dc admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:11.040136 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c28d14-e036-47c8-b3a2-1a073d360f7c admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:11.045477 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0dac19-b4a4-401d-90c0-53462f9d09d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:11.046465 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dac19-b4a4-401d-90c0-53462f9d09d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:11.046817 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dac19-b4a4-401d-90c0-53462f9d09d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:11.047171 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dac19-b4a4-401d-90c0-53462f9d09d6 admin admin] PATH_INFO: `/v3/users/77116c0219514c7c8d6a160fca132284` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:11.050234 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0dac19-b4a4-401d-90c0-53462f9d09d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77116c0219514c7c8d6a160fca132284)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:11.051309 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0dac19-b4a4-401d-90c0-53462f9d09d6 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:11.063213 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:11.070718 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1043/2068] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 04:12:11.076840 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f1156-0aba-41ab-b7aa-a279771857dc admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:11.098394 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f1156-0aba-41ab-b7aa-a279771857dc admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:11.116100 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49faf52-d914-4451-83e8-21b117b5d86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:11.118262 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49faf52-d914-4451-83e8-21b117b5d86b admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:11.119754 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49faf52-d914-4451-83e8-21b117b5d86b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:11.120389 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49faf52-d914-4451-83e8-21b117b5d86b admin admin] PATH_INFO: `/v3/projects/e2bd793d5f5c4a4aa0cae1b432b1d586/users/e72e4508b479497f9532ce8d2a4208e0/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:11.165798 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2c0dac19-b4a4-401d-90c0-53462f9d09d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77116c0219514c7c8d6a160fca132284'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:11.168182 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2c0dac19-b4a4-401d-90c0-53462f9d09d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77116c0219514c7c8d6a160fca132284'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:11.172041 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49faf52-d914-4451-83e8-21b117b5d86b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2bd793d5f5c4a4aa0cae1b432b1d586, user_id=e72e4508b479497f9532ce8d2a4208e0, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:11.174906 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49faf52-d914-4451-83e8-21b117b5d86b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:11.186104 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2c0dac19-b4a4-401d-90c0-53462f9d09d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77116c0219514c7c8d6a160fca132284'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:11.203429 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1044/2069] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:12:11 2022] PUT /identity/v3/projects/e2bd793d5f5c4a4aa0cae1b432b1d586/users/e72e4508b479497f9532ce8d2a4208e0/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:11.212577 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2c0dac19-b4a4-401d-90c0-53462f9d09d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77116c0219514c7c8d6a160fca132284'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:11.212577 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2c0dac19-b4a4-401d-90c0-53462f9d09d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77116c0219514c7c8d6a160fca132284'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:11.215193 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb53bb1-aaf0-4747-aa17-297e3e28e764 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:11.215653 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb53bb1-aaf0-4747-aa17-297e3e28e764 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:11.216084 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb53bb1-aaf0-4747-aa17-297e3e28e764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:11.234400 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1026/2070] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:12:11 2022] DELETE /identity/v3/users/77116c0219514c7c8d6a160fca132284 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 04:12:11.242375 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03551edf-6907-491b-94a5-e8753afe6790 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:11.244042 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03551edf-6907-491b-94a5-e8753afe6790 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:11.244884 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03551edf-6907-491b-94a5-e8753afe6790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:11.290372 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-03551edf-6907-491b-94a5-e8753afe6790 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:11.293867 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-3fb53bb1-aaf0-4747-aa17-297e3e28e764 None None] MFA Rules not processed for user `e72e4508b479497f9532ce8d2a4208e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:11.295479 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3fb53bb1-aaf0-4747-aa17-297e3e28e764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:11.298388 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-03551edf-6907-491b-94a5-e8753afe6790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:11.403411 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1027/2071] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:11.413174 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03551edf-6907-491b-94a5-e8753afe6790 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:11.414185 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1045/2072] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:11.419109 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-03551edf-6907-491b-94a5-e8753afe6790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:11.426886 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb53bb1-aaf0-4747-aa17-297e3e28e764 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:11.428429 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3fb53bb1-aaf0-4747-aa17-297e3e28e764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:11.492863 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03551edf-6907-491b-94a5-e8753afe6790 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:11.495943 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb53bb1-aaf0-4747-aa17-297e3e28e764 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:11.497028 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a436693a-aa28-4ea9-ad17-3633789c0cce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:11.497781 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436693a-aa28-4ea9-ad17-3633789c0cce service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:11.498006 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436693a-aa28-4ea9-ad17-3633789c0cce service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:11.498282 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436693a-aa28-4ea9-ad17-3633789c0cce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:11.500832 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a692e-870c-442b-94a3-414735cfbad0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:11.501368 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a692e-870c-442b-94a3-414735cfbad0 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:11.501684 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a692e-870c-442b-94a3-414735cfbad0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:11.502067 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a692e-870c-442b-94a3-414735cfbad0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:11.518371 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a692e-870c-442b-94a3-414735cfbad0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:11.519890 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a692e-870c-442b-94a3-414735cfbad0 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:11.522949 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a436693a-aa28-4ea9-ad17-3633789c0cce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:11.524426 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a436693a-aa28-4ea9-ad17-3633789c0cce service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:11.529944 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1046/2073] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:12:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 04:12:11.535464 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1028/2074] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:12:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 04:12:11.550046 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a692e-870c-442b-94a3-414735cfbad0 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:11.551537 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c66a692e-870c-442b-94a3-414735cfbad0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:11.567286 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a692e-870c-442b-94a3-414735cfbad0 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:11.574300 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779baec-b195-465b-9bf2-45255639a663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:11.575210 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779baec-b195-465b-9bf2-45255639a663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:11.575501 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779baec-b195-465b-9bf2-45255639a663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:11.576090 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779baec-b195-465b-9bf2-45255639a663 admin admin] PATH_INFO: `/v3/users/e72e4508b479497f9532ce8d2a4208e0` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:11.577370 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779baec-b195-465b-9bf2-45255639a663 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e72e4508b479497f9532ce8d2a4208e0)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:11.579375 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779baec-b195-465b-9bf2-45255639a663 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:11.596795 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:11.642667 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-d779baec-b195-465b-9bf2-45255639a663 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e72e4508b479497f9532ce8d2a4208e0'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:11.652216 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-d779baec-b195-465b-9bf2-45255639a663 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e72e4508b479497f9532ce8d2a4208e0'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:11.653175 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-d779baec-b195-465b-9bf2-45255639a663 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e72e4508b479497f9532ce8d2a4208e0'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:11.669502 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-d779baec-b195-465b-9bf2-45255639a663 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e72e4508b479497f9532ce8d2a4208e0'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:11.671101 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-d779baec-b195-465b-9bf2-45255639a663 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e72e4508b479497f9532ce8d2a4208e0'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:11.697274 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1047/2075] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:12:11 2022] DELETE /identity/v3/users/e72e4508b479497f9532ce8d2a4208e0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:11.702744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244232c2-9907-414a-9866-7bc9aeff106c None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:11.702744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244232c2-9907-414a-9866-7bc9aeff106c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:11.702744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244232c2-9907-414a-9866-7bc9aeff106c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:11.723679 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-244232c2-9907-414a-9866-7bc9aeff106c None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:11.724907 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-244232c2-9907-414a-9866-7bc9aeff106c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:11.753459 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:11.802751 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1029/2076] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:11.814336 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779baec-b195-465b-9bf2-45255639a663 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:11.816498 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d779baec-b195-465b-9bf2-45255639a663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:11.845839 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244232c2-9907-414a-9866-7bc9aeff106c None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:11.847362 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-244232c2-9907-414a-9866-7bc9aeff106c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:11.864501 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244232c2-9907-414a-9866-7bc9aeff106c None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:11.871373 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daad5e0-8c9b-4817-8d44-2679c8d03802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:11.872757 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daad5e0-8c9b-4817-8d44-2679c8d03802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:11.873034 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daad5e0-8c9b-4817-8d44-2679c8d03802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:11.873318 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daad5e0-8c9b-4817-8d44-2679c8d03802 admin admin] PATH_INFO: `/v3/projects/67fed331761f4b6ca6ba9513001fff51` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:11.874949 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daad5e0-8c9b-4817-8d44-2679c8d03802 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67fed331761f4b6ca6ba9513001fff51)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:11.879052 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daad5e0-8c9b-4817-8d44-2679c8d03802 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:11.955844 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779baec-b195-465b-9bf2-45255639a663 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:11.966433 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4daad5e0-8c9b-4817-8d44-2679c8d03802 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67fed331761f4b6ca6ba9513001fff51', 'request_id': 'req-4daad5e0-8c9b-4817-8d44-2679c8d03802'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:11.971300 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4daad5e0-8c9b-4817-8d44-2679c8d03802 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67fed331761f4b6ca6ba9513001fff51', 'request_id': 'req-4daad5e0-8c9b-4817-8d44-2679c8d03802'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:11.988774 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4daad5e0-8c9b-4817-8d44-2679c8d03802 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67fed331761f4b6ca6ba9513001fff51', 'request_id': 'req-4daad5e0-8c9b-4817-8d44-2679c8d03802'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:12.020111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4daad5e0-8c9b-4817-8d44-2679c8d03802 admin admin] The token cache is being invalidate because project 67fed331761f4b6ca6ba9513001fff51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:12:12.020448 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4daad5e0-8c9b-4817-8d44-2679c8d03802 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:12.023104 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4daad5e0-8c9b-4817-8d44-2679c8d03802 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:12.027148 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1030/2077] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:12:11 2022] DELETE /identity/v3/projects/67fed331761f4b6ca6ba9513001fff51 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:12.032254 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb073ca-91f5-4dc8-a3bb-3e954ffbd268 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:12.032636 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb073ca-91f5-4dc8-a3bb-3e954ffbd268 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:12.032974 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb073ca-91f5-4dc8-a3bb-3e954ffbd268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:12.067601 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-7fb073ca-91f5-4dc8-a3bb-3e954ffbd268 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:12.069941 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-7fb073ca-91f5-4dc8-a3bb-3e954ffbd268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:12.080569 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71513902-1657-4315-9838-87e57d9c1f25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:12.081618 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71513902-1657-4315-9838-87e57d9c1f25 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:12.082039 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71513902-1657-4315-9838-87e57d9c1f25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:12.082487 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71513902-1657-4315-9838-87e57d9c1f25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:12.085880 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-71513902-1657-4315-9838-87e57d9c1f25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:12.187008 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71513902-1657-4315-9838-87e57d9c1f25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:12.188501 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71513902-1657-4315-9838-87e57d9c1f25 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:12.200449 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1031/2078] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:12.201095 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:12.207701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ba282-b8f3-4834-802e-3e14c255e1f1 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:12.207989 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ba282-b8f3-4834-802e-3e14c255e1f1 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:12.208776 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ba282-b8f3-4834-802e-3e14c255e1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:12.210210 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1048/2079] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:12:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:12:12.233811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-541ba282-b8f3-4834-802e-3e14c255e1f1 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:12.236808 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-541ba282-b8f3-4834-802e-3e14c255e1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:12.245271 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1032/2080] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:12.249967 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71513902-1657-4315-9838-87e57d9c1f25 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:12.260891 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71513902-1657-4315-9838-87e57d9c1f25 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:12.265968 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872df23-a282-4f84-a783-130f1fd0a8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:12.266733 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872df23-a282-4f84-a783-130f1fd0a8cb admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:12.267163 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872df23-a282-4f84-a783-130f1fd0a8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:12.267451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872df23-a282-4f84-a783-130f1fd0a8cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:12.268201 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872df23-a282-4f84-a783-130f1fd0a8cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:12:12.268516 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872df23-a282-4f84-a783-130f1fd0a8cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:12.270471 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872df23-a282-4f84-a783-130f1fd0a8cb admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:12.283725 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1049/2081] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:12:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:12:12.288486 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ba282-b8f3-4834-802e-3e14c255e1f1 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:12.298745 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ba282-b8f3-4834-802e-3e14c255e1f1 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:12.304763 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3a38e-5866-40f6-bffd-6c1e2266328f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:12.305596 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3a38e-5866-40f6-bffd-6c1e2266328f admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:12.305940 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3a38e-5866-40f6-bffd-6c1e2266328f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:12.306268 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3a38e-5866-40f6-bffd-6c1e2266328f admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:12.307333 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3a38e-5866-40f6-bffd-6c1e2266328f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:12.309448 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3a38e-5866-40f6-bffd-6c1e2266328f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:12.379376 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1033/2082] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:12:12 2022] POST /identity/v3/projects => generated 385 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:12:12.383425 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872df23-a282-4f84-a783-130f1fd0a8cb admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:12.398378 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872df23-a282-4f84-a783-130f1fd0a8cb admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:12.517535 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78e300-ad58-4731-a1a1-ac0ab8b57393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:12.518527 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78e300-ad58-4731-a1a1-ac0ab8b57393 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:12.518814 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78e300-ad58-4731-a1a1-ac0ab8b57393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:12.519094 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78e300-ad58-4731-a1a1-ac0ab8b57393 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:12.519917 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc78e300-ad58-4731-a1a1-ac0ab8b57393 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:12.522257 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc78e300-ad58-4731-a1a1-ac0ab8b57393 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:12.551374 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1050/2083] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:12:12 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:12:12.558525 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3a38e-5866-40f6-bffd-6c1e2266328f admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:12.569563 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3a38e-5866-40f6-bffd-6c1e2266328f admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:12.577144 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2cd3a-7fb3-4289-9321-13dd23d5078d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:12.577846 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2cd3a-7fb3-4289-9321-13dd23d5078d admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:12.578146 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2cd3a-7fb3-4289-9321-13dd23d5078d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:12.578889 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2cd3a-7fb3-4289-9321-13dd23d5078d admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:12.580055 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf2cd3a-7fb3-4289-9321-13dd23d5078d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:12.582256 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf2cd3a-7fb3-4289-9321-13dd23d5078d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:12.596829 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1034/2084] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:12:12.602607 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78e300-ad58-4731-a1a1-ac0ab8b57393 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:12.616016 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78e300-ad58-4731-a1a1-ac0ab8b57393 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:12.622962 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334df21f-15ac-4f10-8d3d-93130201be94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:12.623753 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334df21f-15ac-4f10-8d3d-93130201be94 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:12.624101 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334df21f-15ac-4f10-8d3d-93130201be94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:12.624449 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334df21f-15ac-4f10-8d3d-93130201be94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:12.625397 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334df21f-15ac-4f10-8d3d-93130201be94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:12.628765 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334df21f-15ac-4f10-8d3d-93130201be94 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:12.641948 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1051/2085] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:12:12.645862 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2cd3a-7fb3-4289-9321-13dd23d5078d admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:12.663017 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2cd3a-7fb3-4289-9321-13dd23d5078d admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:12.668217 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5780a1-ca39-4ed7-8836-15d705795dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:12.669184 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5780a1-ca39-4ed7-8836-15d705795dda admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:12.669417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5780a1-ca39-4ed7-8836-15d705795dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:12.669699 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5780a1-ca39-4ed7-8836-15d705795dda admin admin] PATH_INFO: `/v3/projects/e694504de3054a09a5db93a0a16d4b5d/users/30835bc714a043e2b13745338c956cda/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:12.684698 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:12.690115 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5780a1-ca39-4ed7-8836-15d705795dda admin admin] RBAC: Authorizing `identity:create_grant(project_id=e694504de3054a09a5db93a0a16d4b5d, user_id=30835bc714a043e2b13745338c956cda, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:12.694593 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5780a1-ca39-4ed7-8836-15d705795dda admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:12.723426 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1035/2086] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:12:12 2022] PUT /identity/v3/projects/e694504de3054a09a5db93a0a16d4b5d/users/30835bc714a043e2b13745338c956cda/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:12.735498 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0f4cc-a444-4e45-bec7-122d30948049 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:12.735796 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0f4cc-a444-4e45-bec7-122d30948049 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:12.736316 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0f4cc-a444-4e45-bec7-122d30948049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:12.775049 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-21e0f4cc-a444-4e45-bec7-122d30948049 None None] MFA Rules not processed for user `30835bc714a043e2b13745338c956cda`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:12.776836 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-21e0f4cc-a444-4e45-bec7-122d30948049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:12.862341 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1052/2087] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:12.870743 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5780a1-ca39-4ed7-8836-15d705795dda admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:12.872893 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-8b5780a1-ca39-4ed7-8836-15d705795dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:12.948003 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5780a1-ca39-4ed7-8836-15d705795dda admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:12.952327 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1fb21-9411-4f5a-b219-5101e25587e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:12.953002 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1fb21-9411-4f5a-b219-5101e25587e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:12.953297 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1fb21-9411-4f5a-b219-5101e25587e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:12.953584 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1fb21-9411-4f5a-b219-5101e25587e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:12.963547 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1fb21-9411-4f5a-b219-5101e25587e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:12.965380 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1fb21-9411-4f5a-b219-5101e25587e1 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:12.978212 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1036/2088] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:12:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:12:13.313418 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e0f4cc-a444-4e45-bec7-122d30948049 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:13.315157 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-21e0f4cc-a444-4e45-bec7-122d30948049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:13.391749 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:13.409440 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e0f4cc-a444-4e45-bec7-122d30948049 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:13.415784 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fdeff-9d1e-4e16-9aef-f53f5e463953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:13.417433 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fdeff-9d1e-4e16-9aef-f53f5e463953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:13.417604 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fdeff-9d1e-4e16-9aef-f53f5e463953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:13.417883 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fdeff-9d1e-4e16-9aef-f53f5e463953 admin admin] PATH_INFO: `/v3/projects/e2bd793d5f5c4a4aa0cae1b432b1d586` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:13.419240 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14fdeff-9d1e-4e16-9aef-f53f5e463953 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2bd793d5f5c4a4aa0cae1b432b1d586)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:13.421691 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14fdeff-9d1e-4e16-9aef-f53f5e463953 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:13.499670 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a14fdeff-9d1e-4e16-9aef-f53f5e463953 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2bd793d5f5c4a4aa0cae1b432b1d586', 'request_id': 'req-a14fdeff-9d1e-4e16-9aef-f53f5e463953'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:13.510272 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a14fdeff-9d1e-4e16-9aef-f53f5e463953 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2bd793d5f5c4a4aa0cae1b432b1d586', 'request_id': 'req-a14fdeff-9d1e-4e16-9aef-f53f5e463953'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:13.526109 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a14fdeff-9d1e-4e16-9aef-f53f5e463953 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2bd793d5f5c4a4aa0cae1b432b1d586', 'request_id': 'req-a14fdeff-9d1e-4e16-9aef-f53f5e463953'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:13.545256 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a14fdeff-9d1e-4e16-9aef-f53f5e463953 admin admin] The token cache is being invalidate because project e2bd793d5f5c4a4aa0cae1b432b1d586 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:12:13.546168 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a14fdeff-9d1e-4e16-9aef-f53f5e463953 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:13.546620 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a14fdeff-9d1e-4e16-9aef-f53f5e463953 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:13.549055 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1053/2089] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:12:13 2022] DELETE /identity/v3/projects/e2bd793d5f5c4a4aa0cae1b432b1d586 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:13.555423 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534fd040-ed05-47b3-8de7-75649dd471f7 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:13.555919 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534fd040-ed05-47b3-8de7-75649dd471f7 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:13.556212 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534fd040-ed05-47b3-8de7-75649dd471f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:13.578403 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-534fd040-ed05-47b3-8de7-75649dd471f7 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:13.579658 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-534fd040-ed05-47b3-8de7-75649dd471f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:13.649536 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1037/2090] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:13.657117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f04c1-4746-4529-8fdc-480ebe4a407a None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:13.657412 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f04c1-4746-4529-8fdc-480ebe4a407a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:13.657706 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f04c1-4746-4529-8fdc-480ebe4a407a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:13.681263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-bb6f04c1-4746-4529-8fdc-480ebe4a407a None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:13.682938 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-bb6f04c1-4746-4529-8fdc-480ebe4a407a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:13.697418 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1054/2091] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:13.701577 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534fd040-ed05-47b3-8de7-75649dd471f7 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:13.716449 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534fd040-ed05-47b3-8de7-75649dd471f7 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:13.721711 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ede0f-c4b1-4c02-9b0f-bdc98c9335ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:13.722396 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ede0f-c4b1-4c02-9b0f-bdc98c9335ff admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:13.722686 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ede0f-c4b1-4c02-9b0f-bdc98c9335ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:13.722970 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ede0f-c4b1-4c02-9b0f-bdc98c9335ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:13.723718 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ede0f-c4b1-4c02-9b0f-bdc98c9335ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:12:13.724258 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ede0f-c4b1-4c02-9b0f-bdc98c9335ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:13.726075 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ede0f-c4b1-4c02-9b0f-bdc98c9335ff admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:13.742195 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1038/2092] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:12:13.745135 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f04c1-4746-4529-8fdc-480ebe4a407a None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:13.755932 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f04c1-4746-4529-8fdc-480ebe4a407a None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:13.761086 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc3ef8-6c70-4a3c-bc0d-3ce53adcf7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:13.761818 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc3ef8-6c70-4a3c-bc0d-3ce53adcf7f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:13.762683 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc3ef8-6c70-4a3c-bc0d-3ce53adcf7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:13.763042 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc3ef8-6c70-4a3c-bc0d-3ce53adcf7f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:13.763818 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bc3ef8-6c70-4a3c-bc0d-3ce53adcf7f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:13.766449 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bc3ef8-6c70-4a3c-bc0d-3ce53adcf7f3 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:13.808148 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1055/2093] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:12:13 2022] POST /identity/v3/projects => generated 359 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:12:13.809587 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ede0f-c4b1-4c02-9b0f-bdc98c9335ff admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:13.822770 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ede0f-c4b1-4c02-9b0f-bdc98c9335ff admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:13.898701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94c7af-77de-4eb7-8b30-15abc495ec8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:13.899167 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94c7af-77de-4eb7-8b30-15abc495ec8e admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:13.899448 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94c7af-77de-4eb7-8b30-15abc495ec8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:13.899744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94c7af-77de-4eb7-8b30-15abc495ec8e admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:13.900443 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca94c7af-77de-4eb7-8b30-15abc495ec8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:13.902828 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca94c7af-77de-4eb7-8b30-15abc495ec8e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:13.934009 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1039/2094] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:12:13 2022] POST /identity/v3/users => generated 280 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:12:13.938559 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc3ef8-6c70-4a3c-bc0d-3ce53adcf7f3 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:13.952007 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc3ef8-6c70-4a3c-bc0d-3ce53adcf7f3 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:13.959786 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616dcb26-43ff-42f7-a9a1-4469452f4b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:13.960962 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616dcb26-43ff-42f7-a9a1-4469452f4b7f admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:13.961599 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616dcb26-43ff-42f7-a9a1-4469452f4b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:13.962055 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616dcb26-43ff-42f7-a9a1-4469452f4b7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:13.963007 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616dcb26-43ff-42f7-a9a1-4469452f4b7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:13.965074 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616dcb26-43ff-42f7-a9a1-4469452f4b7f admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:13.982090 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1056/2095] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:12:13.988050 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94c7af-77de-4eb7-8b30-15abc495ec8e admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:14.002237 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94c7af-77de-4eb7-8b30-15abc495ec8e admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:14.013544 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e365aaf-9428-4310-91ba-a564676cdac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:14.014379 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e365aaf-9428-4310-91ba-a564676cdac8 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:14.014744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e365aaf-9428-4310-91ba-a564676cdac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:14.015144 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e365aaf-9428-4310-91ba-a564676cdac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:14.015981 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e365aaf-9428-4310-91ba-a564676cdac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:14.017888 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e365aaf-9428-4310-91ba-a564676cdac8 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:14.025616 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:14.034211 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1040/2096] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 04:12:14.038385 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616dcb26-43ff-42f7-a9a1-4469452f4b7f admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:14.048580 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616dcb26-43ff-42f7-a9a1-4469452f4b7f admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:14.053753 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07762aaf-7cea-403d-a0db-ac5121cf3cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:14.054877 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07762aaf-7cea-403d-a0db-ac5121cf3cec admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:14.055158 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07762aaf-7cea-403d-a0db-ac5121cf3cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:14.055462 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07762aaf-7cea-403d-a0db-ac5121cf3cec admin admin] PATH_INFO: `/v3/projects/03e596d066f7430483cdce477ba154c0/users/0edc29ac0019485989e3dce43330b08e/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:14.077288 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07762aaf-7cea-403d-a0db-ac5121cf3cec admin admin] RBAC: Authorizing `identity:create_grant(project_id=03e596d066f7430483cdce477ba154c0, user_id=0edc29ac0019485989e3dce43330b08e, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:14.080199 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07762aaf-7cea-403d-a0db-ac5121cf3cec admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:14.105433 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1057/2097] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:12:14 2022] PUT /identity/v3/projects/03e596d066f7430483cdce477ba154c0/users/0edc29ac0019485989e3dce43330b08e/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:14.107943 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013a018-c0fd-4805-bf2e-4fc0de8a4558 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:14.108237 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013a018-c0fd-4805-bf2e-4fc0de8a4558 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:14.108594 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013a018-c0fd-4805-bf2e-4fc0de8a4558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:14.142941 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-1013a018-c0fd-4805-bf2e-4fc0de8a4558 None None] MFA Rules not processed for user `0edc29ac0019485989e3dce43330b08e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:14.145400 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1013a018-c0fd-4805-bf2e-4fc0de8a4558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:14.237076 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1041/2098] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:14 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:12:14.273242 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07762aaf-7cea-403d-a0db-ac5121cf3cec admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:14.275054 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-07762aaf-7cea-403d-a0db-ac5121cf3cec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:14.349843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07762aaf-7cea-403d-a0db-ac5121cf3cec admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:14.354667 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f2449-6d2a-4bce-93ba-9046d1ffb906 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:14.356143 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f2449-6d2a-4bce-93ba-9046d1ffb906 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:14.356682 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f2449-6d2a-4bce-93ba-9046d1ffb906 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:14.357187 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f2449-6d2a-4bce-93ba-9046d1ffb906 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:14.368500 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f2449-6d2a-4bce-93ba-9046d1ffb906 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:14.370096 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f2449-6d2a-4bce-93ba-9046d1ffb906 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:14.380347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1058/2099] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:12:14 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:12:14.395684 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013a018-c0fd-4805-bf2e-4fc0de8a4558 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:14.494460 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013a018-c0fd-4805-bf2e-4fc0de8a4558 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:14.500556 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82125529-1cbc-412e-9467-8052fc117127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:14.505007 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82125529-1cbc-412e-9467-8052fc117127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:14.518648 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82125529-1cbc-412e-9467-8052fc117127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:14.519185 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82125529-1cbc-412e-9467-8052fc117127 admin admin] PATH_INFO: `/v3/users/0edc29ac0019485989e3dce43330b08e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:14.520741 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82125529-1cbc-412e-9467-8052fc117127 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0edc29ac0019485989e3dce43330b08e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:14.523076 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82125529-1cbc-412e-9467-8052fc117127 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:14.629290 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-82125529-1cbc-412e-9467-8052fc117127 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0edc29ac0019485989e3dce43330b08e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:14.630079 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-82125529-1cbc-412e-9467-8052fc117127 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0edc29ac0019485989e3dce43330b08e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:14.648862 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-82125529-1cbc-412e-9467-8052fc117127 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0edc29ac0019485989e3dce43330b08e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:14.676031 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-82125529-1cbc-412e-9467-8052fc117127 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0edc29ac0019485989e3dce43330b08e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:14.677410 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-82125529-1cbc-412e-9467-8052fc117127 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0edc29ac0019485989e3dce43330b08e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:14.713368 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1042/2100] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:12:14 2022] DELETE /identity/v3/users/0edc29ac0019485989e3dce43330b08e => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:14.722617 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdab248-b4f0-4cf6-8adc-b738da18447a None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:14.723040 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdab248-b4f0-4cf6-8adc-b738da18447a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:14.723282 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdab248-b4f0-4cf6-8adc-b738da18447a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:14.763112 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-0cdab248-b4f0-4cf6-8adc-b738da18447a None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:14.764380 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0cdab248-b4f0-4cf6-8adc-b738da18447a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:14.773907 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82125529-1cbc-412e-9467-8052fc117127 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:14.775505 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-82125529-1cbc-412e-9467-8052fc117127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:14.791438 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:14.822529 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:14.939120 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1059/2101] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:14.944287 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82125529-1cbc-412e-9467-8052fc117127 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:14.949340 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c9e3e-956f-4cbb-955f-2867a82b600d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:14.950279 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c9e3e-956f-4cbb-955f-2867a82b600d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:14.950567 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c9e3e-956f-4cbb-955f-2867a82b600d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:14.950672 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdab248-b4f0-4cf6-8adc-b738da18447a None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:14.950856 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c9e3e-956f-4cbb-955f-2867a82b600d admin admin] PATH_INFO: `/v3/users/a5324ed2f18b4119a505c13989554936` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:14.952386 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c9e3e-956f-4cbb-955f-2867a82b600d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5324ed2f18b4119a505c13989554936)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:14.953598 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0cdab248-b4f0-4cf6-8adc-b738da18447a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:14.954301 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c9e3e-956f-4cbb-955f-2867a82b600d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:15.024406 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-903c9e3e-956f-4cbb-955f-2867a82b600d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5324ed2f18b4119a505c13989554936'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:15.025240 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-903c9e3e-956f-4cbb-955f-2867a82b600d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5324ed2f18b4119a505c13989554936'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:15.037649 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-903c9e3e-956f-4cbb-955f-2867a82b600d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5324ed2f18b4119a505c13989554936'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:15.056737 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdab248-b4f0-4cf6-8adc-b738da18447a None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:15.057756 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-903c9e3e-956f-4cbb-955f-2867a82b600d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5324ed2f18b4119a505c13989554936'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:15.058582 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-903c9e3e-956f-4cbb-955f-2867a82b600d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5324ed2f18b4119a505c13989554936'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:15.063355 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818f71c-5347-45aa-8856-5437084cc82e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:15.064188 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818f71c-5347-45aa-8856-5437084cc82e service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:15.064522 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818f71c-5347-45aa-8856-5437084cc82e service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:15.064806 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818f71c-5347-45aa-8856-5437084cc82e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:15.068439 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a818f71c-5347-45aa-8856-5437084cc82e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:15.075618 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1043/2102] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:12:14 2022] DELETE /identity/v3/users/a5324ed2f18b4119a505c13989554936 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:15.081259 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07508e-16ac-493e-bb0d-c8c426ed0cab None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:15.081554 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07508e-16ac-493e-bb0d-c8c426ed0cab None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:15.081927 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07508e-16ac-493e-bb0d-c8c426ed0cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:15.091910 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818f71c-5347-45aa-8856-5437084cc82e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:15.093732 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818f71c-5347-45aa-8856-5437084cc82e service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:15.120252 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1060/2103] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:12:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 04:12:15.123627 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-bb07508e-16ac-493e-bb0d-c8c426ed0cab None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:15.125561 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-bb07508e-16ac-493e-bb0d-c8c426ed0cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:15.234828 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1044/2104] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:15.241143 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818f71c-5347-45aa-8856-5437084cc82e service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:15.243315 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a818f71c-5347-45aa-8856-5437084cc82e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:15.268661 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818f71c-5347-45aa-8856-5437084cc82e service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:15.355541 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49e1db-5a12-4f7c-a714-34a41730283e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:15.356889 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49e1db-5a12-4f7c-a714-34a41730283e service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:15.357239 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49e1db-5a12-4f7c-a714-34a41730283e service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:15.357616 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49e1db-5a12-4f7c-a714-34a41730283e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:15.371978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a49e1db-5a12-4f7c-a714-34a41730283e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:15.373444 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a49e1db-5a12-4f7c-a714-34a41730283e service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:15.386871 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1061/2105] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:12:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 04:12:15.533835 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07508e-16ac-493e-bb0d-c8c426ed0cab None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:15.535546 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-bb07508e-16ac-493e-bb0d-c8c426ed0cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:15.548793 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07508e-16ac-493e-bb0d-c8c426ed0cab None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:15.555232 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72794163-ad45-40fd-b4a7-5188d0e130a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:15.556419 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72794163-ad45-40fd-b4a7-5188d0e130a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:15.556707 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72794163-ad45-40fd-b4a7-5188d0e130a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:15.557187 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72794163-ad45-40fd-b4a7-5188d0e130a9 admin admin] PATH_INFO: `/v3/projects/03e596d066f7430483cdce477ba154c0` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:15.558784 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72794163-ad45-40fd-b4a7-5188d0e130a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03e596d066f7430483cdce477ba154c0)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:15.561030 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72794163-ad45-40fd-b4a7-5188d0e130a9 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:15.602419 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:15.631220 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-72794163-ad45-40fd-b4a7-5188d0e130a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03e596d066f7430483cdce477ba154c0', 'request_id': 'req-72794163-ad45-40fd-b4a7-5188d0e130a9'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:15.639547 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-72794163-ad45-40fd-b4a7-5188d0e130a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03e596d066f7430483cdce477ba154c0', 'request_id': 'req-72794163-ad45-40fd-b4a7-5188d0e130a9'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:15.649168 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-72794163-ad45-40fd-b4a7-5188d0e130a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03e596d066f7430483cdce477ba154c0', 'request_id': 'req-72794163-ad45-40fd-b4a7-5188d0e130a9'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:15.666026 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-72794163-ad45-40fd-b4a7-5188d0e130a9 admin admin] The token cache is being invalidate because project 03e596d066f7430483cdce477ba154c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:12:15.666349 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-72794163-ad45-40fd-b4a7-5188d0e130a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:15.667607 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-72794163-ad45-40fd-b4a7-5188d0e130a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:15.669186 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1045/2106] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:12:15 2022] DELETE /identity/v3/projects/03e596d066f7430483cdce477ba154c0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:15.675229 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b66d01-2b66-4a05-ae91-4c176ddce766 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:15.676792 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b66d01-2b66-4a05-ae91-4c176ddce766 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:15.677702 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b66d01-2b66-4a05-ae91-4c176ddce766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:15.702009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-02b66d01-2b66-4a05-ae91-4c176ddce766 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:15.703367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-02b66d01-2b66-4a05-ae91-4c176ddce766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:15.739301 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72794163-ad45-40fd-b4a7-5188d0e130a9 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:15.741074 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-72794163-ad45-40fd-b4a7-5188d0e130a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:15.784814 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1062/2107] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:15.792835 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5bcd8-6405-4f94-a4d0-4c137c7c3dc9 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:15.792835 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5bcd8-6405-4f94-a4d0-4c137c7c3dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:15.793227 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5bcd8-6405-4f94-a4d0-4c137c7c3dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:15.814948 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-e0f5bcd8-6405-4f94-a4d0-4c137c7c3dc9 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:15.816377 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e0f5bcd8-6405-4f94-a4d0-4c137c7c3dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:15.823791 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72794163-ad45-40fd-b4a7-5188d0e130a9 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:15.829893 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1063/2108] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:12:15.831682 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768aa4f7-d776-468d-81a7-04d50c17bf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:15.832744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768aa4f7-d776-468d-81a7-04d50c17bf0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:15.833133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768aa4f7-d776-468d-81a7-04d50c17bf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:15.833424 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768aa4f7-d776-468d-81a7-04d50c17bf0d admin admin] PATH_INFO: `/v3/projects/2dd6100c57b944ef9dc20223d3614232` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:15.835021 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5bcd8-6405-4f94-a4d0-4c137c7c3dc9 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:15.840364 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:15.841373 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768aa4f7-d776-468d-81a7-04d50c17bf0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dd6100c57b944ef9dc20223d3614232)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:15.843374 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768aa4f7-d776-468d-81a7-04d50c17bf0d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:15.853808 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5bcd8-6405-4f94-a4d0-4c137c7c3dc9 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:15.860165 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14e21d-d861-49de-925c-df8f9d26f28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:15.860855 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14e21d-d861-49de-925c-df8f9d26f28a admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:15.861246 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14e21d-d861-49de-925c-df8f9d26f28a admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:15.861645 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14e21d-d861-49de-925c-df8f9d26f28a admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:15.862498 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14e21d-d861-49de-925c-df8f9d26f28a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:12:15.862834 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14e21d-d861-49de-925c-df8f9d26f28a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:15.864631 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14e21d-d861-49de-925c-df8f9d26f28a admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:15.880037 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1064/2109] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:12:15.884584 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14e21d-d861-49de-925c-df8f9d26f28a admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:15.895877 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14e21d-d861-49de-925c-df8f9d26f28a admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:15.910173 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-768aa4f7-d776-468d-81a7-04d50c17bf0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dd6100c57b944ef9dc20223d3614232', 'request_id': 'req-768aa4f7-d776-468d-81a7-04d50c17bf0d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:15.917460 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-768aa4f7-d776-468d-81a7-04d50c17bf0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dd6100c57b944ef9dc20223d3614232', 'request_id': 'req-768aa4f7-d776-468d-81a7-04d50c17bf0d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:15.930501 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-768aa4f7-d776-468d-81a7-04d50c17bf0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dd6100c57b944ef9dc20223d3614232', 'request_id': 'req-768aa4f7-d776-468d-81a7-04d50c17bf0d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:15.964742 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-768aa4f7-d776-468d-81a7-04d50c17bf0d admin admin] The token cache is being invalidate because project 2dd6100c57b944ef9dc20223d3614232 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:12:15.966184 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-768aa4f7-d776-468d-81a7-04d50c17bf0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:15.967493 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-768aa4f7-d776-468d-81a7-04d50c17bf0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:15.973860 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1046/2110] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:12:15 2022] DELETE /identity/v3/projects/2dd6100c57b944ef9dc20223d3614232 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:15.979004 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a07c2d-def1-4728-8ec1-96f5a6d20b3e None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:15.979391 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a07c2d-def1-4728-8ec1-96f5a6d20b3e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:15.979734 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a07c2d-def1-4728-8ec1-96f5a6d20b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:16.008798 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0465ac-ca3d-4194-b5bd-5cfa147f4a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:16.010446 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0465ac-ca3d-4194-b5bd-5cfa147f4a23 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:16.011257 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0465ac-ca3d-4194-b5bd-5cfa147f4a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:16.012177 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0465ac-ca3d-4194-b5bd-5cfa147f4a23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:16.013839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0465ac-ca3d-4194-b5bd-5cfa147f4a23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:16.016717 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0465ac-ca3d-4194-b5bd-5cfa147f4a23 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:16.020470 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-20a07c2d-def1-4728-8ec1-96f5a6d20b3e None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:16.021966 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-20a07c2d-def1-4728-8ec1-96f5a6d20b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:16.042737 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1047/2111] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:16.042737 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a07c2d-def1-4728-8ec1-96f5a6d20b3e None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:16.042737 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-20a07c2d-def1-4728-8ec1-96f5a6d20b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:16.052039 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a07c2d-def1-4728-8ec1-96f5a6d20b3e None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:16.057018 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc6a4a-041c-4f49-a922-2009e9888c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:16.060338 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1065/2112] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:12:15 2022] POST /identity/v3/projects => generated 375 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:12:16.060445 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc6a4a-041c-4f49-a922-2009e9888c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:16.060445 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc6a4a-041c-4f49-a922-2009e9888c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:16.060445 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc6a4a-041c-4f49-a922-2009e9888c8e admin admin] PATH_INFO: `/v3/users/30835bc714a043e2b13745338c956cda` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:16.060663 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cf0d6-9d9d-4258-85f5-9b1ab676b9a5 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:16.060663 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cf0d6-9d9d-4258-85f5-9b1ab676b9a5 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:16.060663 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cf0d6-9d9d-4258-85f5-9b1ab676b9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:16.060941 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dc6a4a-041c-4f49-a922-2009e9888c8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=30835bc714a043e2b13745338c956cda)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:16.062977 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dc6a4a-041c-4f49-a922-2009e9888c8e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:16.077533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-9c8cf0d6-9d9d-4258-85f5-9b1ab676b9a5 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:16.078838 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9c8cf0d6-9d9d-4258-85f5-9b1ab676b9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:16.109509 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:16.127933 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e1dc6a4a-041c-4f49-a922-2009e9888c8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30835bc714a043e2b13745338c956cda'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:16.128823 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e1dc6a4a-041c-4f49-a922-2009e9888c8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30835bc714a043e2b13745338c956cda'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:16.139090 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e1dc6a4a-041c-4f49-a922-2009e9888c8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30835bc714a043e2b13745338c956cda'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:16.156259 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1066/2113] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:16.157375 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8cf0d6-9d9d-4258-85f5-9b1ab676b9a5 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:16.161962 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9c8cf0d6-9d9d-4258-85f5-9b1ab676b9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:16.162802 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e1dc6a4a-041c-4f49-a922-2009e9888c8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30835bc714a043e2b13745338c956cda'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:16.163646 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e1dc6a4a-041c-4f49-a922-2009e9888c8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30835bc714a043e2b13745338c956cda'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:16.174137 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8cf0d6-9d9d-4258-85f5-9b1ab676b9a5 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:16.178854 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1048/2114] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:12:16 2022] DELETE /identity/v3/users/30835bc714a043e2b13745338c956cda => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:16.179701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc6a4a-041c-4f49-a922-2009e9888c8e admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:16.181023 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e1dc6a4a-041c-4f49-a922-2009e9888c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:16.182144 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b485c7-d4a7-4b23-b84d-26986b337520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:16.182896 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b485c7-d4a7-4b23-b84d-26986b337520 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:16.183192 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b485c7-d4a7-4b23-b84d-26986b337520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:16.183476 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b485c7-d4a7-4b23-b84d-26986b337520 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:16.184198 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b485c7-d4a7-4b23-b84d-26986b337520 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:16.186232 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b485c7-d4a7-4b23-b84d-26986b337520 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:16.208265 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1067/2115] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:12:16 2022] POST /identity/v3/users => generated 288 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:12:16.209529 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4bff80-9087-432c-b39e-a722dba04f2d None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:16.209889 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4bff80-9087-432c-b39e-a722dba04f2d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:16.210204 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4bff80-9087-432c-b39e-a722dba04f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:16.240137 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-fb4bff80-9087-432c-b39e-a722dba04f2d None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:16.242779 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-fb4bff80-9087-432c-b39e-a722dba04f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:16.272078 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc6a4a-041c-4f49-a922-2009e9888c8e admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:16.280148 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552913a-02be-4fad-9447-36a8d5b3964f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:16.280969 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552913a-02be-4fad-9447-36a8d5b3964f admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:16.281262 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552913a-02be-4fad-9447-36a8d5b3964f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:16.281551 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552913a-02be-4fad-9447-36a8d5b3964f admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:16.282332 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552913a-02be-4fad-9447-36a8d5b3964f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:12:16.282651 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552913a-02be-4fad-9447-36a8d5b3964f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:16.284338 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552913a-02be-4fad-9447-36a8d5b3964f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:16.302213 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1049/2116] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:12:16.302213 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552913a-02be-4fad-9447-36a8d5b3964f admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:16.305095 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0552913a-02be-4fad-9447-36a8d5b3964f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:16.315033 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:16.318504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552913a-02be-4fad-9447-36a8d5b3964f admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:16.323560 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defe049-9b83-475e-9cff-d740427c3930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:16.324328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defe049-9b83-475e-9cff-d740427c3930 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:16.324623 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defe049-9b83-475e-9cff-d740427c3930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:16.325077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defe049-9b83-475e-9cff-d740427c3930 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:16.325966 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5defe049-9b83-475e-9cff-d740427c3930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:16.327516 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1068/2117] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:16.327637 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5defe049-9b83-475e-9cff-d740427c3930 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:16.332331 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4bff80-9087-432c-b39e-a722dba04f2d None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:16.347689 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1050/2118] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:12:16.347689 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defe049-9b83-475e-9cff-d740427c3930 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:16.348004 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4bff80-9087-432c-b39e-a722dba04f2d None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:16.348114 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5defe049-9b83-475e-9cff-d740427c3930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:16.354242 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94b3a2-29e3-4452-82d6-74a84655a182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:16.355059 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94b3a2-29e3-4452-82d6-74a84655a182 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:16.356039 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94b3a2-29e3-4452-82d6-74a84655a182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:16.356606 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94b3a2-29e3-4452-82d6-74a84655a182 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:16.357340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac94b3a2-29e3-4452-82d6-74a84655a182 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:16.359414 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac94b3a2-29e3-4452-82d6-74a84655a182 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:16.394911 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1069/2119] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:12:16 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:12:16.395807 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94b3a2-29e3-4452-82d6-74a84655a182 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:16.418131 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defe049-9b83-475e-9cff-d740427c3930 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:16.473720 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94b3a2-29e3-4452-82d6-74a84655a182 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:16.479415 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7daa870-e5d0-4739-95c7-1726182f3f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:16.480329 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7daa870-e5d0-4739-95c7-1726182f3f94 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:16.480685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7daa870-e5d0-4739-95c7-1726182f3f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:16.481033 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7daa870-e5d0-4739-95c7-1726182f3f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:16.482113 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7daa870-e5d0-4739-95c7-1726182f3f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:16.484020 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7daa870-e5d0-4739-95c7-1726182f3f94 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:16.498707 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:16.499819 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1070/2120] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:12:16.500997 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7daa870-e5d0-4739-95c7-1726182f3f94 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:16.506425 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b40f0-48ef-42a6-b119-acb441f22da8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:16.507163 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b40f0-48ef-42a6-b119-acb441f22da8 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:16.507444 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b40f0-48ef-42a6-b119-acb441f22da8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:16.507719 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b40f0-48ef-42a6-b119-acb441f22da8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:16.522172 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7daa870-e5d0-4739-95c7-1726182f3f94 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:16.525548 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b40f0-48ef-42a6-b119-acb441f22da8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:16.527603 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b40f0-48ef-42a6-b119-acb441f22da8 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:16.529012 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6002713-94b7-42f5-bee9-b3b35131c6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:16.529707 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6002713-94b7-42f5-bee9-b3b35131c6d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:16.529996 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6002713-94b7-42f5-bee9-b3b35131c6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:16.530955 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6002713-94b7-42f5-bee9-b3b35131c6d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:16.531885 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6002713-94b7-42f5-bee9-b3b35131c6d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:16.535155 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6002713-94b7-42f5-bee9-b3b35131c6d6 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:16.539436 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1051/2121] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:12:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:12:16.540667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b40f0-48ef-42a6-b119-acb441f22da8 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:16.542053 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-337b40f0-48ef-42a6-b119-acb441f22da8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:16.559045 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b40f0-48ef-42a6-b119-acb441f22da8 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:16.568078 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1071/2122] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:12:16 2022] POST /identity/v3/users => generated 287 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:12:16.568078 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6002713-94b7-42f5-bee9-b3b35131c6d6 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:16.572240 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ce21a-5c3a-4124-be9a-3fcf404892b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:16.573218 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ce21a-5c3a-4124-be9a-3fcf404892b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:16.573665 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ce21a-5c3a-4124-be9a-3fcf404892b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:16.573950 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ce21a-5c3a-4124-be9a-3fcf404892b9 admin admin] PATH_INFO: `/v3/users/e43cfb2abe424678a128c12f8b2df6dc` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:16.575271 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ce21a-5c3a-4124-be9a-3fcf404892b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e43cfb2abe424678a128c12f8b2df6dc)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:16.577258 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ce21a-5c3a-4124-be9a-3fcf404892b9 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:16.588307 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6002713-94b7-42f5-bee9-b3b35131c6d6 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:16.594301 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8162492-56be-423f-85e1-443ab6a74db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:16.595754 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8162492-56be-423f-85e1-443ab6a74db6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:16.596059 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8162492-56be-423f-85e1-443ab6a74db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:16.596345 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8162492-56be-423f-85e1-443ab6a74db6 admin admin] PATH_INFO: `/v3/projects/b388cd2d35214808886ea6b8860e4a5c/users/b146543a9c0e472a9fd5247bd59b1a38/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:16.617848 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8162492-56be-423f-85e1-443ab6a74db6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b388cd2d35214808886ea6b8860e4a5c, user_id=b146543a9c0e472a9fd5247bd59b1a38, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:16.620832 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8162492-56be-423f-85e1-443ab6a74db6 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:16.640903 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1072/2123] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:12:16 2022] PUT /identity/v3/projects/b388cd2d35214808886ea6b8860e4a5c/users/b146543a9c0e472a9fd5247bd59b1a38/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:16.641971 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8162492-56be-423f-85e1-443ab6a74db6 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:16.656463 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-944ce21a-5c3a-4124-be9a-3fcf404892b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e43cfb2abe424678a128c12f8b2df6dc'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:16.657182 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-944ce21a-5c3a-4124-be9a-3fcf404892b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e43cfb2abe424678a128c12f8b2df6dc'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:16.668884 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-944ce21a-5c3a-4124-be9a-3fcf404892b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e43cfb2abe424678a128c12f8b2df6dc'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:16.687297 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-944ce21a-5c3a-4124-be9a-3fcf404892b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e43cfb2abe424678a128c12f8b2df6dc'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:16.688325 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-944ce21a-5c3a-4124-be9a-3fcf404892b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e43cfb2abe424678a128c12f8b2df6dc'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:16.707654 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1052/2124] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:12:16 2022] DELETE /identity/v3/users/e43cfb2abe424678a128c12f8b2df6dc => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:16.707654 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc3e77-1ddc-4ef9-941d-407cd8d71184 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:16.707654 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc3e77-1ddc-4ef9-941d-407cd8d71184 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:16.707654 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc3e77-1ddc-4ef9-941d-407cd8d71184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:16.742178 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-a7fc3e77-1ddc-4ef9-941d-407cd8d71184 None None] MFA Rules not processed for user `b146543a9c0e472a9fd5247bd59b1a38`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:16.743419 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a7fc3e77-1ddc-4ef9-941d-407cd8d71184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:16.769483 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8162492-56be-423f-85e1-443ab6a74db6 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:16.829522 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:16.866003 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d7275-ef32-4b2c-a689-baab1a4a9298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:16.866812 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d7275-ef32-4b2c-a689-baab1a4a9298 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:16.867111 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d7275-ef32-4b2c-a689-baab1a4a9298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:16.867394 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d7275-ef32-4b2c-a689-baab1a4a9298 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:16.868150 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d7275-ef32-4b2c-a689-baab1a4a9298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:16.869838 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d7275-ef32-4b2c-a689-baab1a4a9298 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:16.886446 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1073/2125] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:12:16.889810 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71e36a-46ab-4521-811e-1c7051e457de None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:16.890109 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71e36a-46ab-4521-811e-1c7051e457de None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:16.890412 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71e36a-46ab-4521-811e-1c7051e457de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:16.891225 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1053/2126] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:16.892864 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc3e77-1ddc-4ef9-941d-407cd8d71184 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:16.895077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a7fc3e77-1ddc-4ef9-941d-407cd8d71184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:16.912394 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ef71e36a-46ab-4521-811e-1c7051e457de None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:16.913707 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ef71e36a-46ab-4521-811e-1c7051e457de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:16.917098 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc3e77-1ddc-4ef9-941d-407cd8d71184 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:16.924234 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1074/2127] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:16.925662 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772d83d-4309-4903-9e45-d01a20b26b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:16.926809 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772d83d-4309-4903-9e45-d01a20b26b64 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:16.927309 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772d83d-4309-4903-9e45-d01a20b26b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:16.927798 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772d83d-4309-4903-9e45-d01a20b26b64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:16.928818 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1772d83d-4309-4903-9e45-d01a20b26b64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:16.929463 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71e36a-46ab-4521-811e-1c7051e457de None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:16.930795 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ef71e36a-46ab-4521-811e-1c7051e457de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:16.931972 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1772d83d-4309-4903-9e45-d01a20b26b64 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:16.945828 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71e36a-46ab-4521-811e-1c7051e457de None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:16.948867 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1054/2128] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:12:16.949992 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772d83d-4309-4903-9e45-d01a20b26b64 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:16.951979 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1772d83d-4309-4903-9e45-d01a20b26b64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:16.958115 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e92e76-c269-4dfb-8bc2-b578a719d56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:16.959315 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e92e76-c269-4dfb-8bc2-b578a719d56f admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:16.959601 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e92e76-c269-4dfb-8bc2-b578a719d56f admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:16.959925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e92e76-c269-4dfb-8bc2-b578a719d56f admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:16.962207 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e92e76-c269-4dfb-8bc2-b578a719d56f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:16.965156 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e92e76-c269-4dfb-8bc2-b578a719d56f admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:17.001189 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1075/2129] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:12:16 2022] POST /identity/v3/projects => generated 375 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:12:17.002352 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e92e76-c269-4dfb-8bc2-b578a719d56f admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:17.014713 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:17.035091 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772d83d-4309-4903-9e45-d01a20b26b64 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:17.122994 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e92e76-c269-4dfb-8bc2-b578a719d56f admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:17.132997 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752888b-6af4-4b36-ac48-4538521dc409 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:17.133678 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752888b-6af4-4b36-ac48-4538521dc409 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:17.133968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752888b-6af4-4b36-ac48-4538521dc409 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:17.134287 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752888b-6af4-4b36-ac48-4538521dc409 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:17.149252 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a752888b-6af4-4b36-ac48-4538521dc409 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:17.151611 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a752888b-6af4-4b36-ac48-4538521dc409 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:17.160284 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68405990-372e-499b-9e20-44a2c01dd6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:17.161389 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68405990-372e-499b-9e20-44a2c01dd6fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:17.163710 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1055/2130] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:12:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:12:17.164100 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68405990-372e-499b-9e20-44a2c01dd6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:17.164494 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68405990-372e-499b-9e20-44a2c01dd6fd admin admin] PATH_INFO: `/v3/projects/4acc33ded4144025b9548b2e1ee46fbd/users/6cc1f9526a9f4802b121530a82b63a2f/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:17.164695 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752888b-6af4-4b36-ac48-4538521dc409 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:17.175291 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752888b-6af4-4b36-ac48-4538521dc409 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:17.181135 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a058b41-8a94-4800-bc48-0d12ba5efdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:17.181972 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a058b41-8a94-4800-bc48-0d12ba5efdf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:17.182383 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a058b41-8a94-4800-bc48-0d12ba5efdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:17.182720 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a058b41-8a94-4800-bc48-0d12ba5efdf2 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:17.183432 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a058b41-8a94-4800-bc48-0d12ba5efdf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:17.185400 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a058b41-8a94-4800-bc48-0d12ba5efdf2 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:17.203380 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68405990-372e-499b-9e20-44a2c01dd6fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4acc33ded4144025b9548b2e1ee46fbd, user_id=6cc1f9526a9f4802b121530a82b63a2f, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:17.206503 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68405990-372e-499b-9e20-44a2c01dd6fd admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:17.220778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1056/2131] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:12:17 2022] POST /identity/v3/users => generated 294 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:12:17.221849 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a058b41-8a94-4800-bc48-0d12ba5efdf2 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:17.226450 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-2a058b41-8a94-4800-bc48-0d12ba5efdf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:17.238449 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1076/2132] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:12:17 2022] PUT /identity/v3/projects/4acc33ded4144025b9548b2e1ee46fbd/users/6cc1f9526a9f4802b121530a82b63a2f/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:17.243558 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68405990-372e-499b-9e20-44a2c01dd6fd admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:17.247340 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a058b41-8a94-4800-bc48-0d12ba5efdf2 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:17.364826 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406a61e-962d-427e-8e9d-4a421074d118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:17.366570 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406a61e-962d-427e-8e9d-4a421074d118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:17.366964 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406a61e-962d-427e-8e9d-4a421074d118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:17.368018 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406a61e-962d-427e-8e9d-4a421074d118 admin admin] PATH_INFO: `/v3/projects/e694504de3054a09a5db93a0a16d4b5d` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:17.369495 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406a61e-962d-427e-8e9d-4a421074d118 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e694504de3054a09a5db93a0a16d4b5d)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:17.372564 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406a61e-962d-427e-8e9d-4a421074d118 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:17.396646 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68405990-372e-499b-9e20-44a2c01dd6fd admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:17.414041 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a4951-daf5-47cc-a90a-f6c9d1f18af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:17.415430 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a4951-daf5-47cc-a90a-f6c9d1f18af0 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:17.417292 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a4951-daf5-47cc-a90a-f6c9d1f18af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:17.417576 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a4951-daf5-47cc-a90a-f6c9d1f18af0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:17.420769 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a4951-daf5-47cc-a90a-f6c9d1f18af0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:17.422691 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a4951-daf5-47cc-a90a-f6c9d1f18af0 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:17.450102 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1077/2133] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:12:17.451627 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b9c5b-4ec3-4619-804b-716be8d15d7d None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:17.451921 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b9c5b-4ec3-4619-804b-716be8d15d7d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:17.452197 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b9c5b-4ec3-4619-804b-716be8d15d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:17.462492 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3406a61e-962d-427e-8e9d-4a421074d118 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e694504de3054a09a5db93a0a16d4b5d', 'request_id': 'req-3406a61e-962d-427e-8e9d-4a421074d118'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:17.476417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3406a61e-962d-427e-8e9d-4a421074d118 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e694504de3054a09a5db93a0a16d4b5d', 'request_id': 'req-3406a61e-962d-427e-8e9d-4a421074d118'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:17.476668 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ec6b9c5b-4ec3-4619-804b-716be8d15d7d None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:17.478792 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ec6b9c5b-4ec3-4619-804b-716be8d15d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:17.488913 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3406a61e-962d-427e-8e9d-4a421074d118 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e694504de3054a09a5db93a0a16d4b5d', 'request_id': 'req-3406a61e-962d-427e-8e9d-4a421074d118'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:17.516943 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3406a61e-962d-427e-8e9d-4a421074d118 admin admin] The token cache is being invalidate because project e694504de3054a09a5db93a0a16d4b5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:12:17.517507 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3406a61e-962d-427e-8e9d-4a421074d118 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:17.518534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3406a61e-962d-427e-8e9d-4a421074d118 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:17.521628 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1057/2134] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:12:17 2022] DELETE /identity/v3/projects/e694504de3054a09a5db93a0a16d4b5d => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:17.524686 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406a61e-962d-427e-8e9d-4a421074d118 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:17.526258 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3406a61e-962d-427e-8e9d-4a421074d118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:17.530252 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:17.556365 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:17.642743 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1078/2135] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:17.645865 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffe508-2d04-42ab-b5e4-6319d8a64f38 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:17.645865 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffe508-2d04-42ab-b5e4-6319d8a64f38 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:17.645865 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffe508-2d04-42ab-b5e4-6319d8a64f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:17.693690 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-f4ffe508-2d04-42ab-b5e4-6319d8a64f38 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:17.695093 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f4ffe508-2d04-42ab-b5e4-6319d8a64f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:17.705037 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1079/2136] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:17.711868 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406a61e-962d-427e-8e9d-4a421074d118 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:17.713877 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ffe508-2d04-42ab-b5e4-6319d8a64f38 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:17.715942 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f4ffe508-2d04-42ab-b5e4-6319d8a64f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:17.721621 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845650e-adc3-484e-9b50-9c0eab888943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:17.727200 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845650e-adc3-484e-9b50-9c0eab888943 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:17.727927 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845650e-adc3-484e-9b50-9c0eab888943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:17.728395 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845650e-adc3-484e-9b50-9c0eab888943 admin admin] PATH_INFO: `/v3/projects/c18c6ed90dac458d85c28263f9005144/users/cc9b003158d84e18b03867e61ce36592/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:17.762907 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845650e-adc3-484e-9b50-9c0eab888943 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c18c6ed90dac458d85c28263f9005144, user_id=cc9b003158d84e18b03867e61ce36592, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:17.766109 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845650e-adc3-484e-9b50-9c0eab888943 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:17.797076 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1058/2137] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:12:17 2022] PUT /identity/v3/projects/c18c6ed90dac458d85c28263f9005144/users/cc9b003158d84e18b03867e61ce36592/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:17.803864 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112a957-93b3-4e19-b992-c74b025442d3 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:17.804293 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112a957-93b3-4e19-b992-c74b025442d3 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:17.804575 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112a957-93b3-4e19-b992-c74b025442d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:17.814046 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ffe508-2d04-42ab-b5e4-6319d8a64f38 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:17.827822 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-5112a957-93b3-4e19-b992-c74b025442d3 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:17.829149 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5112a957-93b3-4e19-b992-c74b025442d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:17.913511 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1059/2138] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:17.914680 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112a957-93b3-4e19-b992-c74b025442d3 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:17.936009 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112a957-93b3-4e19-b992-c74b025442d3 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:17.943218 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b9ab6-a335-4ae3-8a99-7d964785efc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:17.944175 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b9ab6-a335-4ae3-8a99-7d964785efc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:17.944471 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b9ab6-a335-4ae3-8a99-7d964785efc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:17.944591 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f00240-bf88-4df3-9bf4-111c68b2ffa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:17.944749 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b9ab6-a335-4ae3-8a99-7d964785efc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:17.945306 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f00240-bf88-4df3-9bf4-111c68b2ffa2 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:17.945577 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b9ab6-a335-4ae3-8a99-7d964785efc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:17.945688 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f00240-bf88-4df3-9bf4-111c68b2ffa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:17.945861 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f00240-bf88-4df3-9bf4-111c68b2ffa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:17.948109 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b9ab6-a335-4ae3-8a99-7d964785efc9 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:17.963545 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1060/2139] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:12:17.968334 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b9ab6-a335-4ae3-8a99-7d964785efc9 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:17.991793 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b9ab6-a335-4ae3-8a99-7d964785efc9 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:17.995094 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f00240-bf88-4df3-9bf4-111c68b2ffa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:17.996681 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f00240-bf88-4df3-9bf4-111c68b2ffa2 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:17.997462 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe972664-bbb4-416f-94bd-9b6dae95388a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:18.001563 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe972664-bbb4-416f-94bd-9b6dae95388a admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:18.001932 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe972664-bbb4-416f-94bd-9b6dae95388a admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:18.002178 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe972664-bbb4-416f-94bd-9b6dae95388a admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:18.002954 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe972664-bbb4-416f-94bd-9b6dae95388a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:12:18.003328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe972664-bbb4-416f-94bd-9b6dae95388a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:18.006033 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe972664-bbb4-416f-94bd-9b6dae95388a admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:18.018920 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1080/2140] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:12:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 04:12:18.019834 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f00240-bf88-4df3-9bf4-111c68b2ffa2 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:18.026768 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1061/2141] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:12:18.027866 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe972664-bbb4-416f-94bd-9b6dae95388a admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:18.030967 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-fe972664-bbb4-416f-94bd-9b6dae95388a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:18.049966 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe972664-bbb4-416f-94bd-9b6dae95388a admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:18.050239 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f00240-bf88-4df3-9bf4-111c68b2ffa2 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:18.055803 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd802d-0974-4077-8774-a96b3b2b64c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:18.056748 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd802d-0974-4077-8774-a96b3b2b64c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:18.057038 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd802d-0974-4077-8774-a96b3b2b64c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:18.057320 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd802d-0974-4077-8774-a96b3b2b64c7 admin admin] PATH_INFO: `/v3/projects/c18c6ed90dac458d85c28263f9005144/users/cc9b003158d84e18b03867e61ce36592/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:18.058503 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058308de-5f98-4c8a-8cb8-c82195b4763b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:18.059433 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd802d-0974-4077-8774-a96b3b2b64c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c18c6ed90dac458d85c28263f9005144, user_id=cc9b003158d84e18b03867e61ce36592, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:18.059742 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058308de-5f98-4c8a-8cb8-c82195b4763b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:18.060136 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058308de-5f98-4c8a-8cb8-c82195b4763b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:18.060568 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058308de-5f98-4c8a-8cb8-c82195b4763b admin admin] PATH_INFO: `/v3/projects/1af657c8a5944c209eeacaac4bf9a6ae` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:18.061932 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058308de-5f98-4c8a-8cb8-c82195b4763b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1af657c8a5944c209eeacaac4bf9a6ae)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:18.062373 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd802d-0974-4077-8774-a96b3b2b64c7 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:18.065587 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058308de-5f98-4c8a-8cb8-c82195b4763b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:18.084255 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1081/2142] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:12:18 2022] PUT /identity/v3/projects/c18c6ed90dac458d85c28263f9005144/users/cc9b003158d84e18b03867e61ce36592/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:18.085436 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd802d-0974-4077-8774-a96b3b2b64c7 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:18.188729 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-058308de-5f98-4c8a-8cb8-c82195b4763b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1af657c8a5944c209eeacaac4bf9a6ae', 'request_id': 'req-058308de-5f98-4c8a-8cb8-c82195b4763b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:18.201076 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-058308de-5f98-4c8a-8cb8-c82195b4763b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1af657c8a5944c209eeacaac4bf9a6ae', 'request_id': 'req-058308de-5f98-4c8a-8cb8-c82195b4763b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:18.229019 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-058308de-5f98-4c8a-8cb8-c82195b4763b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1af657c8a5944c209eeacaac4bf9a6ae', 'request_id': 'req-058308de-5f98-4c8a-8cb8-c82195b4763b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:18.235084 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:18.256108 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd802d-0974-4077-8774-a96b3b2b64c7 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:18.258548 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-058308de-5f98-4c8a-8cb8-c82195b4763b admin admin] The token cache is being invalidate because project 1af657c8a5944c209eeacaac4bf9a6ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:12:18.258929 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-058308de-5f98-4c8a-8cb8-c82195b4763b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:18.263086 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-058308de-5f98-4c8a-8cb8-c82195b4763b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:18.265769 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1062/2143] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:12:18 2022] DELETE /identity/v3/projects/1af657c8a5944c209eeacaac4bf9a6ae => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:18.267446 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b87a6-e3e9-4bf6-9bc2-296b1dce9e08 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:18.268057 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b87a6-e3e9-4bf6-9bc2-296b1dce9e08 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:18.268533 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b87a6-e3e9-4bf6-9bc2-296b1dce9e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:18.269423 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:18.308403 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-733b87a6-e3e9-4bf6-9bc2-296b1dce9e08 None None] MFA Rules not processed for user `cc9b003158d84e18b03867e61ce36592`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:18.309839 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-733b87a6-e3e9-4bf6-9bc2-296b1dce9e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:18.336311 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73286b51-3a5c-4753-be8f-5f84b15906c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:18.337119 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73286b51-3a5c-4753-be8f-5f84b15906c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:18.337414 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73286b51-3a5c-4753-be8f-5f84b15906c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:18.338315 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73286b51-3a5c-4753-be8f-5f84b15906c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:18.339086 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73286b51-3a5c-4753-be8f-5f84b15906c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:18.342972 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73286b51-3a5c-4753-be8f-5f84b15906c6 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:18.384063 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1082/2144] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:12:18 2022] POST /identity/v3/projects => generated 369 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:12:18.385344 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73286b51-3a5c-4753-be8f-5f84b15906c6 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:18.389826 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-73286b51-3a5c-4753-be8f-5f84b15906c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:18.405758 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1063/2145] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:18 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:18.410005 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b87a6-e3e9-4bf6-9bc2-296b1dce9e08 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:18.410005 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-733b87a6-e3e9-4bf6-9bc2-296b1dce9e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:18.422798 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b87a6-e3e9-4bf6-9bc2-296b1dce9e08 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:18.500783 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73286b51-3a5c-4753-be8f-5f84b15906c6 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:18.506413 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d82d5-b846-4b5c-81d1-7902e9c1e7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:18.507582 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d82d5-b846-4b5c-81d1-7902e9c1e7c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:18.507870 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d82d5-b846-4b5c-81d1-7902e9c1e7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:18.508154 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d82d5-b846-4b5c-81d1-7902e9c1e7c3 admin admin] PATH_INFO: `/v3/users/304f1c25a7014027919faed5535af15f` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:18.509398 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d82d5-b846-4b5c-81d1-7902e9c1e7c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=304f1c25a7014027919faed5535af15f)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:18.511434 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d82d5-b846-4b5c-81d1-7902e9c1e7c3 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:18.556824 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22db2ea-d49a-4a4f-8921-fa28030d6904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:18.559274 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22db2ea-d49a-4a4f-8921-fa28030d6904 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:18.560347 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22db2ea-d49a-4a4f-8921-fa28030d6904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:18.560643 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22db2ea-d49a-4a4f-8921-fa28030d6904 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:18.562523 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22db2ea-d49a-4a4f-8921-fa28030d6904 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:18.567355 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22db2ea-d49a-4a4f-8921-fa28030d6904 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:18.574590 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c93d82d5-b846-4b5c-81d1-7902e9c1e7c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '304f1c25a7014027919faed5535af15f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:18.588131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c93d82d5-b846-4b5c-81d1-7902e9c1e7c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '304f1c25a7014027919faed5535af15f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:18.588977 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c93d82d5-b846-4b5c-81d1-7902e9c1e7c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '304f1c25a7014027919faed5535af15f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:18.614038 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c93d82d5-b846-4b5c-81d1-7902e9c1e7c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '304f1c25a7014027919faed5535af15f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:18.615369 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c93d82d5-b846-4b5c-81d1-7902e9c1e7c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '304f1c25a7014027919faed5535af15f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:18.619785 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1064/2146] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:12:18 2022] POST /identity/v3/users => generated 285 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:12:18.620792 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22db2ea-d49a-4a4f-8921-fa28030d6904 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:18.622652 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f22db2ea-d49a-4a4f-8921-fa28030d6904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:18.634916 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1083/2147] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:12:18 2022] DELETE /identity/v3/users/304f1c25a7014027919faed5535af15f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:18.637955 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d82d5-b846-4b5c-81d1-7902e9c1e7c3 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:18.652175 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c93d82d5-b846-4b5c-81d1-7902e9c1e7c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:18.694827 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:18.698785 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22db2ea-d49a-4a4f-8921-fa28030d6904 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:18.733383 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:18.802729 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d82d5-b846-4b5c-81d1-7902e9c1e7c3 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:18.805131 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ace27e-6a1e-4f67-9646-486b0e1240e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:18.805989 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ace27e-6a1e-4f67-9646-486b0e1240e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:18.808085 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ace27e-6a1e-4f67-9646-486b0e1240e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:18.809596 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ace27e-6a1e-4f67-9646-486b0e1240e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:18.817877 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e05d7f-05b2-4039-ae7e-8a771223dfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:18.818663 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e05d7f-05b2-4039-ae7e-8a771223dfcc admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:18.821466 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e05d7f-05b2-4039-ae7e-8a771223dfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:18.821794 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e05d7f-05b2-4039-ae7e-8a771223dfcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:18.822634 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e05d7f-05b2-4039-ae7e-8a771223dfcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:18.824535 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e05d7f-05b2-4039-ae7e-8a771223dfcc admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:18.825608 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c1ace27e-6a1e-4f67-9646-486b0e1240e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:18.855302 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1084/2148] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:12:18.861343 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e05d7f-05b2-4039-ae7e-8a771223dfcc admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:18.894001 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e05d7f-05b2-4039-ae7e-8a771223dfcc admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:18.907131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c15868-2bbe-45ec-8e39-6b0bc7f7f737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:18.907851 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c15868-2bbe-45ec-8e39-6b0bc7f7f737 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:18.908143 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c15868-2bbe-45ec-8e39-6b0bc7f7f737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:18.908482 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c15868-2bbe-45ec-8e39-6b0bc7f7f737 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:18.910875 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c15868-2bbe-45ec-8e39-6b0bc7f7f737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:18.912663 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c15868-2bbe-45ec-8e39-6b0bc7f7f737 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:18.942225 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1085/2149] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:12:18.942747 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c15868-2bbe-45ec-8e39-6b0bc7f7f737 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:18.979148 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ace27e-6a1e-4f67-9646-486b0e1240e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:18.980597 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c15868-2bbe-45ec-8e39-6b0bc7f7f737 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:18.980730 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ace27e-6a1e-4f67-9646-486b0e1240e2 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:18.986488 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c253acd4-2e79-4950-91a2-6f1c1588ddcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:18.987936 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253acd4-2e79-4950-91a2-6f1c1588ddcf admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:18.987936 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253acd4-2e79-4950-91a2-6f1c1588ddcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:18.988145 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253acd4-2e79-4950-91a2-6f1c1588ddcf admin admin] PATH_INFO: `/v3/projects/c2a9b4e6a4a547639814a222e43e2bce/users/748e0708acdb41a8ad951334d4275888/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:19.008176 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1065/2150] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:12:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:12:19.010057 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c253acd4-2e79-4950-91a2-6f1c1588ddcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2a9b4e6a4a547639814a222e43e2bce, user_id=748e0708acdb41a8ad951334d4275888, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:19.014024 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c253acd4-2e79-4950-91a2-6f1c1588ddcf admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:19.039138 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1086/2151] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:12:18 2022] PUT /identity/v3/projects/c2a9b4e6a4a547639814a222e43e2bce/users/748e0708acdb41a8ad951334d4275888/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 04:12:19.050013 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912a39a-3e97-4219-b245-3704850e205f None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:19.050362 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912a39a-3e97-4219-b245-3704850e205f None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:19.050656 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912a39a-3e97-4219-b245-3704850e205f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:19.104654 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c253acd4-2e79-4950-91a2-6f1c1588ddcf admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:19.107349 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c253acd4-2e79-4950-91a2-6f1c1588ddcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:19.167729 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-1912a39a-3e97-4219-b245-3704850e205f None None] MFA Rules not processed for user `748e0708acdb41a8ad951334d4275888`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:19.169725 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1912a39a-3e97-4219-b245-3704850e205f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:19.267093 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c253acd4-2e79-4950-91a2-6f1c1588ddcf admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:19.274825 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81959ef6-659b-4c8c-81f8-dab9cb8543c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:19.276860 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81959ef6-659b-4c8c-81f8-dab9cb8543c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:19.277311 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81959ef6-659b-4c8c-81f8-dab9cb8543c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:19.278774 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81959ef6-659b-4c8c-81f8-dab9cb8543c8 admin admin] PATH_INFO: `/v3/projects/3183bba81bbf47688ee570bdf14d5390` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:19.283486 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81959ef6-659b-4c8c-81f8-dab9cb8543c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3183bba81bbf47688ee570bdf14d5390)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:19.290981 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81959ef6-659b-4c8c-81f8-dab9cb8543c8 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:19.356611 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1066/2152] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:19 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:12:19.368647 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912a39a-3e97-4219-b245-3704850e205f None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:19.372233 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1912a39a-3e97-4219-b245-3704850e205f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:19.403171 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-81959ef6-659b-4c8c-81f8-dab9cb8543c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3183bba81bbf47688ee570bdf14d5390', 'request_id': 'req-81959ef6-659b-4c8c-81f8-dab9cb8543c8'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:19.428447 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-81959ef6-659b-4c8c-81f8-dab9cb8543c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3183bba81bbf47688ee570bdf14d5390', 'request_id': 'req-81959ef6-659b-4c8c-81f8-dab9cb8543c8'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:19.440891 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-81959ef6-659b-4c8c-81f8-dab9cb8543c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3183bba81bbf47688ee570bdf14d5390', 'request_id': 'req-81959ef6-659b-4c8c-81f8-dab9cb8543c8'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:19.473427 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-81959ef6-659b-4c8c-81f8-dab9cb8543c8 admin admin] The token cache is being invalidate because project 3183bba81bbf47688ee570bdf14d5390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:12:19.473748 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-81959ef6-659b-4c8c-81f8-dab9cb8543c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:19.474531 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-81959ef6-659b-4c8c-81f8-dab9cb8543c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:19.484084 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1087/2153] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:12:19 2022] DELETE /identity/v3/projects/3183bba81bbf47688ee570bdf14d5390 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 04:12:19.490999 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e3159-a6ce-4af3-8841-8c253668493f None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:19.491097 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e3159-a6ce-4af3-8841-8c253668493f None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:19.492154 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e3159-a6ce-4af3-8841-8c253668493f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:19.516672 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:19.535533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-d75e3159-a6ce-4af3-8841-8c253668493f None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:19.539079 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d75e3159-a6ce-4af3-8841-8c253668493f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:19.581951 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912a39a-3e97-4219-b245-3704850e205f None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:19.609194 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:19.647074 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba361d-4c72-4c80-a5c9-6ce6647d2d01 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e29ce1e3d64431bc7aa80d55787ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:19.647908 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba361d-4c72-4c80-a5c9-6ce6647d2d01 service glance] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:19.648314 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba361d-4c72-4c80-a5c9-6ce6647d2d01 service glance] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:19.649559 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba361d-4c72-4c80-a5c9-6ce6647d2d01 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:19.651713 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d7ba361d-4c72-4c80-a5c9-6ce6647d2d01 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:19.723124 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1088/2154] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:19.731289 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a4e2d-d234-4c91-8222-917a5f6296dd None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:19.731845 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a4e2d-d234-4c91-8222-917a5f6296dd None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:19.732288 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a4e2d-d234-4c91-8222-917a5f6296dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:19.753772 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba361d-4c72-4c80-a5c9-6ce6647d2d01 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:19.755607 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba361d-4c72-4c80-a5c9-6ce6647d2d01 service glance] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:19.767985 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1067/2155] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:12:19 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:12:19.775865 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-8f6a4e2d-d234-4c91-8222-917a5f6296dd None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:19.777244 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-8f6a4e2d-d234-4c91-8222-917a5f6296dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:19.787330 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1089/2156] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:12:19.791872 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba361d-4c72-4c80-a5c9-6ce6647d2d01 service glance] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:19.814443 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba361d-4c72-4c80-a5c9-6ce6647d2d01 service glance] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:19.820476 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7304286-dc62-4c24-bb6d-3c20b19596b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:19.821416 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7304286-dc62-4c24-bb6d-3c20b19596b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:19.821849 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7304286-dc62-4c24-bb6d-3c20b19596b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:19.822321 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7304286-dc62-4c24-bb6d-3c20b19596b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:19.823219 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7304286-dc62-4c24-bb6d-3c20b19596b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:12:19.823638 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7304286-dc62-4c24-bb6d-3c20b19596b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:19.825450 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7304286-dc62-4c24-bb6d-3c20b19596b0 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:19.842526 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1068/2157] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:12:19.846859 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a4e2d-d234-4c91-8222-917a5f6296dd None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:19.877862 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a4e2d-d234-4c91-8222-917a5f6296dd None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:19.890979 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f4374-d858-45ff-95d7-ab38d4a724cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:19.892442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f4374-d858-45ff-95d7-ab38d4a724cd admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:19.893103 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f4374-d858-45ff-95d7-ab38d4a724cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:19.894995 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f4374-d858-45ff-95d7-ab38d4a724cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:19.895849 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f4374-d858-45ff-95d7-ab38d4a724cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:19.898033 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f4374-d858-45ff-95d7-ab38d4a724cd admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:19.981489 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1090/2158] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:12:19 2022] POST /identity/v3/projects => generated 393 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 04:12:19.982622 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7304286-dc62-4c24-bb6d-3c20b19596b0 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:19.999611 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7304286-dc62-4c24-bb6d-3c20b19596b0 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:20.125592 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864ee40-301c-45f1-869d-ffe0f75cdeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:20.126758 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864ee40-301c-45f1-869d-ffe0f75cdeda admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:20.127029 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864ee40-301c-45f1-869d-ffe0f75cdeda admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:20.127400 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864ee40-301c-45f1-869d-ffe0f75cdeda admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:20.128252 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b864ee40-301c-45f1-869d-ffe0f75cdeda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:20.130364 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b864ee40-301c-45f1-869d-ffe0f75cdeda admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:20.167543 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1069/2159] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:12:19 2022] POST /identity/v3/users => generated 297 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:12:20.171119 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f4374-d858-45ff-95d7-ab38d4a724cd admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:20.184226 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f4374-d858-45ff-95d7-ab38d4a724cd admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:20.190611 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2618ba-8364-49f6-b756-44c1ce25f9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:20.191493 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2618ba-8364-49f6-b756-44c1ce25f9b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:20.192006 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2618ba-8364-49f6-b756-44c1ce25f9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:20.192335 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2618ba-8364-49f6-b756-44c1ce25f9b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:20.193698 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2618ba-8364-49f6-b756-44c1ce25f9b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:20.195695 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2618ba-8364-49f6-b756-44c1ce25f9b7 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:20.214031 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1091/2160] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:12:20.217430 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864ee40-301c-45f1-869d-ffe0f75cdeda admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:20.232526 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864ee40-301c-45f1-869d-ffe0f75cdeda admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:20.238429 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea51818-8fca-479b-9516-ca6c03f38597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:20.239499 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea51818-8fca-479b-9516-ca6c03f38597 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:20.240023 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea51818-8fca-479b-9516-ca6c03f38597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:20.240414 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea51818-8fca-479b-9516-ca6c03f38597 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:20.241722 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea51818-8fca-479b-9516-ca6c03f38597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:20.243616 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea51818-8fca-479b-9516-ca6c03f38597 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:20.257969 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1070/2161] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:12:20.261925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2618ba-8364-49f6-b756-44c1ce25f9b7 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:20.274341 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2618ba-8364-49f6-b756-44c1ce25f9b7 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:20.286357 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c5992-9741-4ee6-9cac-93a4791f1b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:20.287792 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c5992-9741-4ee6-9cac-93a4791f1b61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:20.288223 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c5992-9741-4ee6-9cac-93a4791f1b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:20.288695 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c5992-9741-4ee6-9cac-93a4791f1b61 admin admin] PATH_INFO: `/v3/projects/74356b57ab53417aa060585ca9f4823a/users/85e3b9dbc230444c86425cb043d98568/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:20.308478 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c5992-9741-4ee6-9cac-93a4791f1b61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74356b57ab53417aa060585ca9f4823a, user_id=85e3b9dbc230444c86425cb043d98568, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:20.312384 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c5992-9741-4ee6-9cac-93a4791f1b61 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:20.335224 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1092/2162] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:12:20 2022] PUT /identity/v3/projects/74356b57ab53417aa060585ca9f4823a/users/85e3b9dbc230444c86425cb043d98568/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 04:12:20.348100 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be84e0-3ed0-401f-b04b-99888c6677e0 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:20.348574 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be84e0-3ed0-401f-b04b-99888c6677e0 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:20.349390 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be84e0-3ed0-401f-b04b-99888c6677e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:20.394692 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-40be84e0-3ed0-401f-b04b-99888c6677e0 None None] MFA Rules not processed for user `85e3b9dbc230444c86425cb043d98568`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:20.396568 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-40be84e0-3ed0-401f-b04b-99888c6677e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:20.453239 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:20.572083 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1071/2163] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:20.573466 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c5992-9741-4ee6-9cac-93a4791f1b61 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:20.718731 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c5992-9741-4ee6-9cac-93a4791f1b61 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:20.731201 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915e5da-2121-432d-906a-36c32a36ab12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:20.732197 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915e5da-2121-432d-906a-36c32a36ab12 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:20.732390 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915e5da-2121-432d-906a-36c32a36ab12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:20.736522 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915e5da-2121-432d-906a-36c32a36ab12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:20.737726 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915e5da-2121-432d-906a-36c32a36ab12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:20.746470 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915e5da-2121-432d-906a-36c32a36ab12 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:20.792329 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1093/2164] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:12:20 2022] POST /identity/v3/projects => generated 391 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:12:20.796345 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be84e0-3ed0-401f-b04b-99888c6677e0 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:20.821971 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be84e0-3ed0-401f-b04b-99888c6677e0 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:20.972178 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e251a6e-8650-46e3-b6dc-45544583d975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:20.974323 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e251a6e-8650-46e3-b6dc-45544583d975 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:20.974684 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e251a6e-8650-46e3-b6dc-45544583d975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:20.974959 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e251a6e-8650-46e3-b6dc-45544583d975 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:20.975721 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e251a6e-8650-46e3-b6dc-45544583d975 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:20.978652 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e251a6e-8650-46e3-b6dc-45544583d975 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:21.054049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1072/2165] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:12:20 2022] POST /identity/v3/users => generated 302 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:12:21.059134 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915e5da-2121-432d-906a-36c32a36ab12 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:21.075395 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915e5da-2121-432d-906a-36c32a36ab12 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:21.084313 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22120975-06cc-4e45-8c90-e4a53b313775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:21.085545 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22120975-06cc-4e45-8c90-e4a53b313775 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:21.086475 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22120975-06cc-4e45-8c90-e4a53b313775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:21.086756 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22120975-06cc-4e45-8c90-e4a53b313775 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:21.088312 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22120975-06cc-4e45-8c90-e4a53b313775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:21.090037 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22120975-06cc-4e45-8c90-e4a53b313775 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:21.105332 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1094/2166] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 04:12:21.106621 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e251a6e-8650-46e3-b6dc-45544583d975 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:21.120651 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e251a6e-8650-46e3-b6dc-45544583d975 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:21.157715 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f263e3-335a-4bea-a412-d6d5fe960761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:21.158798 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f263e3-335a-4bea-a412-d6d5fe960761 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:21.159103 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f263e3-335a-4bea-a412-d6d5fe960761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:21.159378 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f263e3-335a-4bea-a412-d6d5fe960761 admin admin] PATH_INFO: `/v3/projects/c156633ee1884fa99ab5404be03183ab/users/37bfaa72d4364256bbed114ca35e80b4/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:21.208064 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f263e3-335a-4bea-a412-d6d5fe960761 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c156633ee1884fa99ab5404be03183ab, user_id=37bfaa72d4364256bbed114ca35e80b4, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:21.213346 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f263e3-335a-4bea-a412-d6d5fe960761 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:21.246904 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1073/2167] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:12:21 2022] PUT /identity/v3/projects/c156633ee1884fa99ab5404be03183ab/users/37bfaa72d4364256bbed114ca35e80b4/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:21.251461 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22120975-06cc-4e45-8c90-e4a53b313775 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:21.265028 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22120975-06cc-4e45-8c90-e4a53b313775 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:21.289804 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:21.365169 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fedd26c-4a6c-41df-b411-903b116cb6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:21.367012 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fedd26c-4a6c-41df-b411-903b116cb6b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:21.367685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fedd26c-4a6c-41df-b411-903b116cb6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:21.368111 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fedd26c-4a6c-41df-b411-903b116cb6b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:21.369050 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fedd26c-4a6c-41df-b411-903b116cb6b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:21.371163 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fedd26c-4a6c-41df-b411-903b116cb6b4 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:21.385022 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1095/2168] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:12:21.389621 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f263e3-335a-4bea-a412-d6d5fe960761 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:21.404559 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f263e3-335a-4bea-a412-d6d5fe960761 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:21.412077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6547a3-f82e-49ca-ba05-641002932407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:21.413303 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6547a3-f82e-49ca-ba05-641002932407 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:21.413666 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6547a3-f82e-49ca-ba05-641002932407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:21.413954 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6547a3-f82e-49ca-ba05-641002932407 admin admin] PATH_INFO: `/v3/projects/c156633ee1884fa99ab5404be03183ab/users/37bfaa72d4364256bbed114ca35e80b4/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:21.416509 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6547a3-f82e-49ca-ba05-641002932407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c156633ee1884fa99ab5404be03183ab, user_id=37bfaa72d4364256bbed114ca35e80b4, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:21.419316 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6547a3-f82e-49ca-ba05-641002932407 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:21.432954 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1074/2169] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:12:21 2022] PUT /identity/v3/projects/c156633ee1884fa99ab5404be03183ab/users/37bfaa72d4364256bbed114ca35e80b4/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:21.443652 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce267e-d9bf-4268-9adc-a802f92b972e None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:21.444232 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce267e-d9bf-4268-9adc-a802f92b972e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:21.445232 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce267e-d9bf-4268-9adc-a802f92b972e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:21.489267 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-b4ce267e-d9bf-4268-9adc-a802f92b972e None None] MFA Rules not processed for user `37bfaa72d4364256bbed114ca35e80b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:21.490694 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b4ce267e-d9bf-4268-9adc-a802f92b972e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:21.589468 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1096/2170] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:21 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:21.604155 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6547a3-f82e-49ca-ba05-641002932407 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:21.607733 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6e6547a3-f82e-49ca-ba05-641002932407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:21.673530 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6547a3-f82e-49ca-ba05-641002932407 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:21.677397 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f583caa-f78e-4bc1-86c6-ec5b8fb3ff14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:21.678080 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f583caa-f78e-4bc1-86c6-ec5b8fb3ff14 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:21.678480 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f583caa-f78e-4bc1-86c6-ec5b8fb3ff14 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:21.678864 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f583caa-f78e-4bc1-86c6-ec5b8fb3ff14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:21.691261 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f583caa-f78e-4bc1-86c6-ec5b8fb3ff14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:21.692802 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f583caa-f78e-4bc1-86c6-ec5b8fb3ff14 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:21.707429 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1075/2171] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:12:21 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:12:21.777195 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce267e-d9bf-4268-9adc-a802f92b972e None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:21.778892 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b4ce267e-d9bf-4268-9adc-a802f92b972e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:21.795361 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce267e-d9bf-4268-9adc-a802f92b972e None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:21.799415 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c2c7c-2560-48ae-954b-e9d074c78739 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:21.800219 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c2c7c-2560-48ae-954b-e9d074c78739 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:21.800728 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c2c7c-2560-48ae-954b-e9d074c78739 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:21.801047 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c2c7c-2560-48ae-954b-e9d074c78739 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:21.869689 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c2c7c-2560-48ae-954b-e9d074c78739 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:21.871253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c2c7c-2560-48ae-954b-e9d074c78739 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:21.890808 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1097/2172] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:12:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:12:22.077616 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f583caa-f78e-4bc1-86c6-ec5b8fb3ff14 service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:22.079194 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0f583caa-f78e-4bc1-86c6-ec5b8fb3ff14 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:22.141919 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:22.195197 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f583caa-f78e-4bc1-86c6-ec5b8fb3ff14 service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:22.201541 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ab1d6-7669-4f34-a878-9aff41f7bc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:22.202846 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ab1d6-7669-4f34-a878-9aff41f7bc36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:22.203350 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ab1d6-7669-4f34-a878-9aff41f7bc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:22.203595 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ab1d6-7669-4f34-a878-9aff41f7bc36 admin admin] PATH_INFO: `/v3/users/b146543a9c0e472a9fd5247bd59b1a38` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:22.205583 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67ab1d6-7669-4f34-a878-9aff41f7bc36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b146543a9c0e472a9fd5247bd59b1a38)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:22.208240 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67ab1d6-7669-4f34-a878-9aff41f7bc36 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:22.286140 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c67ab1d6-7669-4f34-a878-9aff41f7bc36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b146543a9c0e472a9fd5247bd59b1a38'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:22.287665 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c67ab1d6-7669-4f34-a878-9aff41f7bc36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b146543a9c0e472a9fd5247bd59b1a38'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:22.299889 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c67ab1d6-7669-4f34-a878-9aff41f7bc36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b146543a9c0e472a9fd5247bd59b1a38'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:22.318308 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c67ab1d6-7669-4f34-a878-9aff41f7bc36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b146543a9c0e472a9fd5247bd59b1a38'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:22.319293 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c67ab1d6-7669-4f34-a878-9aff41f7bc36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b146543a9c0e472a9fd5247bd59b1a38'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:22.339487 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1076/2173] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:12:22 2022] DELETE /identity/v3/users/b146543a9c0e472a9fd5247bd59b1a38 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:22.341887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea423273-d778-46e9-951f-919f2448f29e None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:22.342947 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea423273-d778-46e9-951f-919f2448f29e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:22.343232 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea423273-d778-46e9-951f-919f2448f29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:22.387545 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ea423273-d778-46e9-951f-919f2448f29e None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:22.388925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ea423273-d778-46e9-951f-919f2448f29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:22.460288 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:22.528447 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1098/2174] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:22.540054 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ab1d6-7669-4f34-a878-9aff41f7bc36 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:22.545460 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c67ab1d6-7669-4f34-a878-9aff41f7bc36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:22.648835 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ab1d6-7669-4f34-a878-9aff41f7bc36 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:22.653265 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3d1e6-2ad0-4ebc-948a-6d564ffff7b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:22.654127 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3d1e6-2ad0-4ebc-948a-6d564ffff7b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:22.654544 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3d1e6-2ad0-4ebc-948a-6d564ffff7b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:22.654928 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3d1e6-2ad0-4ebc-948a-6d564ffff7b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:22.667091 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f3d1e6-2ad0-4ebc-948a-6d564ffff7b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:22.668945 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f3d1e6-2ad0-4ebc-948a-6d564ffff7b8 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:22.684006 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1077/2175] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:12:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:12:23.142079 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea423273-d778-46e9-951f-919f2448f29e None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:23.144008 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ea423273-d778-46e9-951f-919f2448f29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:23.172907 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea423273-d778-46e9-951f-919f2448f29e None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:23.194701 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564f9e6-21c7-44ae-b829-02fd0a6f5563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:23.196155 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564f9e6-21c7-44ae-b829-02fd0a6f5563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:23.196613 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564f9e6-21c7-44ae-b829-02fd0a6f5563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:23.197055 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564f9e6-21c7-44ae-b829-02fd0a6f5563 admin admin] PATH_INFO: `/v3/projects/b388cd2d35214808886ea6b8860e4a5c` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:23.198614 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1564f9e6-21c7-44ae-b829-02fd0a6f5563 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b388cd2d35214808886ea6b8860e4a5c)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:23.216954 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1564f9e6-21c7-44ae-b829-02fd0a6f5563 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:23.311345 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1564f9e6-21c7-44ae-b829-02fd0a6f5563 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b388cd2d35214808886ea6b8860e4a5c', 'request_id': 'req-1564f9e6-21c7-44ae-b829-02fd0a6f5563'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:23.319101 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1564f9e6-21c7-44ae-b829-02fd0a6f5563 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b388cd2d35214808886ea6b8860e4a5c', 'request_id': 'req-1564f9e6-21c7-44ae-b829-02fd0a6f5563'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:23.327268 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1564f9e6-21c7-44ae-b829-02fd0a6f5563 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b388cd2d35214808886ea6b8860e4a5c', 'request_id': 'req-1564f9e6-21c7-44ae-b829-02fd0a6f5563'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:23.343721 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1564f9e6-21c7-44ae-b829-02fd0a6f5563 admin admin] The token cache is being invalidate because project b388cd2d35214808886ea6b8860e4a5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:12:23.344193 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1564f9e6-21c7-44ae-b829-02fd0a6f5563 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:23.344839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1564f9e6-21c7-44ae-b829-02fd0a6f5563 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:23.346619 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1099/2176] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:12:23 2022] DELETE /identity/v3/projects/b388cd2d35214808886ea6b8860e4a5c => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:23.350732 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3d1e6-2ad0-4ebc-948a-6d564ffff7b8 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:23.362904 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3d1e6-2ad0-4ebc-948a-6d564ffff7b8 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:23.444419 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:23.469140 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16d396-060b-49dc-9628-4308cec0f2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:23.470435 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16d396-060b-49dc-9628-4308cec0f2a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:23.471174 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16d396-060b-49dc-9628-4308cec0f2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:23.471619 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16d396-060b-49dc-9628-4308cec0f2a7 admin admin] PATH_INFO: `/v3/users/cc9b003158d84e18b03867e61ce36592` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:23.473044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16d396-060b-49dc-9628-4308cec0f2a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc9b003158d84e18b03867e61ce36592)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:23.475903 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16d396-060b-49dc-9628-4308cec0f2a7 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:23.569267 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fc16d396-060b-49dc-9628-4308cec0f2a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc9b003158d84e18b03867e61ce36592'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:23.570180 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fc16d396-060b-49dc-9628-4308cec0f2a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc9b003158d84e18b03867e61ce36592'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:23.585369 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fc16d396-060b-49dc-9628-4308cec0f2a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc9b003158d84e18b03867e61ce36592'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:23.624377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fc16d396-060b-49dc-9628-4308cec0f2a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc9b003158d84e18b03867e61ce36592'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:23.625221 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fc16d396-060b-49dc-9628-4308cec0f2a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc9b003158d84e18b03867e61ce36592'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:23.640773 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1078/2177] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:12:23 2022] DELETE /identity/v3/users/cc9b003158d84e18b03867e61ce36592 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:24.144095 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564f9e6-21c7-44ae-b829-02fd0a6f5563 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:24.146305 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1564f9e6-21c7-44ae-b829-02fd0a6f5563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:24.168950 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564f9e6-21c7-44ae-b829-02fd0a6f5563 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:24.302459 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb80be-80b6-4dbd-96b2-28b686291bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:24.303472 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb80be-80b6-4dbd-96b2-28b686291bdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:24.303767 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb80be-80b6-4dbd-96b2-28b686291bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:24.304054 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb80be-80b6-4dbd-96b2-28b686291bdf admin admin] PATH_INFO: `/v3/projects/c18c6ed90dac458d85c28263f9005144` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:24.305975 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb80be-80b6-4dbd-96b2-28b686291bdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c18c6ed90dac458d85c28263f9005144)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:24.309249 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb80be-80b6-4dbd-96b2-28b686291bdf admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:24.405613 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-2ebb80be-80b6-4dbd-96b2-28b686291bdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c18c6ed90dac458d85c28263f9005144', 'request_id': 'req-2ebb80be-80b6-4dbd-96b2-28b686291bdf'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:24.414147 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-2ebb80be-80b6-4dbd-96b2-28b686291bdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c18c6ed90dac458d85c28263f9005144', 'request_id': 'req-2ebb80be-80b6-4dbd-96b2-28b686291bdf'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:24.421737 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-2ebb80be-80b6-4dbd-96b2-28b686291bdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c18c6ed90dac458d85c28263f9005144', 'request_id': 'req-2ebb80be-80b6-4dbd-96b2-28b686291bdf'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:24.424032 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:24.447761 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-2ebb80be-80b6-4dbd-96b2-28b686291bdf admin admin] The token cache is being invalidate because project c18c6ed90dac458d85c28263f9005144 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:12:24.448552 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-2ebb80be-80b6-4dbd-96b2-28b686291bdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:24.449325 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-2ebb80be-80b6-4dbd-96b2-28b686291bdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:24.451918 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1100/2178] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:12:24 2022] DELETE /identity/v3/projects/c18c6ed90dac458d85c28263f9005144 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:24.456636 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedc90a-220d-4b1f-aa84-e211d0a2a65b None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:24.457487 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedc90a-220d-4b1f-aa84-e211d0a2a65b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:24.457914 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedc90a-220d-4b1f-aa84-e211d0a2a65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:24.503074 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-4cedc90a-220d-4b1f-aa84-e211d0a2a65b None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:24.504613 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4cedc90a-220d-4b1f-aa84-e211d0a2a65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:24.613786 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1079/2179] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:24.617679 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d409b-7556-4e31-88ad-f31097e4b056 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:24.618175 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d409b-7556-4e31-88ad-f31097e4b056 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:24.618598 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d409b-7556-4e31-88ad-f31097e4b056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:24.659135 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-d98d409b-7556-4e31-88ad-f31097e4b056 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:24.661332 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d98d409b-7556-4e31-88ad-f31097e4b056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:24.676736 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1101/2180] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:24.681630 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cedc90a-220d-4b1f-aa84-e211d0a2a65b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:24.699526 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cedc90a-220d-4b1f-aa84-e211d0a2a65b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:24.716106 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198a898-7041-4ef6-8b45-2ea79348c9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:24.717121 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198a898-7041-4ef6-8b45-2ea79348c9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:24.718340 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198a898-7041-4ef6-8b45-2ea79348c9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:24.718881 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198a898-7041-4ef6-8b45-2ea79348c9d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:24.720780 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198a898-7041-4ef6-8b45-2ea79348c9d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:12:24.723011 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198a898-7041-4ef6-8b45-2ea79348c9d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:24.726928 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198a898-7041-4ef6-8b45-2ea79348c9d4 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:24.743296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1080/2181] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:12:24.747939 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d409b-7556-4e31-88ad-f31097e4b056 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:24.771573 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d409b-7556-4e31-88ad-f31097e4b056 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:24.782498 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73124da-3f97-4f5d-8cce-b37f1ebc2f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:24.783680 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73124da-3f97-4f5d-8cce-b37f1ebc2f04 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:24.783981 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73124da-3f97-4f5d-8cce-b37f1ebc2f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:24.784265 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73124da-3f97-4f5d-8cce-b37f1ebc2f04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:24.784996 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73124da-3f97-4f5d-8cce-b37f1ebc2f04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:24.786998 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73124da-3f97-4f5d-8cce-b37f1ebc2f04 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:24.851476 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1102/2182] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:12:24 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:12:24.854067 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198a898-7041-4ef6-8b45-2ea79348c9d4 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:24.870283 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198a898-7041-4ef6-8b45-2ea79348c9d4 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:24.947580 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:24.956217 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4ff7d-fbaa-4ccd-b51e-c1f0c04df618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:24.957187 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4ff7d-fbaa-4ccd-b51e-c1f0c04df618 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:24.957691 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4ff7d-fbaa-4ccd-b51e-c1f0c04df618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:24.958368 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4ff7d-fbaa-4ccd-b51e-c1f0c04df618 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:24.959108 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc4ff7d-fbaa-4ccd-b51e-c1f0c04df618 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:24.961356 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc4ff7d-fbaa-4ccd-b51e-c1f0c04df618 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:24.987812 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1081/2183] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:12:24 2022] POST /identity/v3/users => generated 292 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:12:24.992448 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73124da-3f97-4f5d-8cce-b37f1ebc2f04 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:25.005369 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73124da-3f97-4f5d-8cce-b37f1ebc2f04 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:25.010604 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d216b20-eca6-41d1-a829-e20ec2663f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:25.011310 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d216b20-eca6-41d1-a829-e20ec2663f80 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:25.011609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d216b20-eca6-41d1-a829-e20ec2663f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:25.011895 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d216b20-eca6-41d1-a829-e20ec2663f80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:25.012645 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d216b20-eca6-41d1-a829-e20ec2663f80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:25.014387 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d216b20-eca6-41d1-a829-e20ec2663f80 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:25.030021 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1103/2184] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 04:12:25.034414 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4ff7d-fbaa-4ccd-b51e-c1f0c04df618 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:25.048633 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4ff7d-fbaa-4ccd-b51e-c1f0c04df618 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:25.055124 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a074c4-6dde-4579-9eb7-a35a99ea09f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:25.055890 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a074c4-6dde-4579-9eb7-a35a99ea09f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:25.056180 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a074c4-6dde-4579-9eb7-a35a99ea09f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:25.056461 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a074c4-6dde-4579-9eb7-a35a99ea09f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:25.057265 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a074c4-6dde-4579-9eb7-a35a99ea09f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:25.059130 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a074c4-6dde-4579-9eb7-a35a99ea09f0 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:25.079366 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1082/2185] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:12:25.083622 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d216b20-eca6-41d1-a829-e20ec2663f80 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:25.095020 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d216b20-eca6-41d1-a829-e20ec2663f80 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:25.136955 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2356bf-6ab0-4ecc-9974-036b8ace8fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:25.137954 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2356bf-6ab0-4ecc-9974-036b8ace8fd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:25.138670 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2356bf-6ab0-4ecc-9974-036b8ace8fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:25.139926 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2356bf-6ab0-4ecc-9974-036b8ace8fd2 admin admin] PATH_INFO: `/v3/projects/a9ed2084729d4ea0863298fcbf27155b/users/a0789bda75d4414985767d3f1113adb6/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:25.167537 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2356bf-6ab0-4ecc-9974-036b8ace8fd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9ed2084729d4ea0863298fcbf27155b, user_id=a0789bda75d4414985767d3f1113adb6, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:25.170498 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2356bf-6ab0-4ecc-9974-036b8ace8fd2 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:25.192281 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1104/2186] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:12:25 2022] PUT /identity/v3/projects/a9ed2084729d4ea0863298fcbf27155b/users/a0789bda75d4414985767d3f1113adb6/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:25.200566 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e2e6a-6b2e-40c0-969d-553ae85a0443 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:25.201345 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e2e6a-6b2e-40c0-969d-553ae85a0443 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:25.201838 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e2e6a-6b2e-40c0-969d-553ae85a0443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:25.231393 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-ea9e2e6a-6b2e-40c0-969d-553ae85a0443 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:25.233018 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ea9e2e6a-6b2e-40c0-969d-553ae85a0443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:25.317107 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e59851-371e-4ec8-a9df-48a152c5bd57 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:25.317418 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e59851-371e-4ec8-a9df-48a152c5bd57 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:25.317889 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e59851-371e-4ec8-a9df-48a152c5bd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:25.392042 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1083/2187] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:25.399309 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-27e59851-371e-4ec8-a9df-48a152c5bd57 None None] MFA Rules not processed for user `6cc1f9526a9f4802b121530a82b63a2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:25.402824 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-27e59851-371e-4ec8-a9df-48a152c5bd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:25.422599 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e2e6a-6b2e-40c0-969d-553ae85a0443 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:25.429376 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ea9e2e6a-6b2e-40c0-969d-553ae85a0443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:25.495082 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1105/2188] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:25.499486 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e59851-371e-4ec8-a9df-48a152c5bd57 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:25.501164 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-27e59851-371e-4ec8-a9df-48a152c5bd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:25.518553 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e59851-371e-4ec8-a9df-48a152c5bd57 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:25.536157 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33122f81-0f2b-438f-a2e6-b06b2b19d745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:25.536982 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33122f81-0f2b-438f-a2e6-b06b2b19d745 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:25.537147 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33122f81-0f2b-438f-a2e6-b06b2b19d745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:25.537451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33122f81-0f2b-438f-a2e6-b06b2b19d745 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:25.538513 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33122f81-0f2b-438f-a2e6-b06b2b19d745 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:25.540537 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33122f81-0f2b-438f-a2e6-b06b2b19d745 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:25.557675 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e2e6a-6b2e-40c0-969d-553ae85a0443 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:25.566058 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616db5b-1e43-45f0-93de-be2110c0a988 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:25.567537 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616db5b-1e43-45f0-93de-be2110c0a988 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:25.568091 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616db5b-1e43-45f0-93de-be2110c0a988 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:25.568693 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616db5b-1e43-45f0-93de-be2110c0a988 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:25.590618 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1106/2189] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:12:25 2022] POST /identity/v3/projects => generated 371 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:12:25.590618 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33122f81-0f2b-438f-a2e6-b06b2b19d745 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:25.602877 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5616db5b-1e43-45f0-93de-be2110c0a988 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:25.605005 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5616db5b-1e43-45f0-93de-be2110c0a988 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:25.620073 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1084/2190] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:12:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:12:25.692774 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:25.705853 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33122f81-0f2b-438f-a2e6-b06b2b19d745 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:25.714020 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9732e57-eb12-4efe-8e75-b5fcdac2e592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:25.715049 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9732e57-eb12-4efe-8e75-b5fcdac2e592 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:25.715399 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9732e57-eb12-4efe-8e75-b5fcdac2e592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:25.715753 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9732e57-eb12-4efe-8e75-b5fcdac2e592 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:25.716549 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9732e57-eb12-4efe-8e75-b5fcdac2e592 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:25.719877 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9732e57-eb12-4efe-8e75-b5fcdac2e592 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:25.754259 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1107/2191] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:12:25 2022] POST /identity/v3/users => generated 292 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:12:25.757290 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616db5b-1e43-45f0-93de-be2110c0a988 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:25.768596 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616db5b-1e43-45f0-93de-be2110c0a988 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:25.784444 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067d1c2-73f3-4530-815e-c722d1fa1fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:25.786749 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067d1c2-73f3-4530-815e-c722d1fa1fbb admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:25.794268 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067d1c2-73f3-4530-815e-c722d1fa1fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:25.794562 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067d1c2-73f3-4530-815e-c722d1fa1fbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:25.795513 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3067d1c2-73f3-4530-815e-c722d1fa1fbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:25.797384 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3067d1c2-73f3-4530-815e-c722d1fa1fbb admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:25.822143 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1085/2192] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:12:25.824129 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9732e57-eb12-4efe-8e75-b5fcdac2e592 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:25.841083 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9732e57-eb12-4efe-8e75-b5fcdac2e592 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:25.851054 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4413ca-a04b-4711-a1a3-b3b3d828577d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:25.852238 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4413ca-a04b-4711-a1a3-b3b3d828577d admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:25.852460 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4413ca-a04b-4711-a1a3-b3b3d828577d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:25.857351 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4413ca-a04b-4711-a1a3-b3b3d828577d admin admin] PATH_INFO: `/v3/projects/51276352eb314e54abcb5711e2f1b627/users/75a92d937d044cd0ba94ca4404386d69/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:25.884377 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4413ca-a04b-4711-a1a3-b3b3d828577d admin admin] RBAC: Authorizing `identity:create_grant(project_id=51276352eb314e54abcb5711e2f1b627, user_id=75a92d937d044cd0ba94ca4404386d69, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:25.887377 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4413ca-a04b-4711-a1a3-b3b3d828577d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:25.904646 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1108/2193] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:12:25 2022] PUT /identity/v3/projects/51276352eb314e54abcb5711e2f1b627/users/75a92d937d044cd0ba94ca4404386d69/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 04:12:25.909583 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067d1c2-73f3-4530-815e-c722d1fa1fbb admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:25.922660 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067d1c2-73f3-4530-815e-c722d1fa1fbb admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:26.057495 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0b3c9-42cd-4261-99b9-7b457d85e293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:26.058472 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0b3c9-42cd-4261-99b9-7b457d85e293 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:26.058769 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0b3c9-42cd-4261-99b9-7b457d85e293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:26.059196 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0b3c9-42cd-4261-99b9-7b457d85e293 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:26.061655 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0b3c9-42cd-4261-99b9-7b457d85e293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:26.066414 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0b3c9-42cd-4261-99b9-7b457d85e293 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:26.095882 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1086/2194] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 04:12:26.098431 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4413ca-a04b-4711-a1a3-b3b3d828577d admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:26.114430 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4413ca-a04b-4711-a1a3-b3b3d828577d admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:26.120836 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbabee5-de02-4e0f-9b2e-d44990f89942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:26.122973 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbabee5-de02-4e0f-9b2e-d44990f89942 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:26.123457 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbabee5-de02-4e0f-9b2e-d44990f89942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:26.123928 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbabee5-de02-4e0f-9b2e-d44990f89942 admin admin] PATH_INFO: `/v3/projects/51276352eb314e54abcb5711e2f1b627/users/75a92d937d044cd0ba94ca4404386d69/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:26.127286 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbabee5-de02-4e0f-9b2e-d44990f89942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51276352eb314e54abcb5711e2f1b627, user_id=75a92d937d044cd0ba94ca4404386d69, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:26.131091 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbabee5-de02-4e0f-9b2e-d44990f89942 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:26.157123 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1109/2195] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:12:26 2022] PUT /identity/v3/projects/51276352eb314e54abcb5711e2f1b627/users/75a92d937d044cd0ba94ca4404386d69/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 04:12:26.260082 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0b3c9-42cd-4261-99b9-7b457d85e293 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:26.262211 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-40c0b3c9-42cd-4261-99b9-7b457d85e293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:26.276992 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:26.282183 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0b3c9-42cd-4261-99b9-7b457d85e293 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:26.384742 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3c800-9d28-46f8-a5c8-48de573bd2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:26.386144 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3c800-9d28-46f8-a5c8-48de573bd2a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:26.386529 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3c800-9d28-46f8-a5c8-48de573bd2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:26.386831 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3c800-9d28-46f8-a5c8-48de573bd2a1 admin admin] PATH_INFO: `/v3/users/85e3b9dbc230444c86425cb043d98568` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:26.388116 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3c800-9d28-46f8-a5c8-48de573bd2a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85e3b9dbc230444c86425cb043d98568)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:26.390975 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3c800-9d28-46f8-a5c8-48de573bd2a1 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:26.478374 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-bbb3c800-9d28-46f8-a5c8-48de573bd2a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85e3b9dbc230444c86425cb043d98568'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:26.479403 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-bbb3c800-9d28-46f8-a5c8-48de573bd2a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85e3b9dbc230444c86425cb043d98568'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:26.493247 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-bbb3c800-9d28-46f8-a5c8-48de573bd2a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85e3b9dbc230444c86425cb043d98568'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:26.506244 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a94928-18dd-49b7-adc2-14cf76b51fab None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:26.507193 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a94928-18dd-49b7-adc2-14cf76b51fab None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:26.507652 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a94928-18dd-49b7-adc2-14cf76b51fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:26.532539 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-bbb3c800-9d28-46f8-a5c8-48de573bd2a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85e3b9dbc230444c86425cb043d98568'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:26.533349 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-bbb3c800-9d28-46f8-a5c8-48de573bd2a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85e3b9dbc230444c86425cb043d98568'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:26.543767 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-50a94928-18dd-49b7-adc2-14cf76b51fab None None] MFA Rules not processed for user `a0789bda75d4414985767d3f1113adb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:26.545197 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-50a94928-18dd-49b7-adc2-14cf76b51fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:26.551433 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1087/2196] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:12:26 2022] DELETE /identity/v3/users/85e3b9dbc230444c86425cb043d98568 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:26.552829 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01bce5-c61f-403f-98fe-3372317e8fb3 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:26.553992 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01bce5-c61f-403f-98fe-3372317e8fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:26.555728 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01bce5-c61f-403f-98fe-3372317e8fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:26.604390 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-0c01bce5-c61f-403f-98fe-3372317e8fb3 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:26.606009 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0c01bce5-c61f-403f-98fe-3372317e8fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:26.693064 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1110/2197] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:12:26.710697 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a94928-18dd-49b7-adc2-14cf76b51fab None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:26.712677 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-50a94928-18dd-49b7-adc2-14cf76b51fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:26.725041 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1088/2198] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:26.737764 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01bce5-c61f-403f-98fe-3372317e8fb3 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:26.740585 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0c01bce5-c61f-403f-98fe-3372317e8fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:26.796507 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:26.815458 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a94928-18dd-49b7-adc2-14cf76b51fab None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:26.819640 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8255d-86ca-466c-b60c-4083440db5bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:26.820309 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8255d-86ca-466c-b60c-4083440db5bd service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:26.820692 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8255d-86ca-466c-b60c-4083440db5bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:26.820980 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8255d-86ca-466c-b60c-4083440db5bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:26.834011 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8255d-86ca-466c-b60c-4083440db5bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:26.837131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8255d-86ca-466c-b60c-4083440db5bd service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:26.840823 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01bce5-c61f-403f-98fe-3372317e8fb3 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:26.846381 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95bf143-ad65-4359-bd0e-e8f80bdaa70d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:26.847672 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bf143-ad65-4359-bd0e-e8f80bdaa70d service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:26.848321 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bf143-ad65-4359-bd0e-e8f80bdaa70d service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:26.848702 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bf143-ad65-4359-bd0e-e8f80bdaa70d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:26.861742 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1111/2199] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:12:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 04:12:26.882728 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95bf143-ad65-4359-bd0e-e8f80bdaa70d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:26.884422 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95bf143-ad65-4359-bd0e-e8f80bdaa70d service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:26.899970 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1089/2200] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:12:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:12:27.987246 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8255d-86ca-466c-b60c-4083440db5bd service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:27.990857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-8dc8255d-86ca-466c-b60c-4083440db5bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:28.018918 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8255d-86ca-466c-b60c-4083440db5bd service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:28.024739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b9bc1-a6cf-4b95-b033-5673ae18711d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:28.025201 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b9bc1-a6cf-4b95-b033-5673ae18711d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:28.025486 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b9bc1-a6cf-4b95-b033-5673ae18711d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:28.025773 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b9bc1-a6cf-4b95-b033-5673ae18711d admin admin] PATH_INFO: `/v3/projects/74356b57ab53417aa060585ca9f4823a` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:28.027521 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5b9bc1-a6cf-4b95-b033-5673ae18711d admin admin] RBAC: Authorizing `identity:delete_project(project_id=74356b57ab53417aa060585ca9f4823a)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:28.031021 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5b9bc1-a6cf-4b95-b033-5673ae18711d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:28.075626 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:28.095336 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3d5b9bc1-a6cf-4b95-b033-5673ae18711d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74356b57ab53417aa060585ca9f4823a', 'request_id': 'req-3d5b9bc1-a6cf-4b95-b033-5673ae18711d'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:28.108167 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3d5b9bc1-a6cf-4b95-b033-5673ae18711d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74356b57ab53417aa060585ca9f4823a', 'request_id': 'req-3d5b9bc1-a6cf-4b95-b033-5673ae18711d'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:28.120705 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3d5b9bc1-a6cf-4b95-b033-5673ae18711d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74356b57ab53417aa060585ca9f4823a', 'request_id': 'req-3d5b9bc1-a6cf-4b95-b033-5673ae18711d'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:28.143333 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3d5b9bc1-a6cf-4b95-b033-5673ae18711d admin admin] The token cache is being invalidate because project 74356b57ab53417aa060585ca9f4823a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:12:28.144236 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3d5b9bc1-a6cf-4b95-b033-5673ae18711d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:28.144833 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3d5b9bc1-a6cf-4b95-b033-5673ae18711d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:28.147580 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1112/2201] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:12:27 2022] DELETE /identity/v3/projects/74356b57ab53417aa060585ca9f4823a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:28.152335 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95bf143-ad65-4359-bd0e-e8f80bdaa70d service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:28.171207 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95bf143-ad65-4359-bd0e-e8f80bdaa70d service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:28.286090 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ae967-da81-456f-8eb2-3905534c8b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:28.287232 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ae967-da81-456f-8eb2-3905534c8b41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:28.287615 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ae967-da81-456f-8eb2-3905534c8b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:28.287992 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ae967-da81-456f-8eb2-3905534c8b41 admin admin] PATH_INFO: `/v3/users/37bfaa72d4364256bbed114ca35e80b4` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:28.289493 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ae967-da81-456f-8eb2-3905534c8b41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37bfaa72d4364256bbed114ca35e80b4)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:28.291706 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ae967-da81-456f-8eb2-3905534c8b41 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:28.358069 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-b21ae967-da81-456f-8eb2-3905534c8b41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37bfaa72d4364256bbed114ca35e80b4'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:28.359003 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-b21ae967-da81-456f-8eb2-3905534c8b41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37bfaa72d4364256bbed114ca35e80b4'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:28.372348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-b21ae967-da81-456f-8eb2-3905534c8b41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37bfaa72d4364256bbed114ca35e80b4'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:28.388592 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-b21ae967-da81-456f-8eb2-3905534c8b41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37bfaa72d4364256bbed114ca35e80b4'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:28.389659 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-b21ae967-da81-456f-8eb2-3905534c8b41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37bfaa72d4364256bbed114ca35e80b4'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:28.405380 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1090/2202] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:12:28 2022] DELETE /identity/v3/users/37bfaa72d4364256bbed114ca35e80b4 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:28.495125 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6c85c-7474-4fff-8089-56104f8a5217 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:28.495489 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6c85c-7474-4fff-8089-56104f8a5217 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:28.495614 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6c85c-7474-4fff-8089-56104f8a5217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:28.524914 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ccf6c85c-7474-4fff-8089-56104f8a5217 None None] MFA Rules not processed for user `a0789bda75d4414985767d3f1113adb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:28.526526 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ccf6c85c-7474-4fff-8089-56104f8a5217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:28.647458 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1113/2203] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:29.478848 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ae967-da81-456f-8eb2-3905534c8b41 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:29.482087 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b21ae967-da81-456f-8eb2-3905534c8b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:29.666141 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:29.727298 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ae967-da81-456f-8eb2-3905534c8b41 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:29.737758 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42bdcb6-d7fb-4403-948e-94ed0da38821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:29.738777 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bdcb6-d7fb-4403-948e-94ed0da38821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:29.739159 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bdcb6-d7fb-4403-948e-94ed0da38821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:29.739536 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bdcb6-d7fb-4403-948e-94ed0da38821 admin admin] PATH_INFO: `/v3/projects/c156633ee1884fa99ab5404be03183ab` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:29.746810 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42bdcb6-d7fb-4403-948e-94ed0da38821 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c156633ee1884fa99ab5404be03183ab)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:29.748929 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42bdcb6-d7fb-4403-948e-94ed0da38821 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:29.864588 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c42bdcb6-d7fb-4403-948e-94ed0da38821 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c156633ee1884fa99ab5404be03183ab', 'request_id': 'req-c42bdcb6-d7fb-4403-948e-94ed0da38821'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:29.874854 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c42bdcb6-d7fb-4403-948e-94ed0da38821 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c156633ee1884fa99ab5404be03183ab', 'request_id': 'req-c42bdcb6-d7fb-4403-948e-94ed0da38821'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:29.882644 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c42bdcb6-d7fb-4403-948e-94ed0da38821 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c156633ee1884fa99ab5404be03183ab', 'request_id': 'req-c42bdcb6-d7fb-4403-948e-94ed0da38821'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:29.919016 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c42bdcb6-d7fb-4403-948e-94ed0da38821 admin admin] The token cache is being invalidate because project c156633ee1884fa99ab5404be03183ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:12:29.919537 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c42bdcb6-d7fb-4403-948e-94ed0da38821 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:29.922414 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c42bdcb6-d7fb-4403-948e-94ed0da38821 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:29.930041 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1091/2204] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:12:29 2022] DELETE /identity/v3/projects/c156633ee1884fa99ab5404be03183ab => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:29.931915 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4c06b-ce54-4141-83e9-0b9740602541 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:29.932390 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4c06b-ce54-4141-83e9-0b9740602541 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:29.932484 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4c06b-ce54-4141-83e9-0b9740602541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:29.983752 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-45f4c06b-ce54-4141-83e9-0b9740602541 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:29.989768 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-45f4c06b-ce54-4141-83e9-0b9740602541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:30.101605 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1114/2205] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:30.109853 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e3aab-74e4-4996-82e1-0855595286d9 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:30.110306 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e3aab-74e4-4996-82e1-0855595286d9 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:30.110710 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e3aab-74e4-4996-82e1-0855595286d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:30.145356 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-716e3aab-74e4-4996-82e1-0855595286d9 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:30.146823 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-716e3aab-74e4-4996-82e1-0855595286d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:30.173525 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1092/2206] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:30.178034 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4c06b-ce54-4141-83e9-0b9740602541 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:30.193476 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4c06b-ce54-4141-83e9-0b9740602541 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:30.210876 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bdebd0-b8b7-426e-9484-392e1737e769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:30.211573 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdebd0-b8b7-426e-9484-392e1737e769 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:30.211865 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdebd0-b8b7-426e-9484-392e1737e769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:30.212155 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdebd0-b8b7-426e-9484-392e1737e769 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:30.213169 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bdebd0-b8b7-426e-9484-392e1737e769 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:12:30.216699 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bdebd0-b8b7-426e-9484-392e1737e769 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:30.216699 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bdebd0-b8b7-426e-9484-392e1737e769 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:30.258046 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1115/2207] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:12:30.258954 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e3aab-74e4-4996-82e1-0855595286d9 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:30.286321 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e3aab-74e4-4996-82e1-0855595286d9 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:30.313173 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44c688-cd2a-44e6-975b-64a9fef9b280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:30.314105 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44c688-cd2a-44e6-975b-64a9fef9b280 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:30.314558 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44c688-cd2a-44e6-975b-64a9fef9b280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:30.314897 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44c688-cd2a-44e6-975b-64a9fef9b280 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:30.315707 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44c688-cd2a-44e6-975b-64a9fef9b280 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:30.322131 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44c688-cd2a-44e6-975b-64a9fef9b280 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:30.412267 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1093/2208] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:12:30 2022] POST /identity/v3/projects => generated 377 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 04:12:30.416620 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bdebd0-b8b7-426e-9484-392e1737e769 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:30.432374 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bdebd0-b8b7-426e-9484-392e1737e769 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:30.536616 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:30.550333 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f822af-4a2b-432f-8294-7ddb8c0df042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:30.558308 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f822af-4a2b-432f-8294-7ddb8c0df042 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:30.558308 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f822af-4a2b-432f-8294-7ddb8c0df042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:30.558308 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f822af-4a2b-432f-8294-7ddb8c0df042 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:30.558308 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f822af-4a2b-432f-8294-7ddb8c0df042 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:30.563515 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f822af-4a2b-432f-8294-7ddb8c0df042 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:30.617573 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1116/2209] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:12:30 2022] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:12:30.631268 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44c688-cd2a-44e6-975b-64a9fef9b280 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:30.645642 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44c688-cd2a-44e6-975b-64a9fef9b280 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:30.652555 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927fa735-883f-4578-8460-12ca6854e4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:30.653396 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927fa735-883f-4578-8460-12ca6854e4ce admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:30.653789 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927fa735-883f-4578-8460-12ca6854e4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:30.654199 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927fa735-883f-4578-8460-12ca6854e4ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:30.655094 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927fa735-883f-4578-8460-12ca6854e4ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:30.656989 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927fa735-883f-4578-8460-12ca6854e4ce admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:30.683824 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1094/2210] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:12:30.687774 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f822af-4a2b-432f-8294-7ddb8c0df042 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:30.715301 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f822af-4a2b-432f-8294-7ddb8c0df042 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:30.724356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb2f90-2647-4f5d-9762-d7f9de5a7d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:30.733773 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb2f90-2647-4f5d-9762-d7f9de5a7d7b admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:30.734320 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb2f90-2647-4f5d-9762-d7f9de5a7d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:30.734790 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb2f90-2647-4f5d-9762-d7f9de5a7d7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:30.735985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb2f90-2647-4f5d-9762-d7f9de5a7d7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:30.745764 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb2f90-2647-4f5d-9762-d7f9de5a7d7b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:30.764685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1117/2211] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:12:30.767961 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927fa735-883f-4578-8460-12ca6854e4ce admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:30.787882 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927fa735-883f-4578-8460-12ca6854e4ce admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:30.818717 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482b2bc-69e4-4d11-a3fb-78a50b10fbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:30.820593 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482b2bc-69e4-4d11-a3fb-78a50b10fbba admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:30.821848 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482b2bc-69e4-4d11-a3fb-78a50b10fbba admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:30.822220 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482b2bc-69e4-4d11-a3fb-78a50b10fbba admin admin] PATH_INFO: `/v3/projects/88f18b3ceb1b4f3c8b4e4e2f1629ec48/users/af11369a58ec4cb18b764df886007447/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:30.889579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9482b2bc-69e4-4d11-a3fb-78a50b10fbba admin admin] RBAC: Authorizing `identity:create_grant(project_id=88f18b3ceb1b4f3c8b4e4e2f1629ec48, user_id=af11369a58ec4cb18b764df886007447, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:30.897735 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9482b2bc-69e4-4d11-a3fb-78a50b10fbba admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:30.954036 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1095/2212] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:12:30 2022] PUT /identity/v3/projects/88f18b3ceb1b4f3c8b4e4e2f1629ec48/users/af11369a58ec4cb18b764df886007447/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:30.956033 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe38b74-c830-4d15-a1bb-ce0b387c5ef4 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:30.956550 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe38b74-c830-4d15-a1bb-ce0b387c5ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:30.956723 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe38b74-c830-4d15-a1bb-ce0b387c5ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:31.052518 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-1fe38b74-c830-4d15-a1bb-ce0b387c5ef4 None None] MFA Rules not processed for user `af11369a58ec4cb18b764df886007447`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:31.053808 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1fe38b74-c830-4d15-a1bb-ce0b387c5ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:31.294266 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1118/2213] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:12:31.306621 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482b2bc-69e4-4d11-a3fb-78a50b10fbba admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:31.309050 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9482b2bc-69e4-4d11-a3fb-78a50b10fbba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:31.410347 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482b2bc-69e4-4d11-a3fb-78a50b10fbba admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:31.430295 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879906d-35cd-4d01-b027-ed68bed09cfd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e29ce1e3d64431bc7aa80d55787ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:31.433473 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879906d-35cd-4d01-b027-ed68bed09cfd service glance] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:31.433766 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879906d-35cd-4d01-b027-ed68bed09cfd service glance] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:31.434056 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879906d-35cd-4d01-b027-ed68bed09cfd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:31.486300 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879906d-35cd-4d01-b027-ed68bed09cfd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:31.491930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879906d-35cd-4d01-b027-ed68bed09cfd service glance] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:31.518051 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1096/2214] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:12:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:12:35.583458 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb47ffa-0e82-4cce-8c23-f9535b79187f None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:35.584077 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb47ffa-0e82-4cce-8c23-f9535b79187f None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:35.584077 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb47ffa-0e82-4cce-8c23-f9535b79187f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:35.623500 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-dcb47ffa-0e82-4cce-8c23-f9535b79187f None None] MFA Rules not processed for user `75a92d937d044cd0ba94ca4404386d69`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:35.624798 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-dcb47ffa-0e82-4cce-8c23-f9535b79187f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:35.775003 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879906d-35cd-4d01-b027-ed68bed09cfd service glance] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:35.776449 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0879906d-35cd-4d01-b027-ed68bed09cfd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:35.783875 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1119/2215] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:35 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:35.797003 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:35.903269 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879906d-35cd-4d01-b027-ed68bed09cfd service glance] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:35.927798 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4172370-2ecd-41d9-8430-23565b51b032 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:35.928709 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4172370-2ecd-41d9-8430-23565b51b032 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:35.929180 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4172370-2ecd-41d9-8430-23565b51b032 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:35.930867 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4172370-2ecd-41d9-8430-23565b51b032 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:35.937016 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d4172370-2ecd-41d9-8430-23565b51b032 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:36.080966 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb47ffa-0e82-4cce-8c23-f9535b79187f None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:36.080966 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-dcb47ffa-0e82-4cce-8c23-f9535b79187f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:36.145903 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:36.149925 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4172370-2ecd-41d9-8430-23565b51b032 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:36.155841 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4172370-2ecd-41d9-8430-23565b51b032 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:36.164052 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb47ffa-0e82-4cce-8c23-f9535b79187f None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:36.172361 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac0b4e-33b0-4bd2-a58e-18962bcc92c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:36.173291 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac0b4e-33b0-4bd2-a58e-18962bcc92c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:36.173574 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac0b4e-33b0-4bd2-a58e-18962bcc92c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:36.173857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac0b4e-33b0-4bd2-a58e-18962bcc92c7 admin admin] PATH_INFO: `/v3/users/8c08f725d244480c922fc400d34322ee` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:36.176272 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac0b4e-33b0-4bd2-a58e-18962bcc92c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c08f725d244480c922fc400d34322ee)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:36.180359 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac0b4e-33b0-4bd2-a58e-18962bcc92c7 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:36.186460 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1097/2216] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:12:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:12:36.255246 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-74ac0b4e-33b0-4bd2-a58e-18962bcc92c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c08f725d244480c922fc400d34322ee'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:36.271390 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-74ac0b4e-33b0-4bd2-a58e-18962bcc92c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c08f725d244480c922fc400d34322ee'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:36.273217 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-74ac0b4e-33b0-4bd2-a58e-18962bcc92c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c08f725d244480c922fc400d34322ee'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:36.292086 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-74ac0b4e-33b0-4bd2-a58e-18962bcc92c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c08f725d244480c922fc400d34322ee'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:36.293119 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-74ac0b4e-33b0-4bd2-a58e-18962bcc92c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c08f725d244480c922fc400d34322ee'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:36.308898 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1120/2217] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:12:36 2022] DELETE /identity/v3/users/8c08f725d244480c922fc400d34322ee => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:36.640618 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4172370-2ecd-41d9-8430-23565b51b032 service nova] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:36.661127 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4172370-2ecd-41d9-8430-23565b51b032 service nova] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:36.819804 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c86fe3-7827-4f2a-9d8e-4a6e8171d41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:36.820759 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c86fe3-7827-4f2a-9d8e-4a6e8171d41e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:36.821048 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c86fe3-7827-4f2a-9d8e-4a6e8171d41e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:36.821386 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c86fe3-7827-4f2a-9d8e-4a6e8171d41e admin admin] PATH_INFO: `/v3/projects/c583042f383d44cd8eee480a473fdf5e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:36.823103 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c86fe3-7827-4f2a-9d8e-4a6e8171d41e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c583042f383d44cd8eee480a473fdf5e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:36.835538 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c86fe3-7827-4f2a-9d8e-4a6e8171d41e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:36.972881 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c8c86fe3-7827-4f2a-9d8e-4a6e8171d41e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c583042f383d44cd8eee480a473fdf5e', 'request_id': 'req-c8c86fe3-7827-4f2a-9d8e-4a6e8171d41e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:36.988054 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:36.991013 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c8c86fe3-7827-4f2a-9d8e-4a6e8171d41e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c583042f383d44cd8eee480a473fdf5e', 'request_id': 'req-c8c86fe3-7827-4f2a-9d8e-4a6e8171d41e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:37.007724 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c8c86fe3-7827-4f2a-9d8e-4a6e8171d41e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c583042f383d44cd8eee480a473fdf5e', 'request_id': 'req-c8c86fe3-7827-4f2a-9d8e-4a6e8171d41e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:37.035649 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c8c86fe3-7827-4f2a-9d8e-4a6e8171d41e admin admin] The token cache is being invalidate because project c583042f383d44cd8eee480a473fdf5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:12:37.035947 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c8c86fe3-7827-4f2a-9d8e-4a6e8171d41e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:37.036885 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c8c86fe3-7827-4f2a-9d8e-4a6e8171d41e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:37.042385 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1098/2218] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:12:36 2022] DELETE /identity/v3/projects/c583042f383d44cd8eee480a473fdf5e => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:37.050109 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd622b3-ac5f-4767-852d-8fa960a03fc5 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:37.051048 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd622b3-ac5f-4767-852d-8fa960a03fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:37.053019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd622b3-ac5f-4767-852d-8fa960a03fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:37.098343 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-0bd622b3-ac5f-4767-852d-8fa960a03fc5 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:37.101528 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0bd622b3-ac5f-4767-852d-8fa960a03fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:37.285801 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1121/2219] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:37.294966 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489ef67-1dc0-4d05-8ff2-aef42d7aaccb None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:37.295612 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489ef67-1dc0-4d05-8ff2-aef42d7aaccb None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:37.296231 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489ef67-1dc0-4d05-8ff2-aef42d7aaccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:37.326246 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c489ef67-1dc0-4d05-8ff2-aef42d7aaccb None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:37.327516 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c489ef67-1dc0-4d05-8ff2-aef42d7aaccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:37.340215 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1099/2220] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:37.341615 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd622b3-ac5f-4767-852d-8fa960a03fc5 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:37.355346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd622b3-ac5f-4767-852d-8fa960a03fc5 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:37.366895 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e526ba-e243-45f9-b8ad-7918540f8a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:37.367689 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e526ba-e243-45f9-b8ad-7918540f8a33 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:37.368112 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e526ba-e243-45f9-b8ad-7918540f8a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:37.368460 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e526ba-e243-45f9-b8ad-7918540f8a33 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:37.369756 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e526ba-e243-45f9-b8ad-7918540f8a33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:12:37.372748 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e526ba-e243-45f9-b8ad-7918540f8a33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:37.374695 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e526ba-e243-45f9-b8ad-7918540f8a33 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:37.415754 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1122/2221] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:12:37.417126 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489ef67-1dc0-4d05-8ff2-aef42d7aaccb None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:37.442851 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489ef67-1dc0-4d05-8ff2-aef42d7aaccb None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:37.453922 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d30d39-283c-4698-a412-f3d6cd1f26af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:37.455098 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d30d39-283c-4698-a412-f3d6cd1f26af admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:37.455098 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d30d39-283c-4698-a412-f3d6cd1f26af admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:37.455350 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d30d39-283c-4698-a412-f3d6cd1f26af admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:37.456342 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d30d39-283c-4698-a412-f3d6cd1f26af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:37.458852 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d30d39-283c-4698-a412-f3d6cd1f26af admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:37.513025 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1100/2222] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:12:37 2022] POST /identity/v3/projects => generated 403 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:12:37.517294 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e526ba-e243-45f9-b8ad-7918540f8a33 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:37.532989 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e526ba-e243-45f9-b8ad-7918540f8a33 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:37.612852 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:37.633991 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14868ffb-c56f-4640-b697-79ed33e45401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:37.634883 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14868ffb-c56f-4640-b697-79ed33e45401 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:37.635175 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14868ffb-c56f-4640-b697-79ed33e45401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:37.635471 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14868ffb-c56f-4640-b697-79ed33e45401 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:37.641921 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14868ffb-c56f-4640-b697-79ed33e45401 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:37.641921 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14868ffb-c56f-4640-b697-79ed33e45401 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:37.676098 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1123/2223] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:12:37 2022] POST /identity/v3/users => generated 302 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:12:37.680875 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d30d39-283c-4698-a412-f3d6cd1f26af admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:37.701828 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d30d39-283c-4698-a412-f3d6cd1f26af admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:37.708786 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac979a-78d5-4388-b6f5-6cb301d94fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:37.709485 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac979a-78d5-4388-b6f5-6cb301d94fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:37.714213 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac979a-78d5-4388-b6f5-6cb301d94fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:37.714213 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac979a-78d5-4388-b6f5-6cb301d94fe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:37.716201 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac979a-78d5-4388-b6f5-6cb301d94fe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:37.717917 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac979a-78d5-4388-b6f5-6cb301d94fe0 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:37.742375 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1101/2224] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:12:37.743793 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14868ffb-c56f-4640-b697-79ed33e45401 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:37.761061 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14868ffb-c56f-4640-b697-79ed33e45401 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:37.766803 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5efdee-63e2-459e-81cc-e4a7bf2a4f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:37.767516 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5efdee-63e2-459e-81cc-e4a7bf2a4f78 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:37.767801 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5efdee-63e2-459e-81cc-e4a7bf2a4f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:37.768084 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5efdee-63e2-459e-81cc-e4a7bf2a4f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:37.768836 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5efdee-63e2-459e-81cc-e4a7bf2a4f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:37.775390 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5efdee-63e2-459e-81cc-e4a7bf2a4f78 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:37.862404 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1124/2225] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:12:37.865082 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac979a-78d5-4388-b6f5-6cb301d94fe0 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:37.884722 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac979a-78d5-4388-b6f5-6cb301d94fe0 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:37.891739 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d63563-06f5-4af0-85db-d4df5fc53924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:37.892778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d63563-06f5-4af0-85db-d4df5fc53924 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:37.893195 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d63563-06f5-4af0-85db-d4df5fc53924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:37.893545 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d63563-06f5-4af0-85db-d4df5fc53924 admin admin] PATH_INFO: `/v3/projects/c3c5ae01e5974582a165f7b6151e1489/users/81d0d9b31072413bb85259884df26c83/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:37.914047 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d63563-06f5-4af0-85db-d4df5fc53924 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3c5ae01e5974582a165f7b6151e1489, user_id=81d0d9b31072413bb85259884df26c83, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:37.917156 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d63563-06f5-4af0-85db-d4df5fc53924 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:37.938374 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1102/2226] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:12:37 2022] PUT /identity/v3/projects/c3c5ae01e5974582a165f7b6151e1489/users/81d0d9b31072413bb85259884df26c83/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:37.947959 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2ace8-6d0a-477b-9f55-45b9fe1bdbce None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:37.948584 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2ace8-6d0a-477b-9f55-45b9fe1bdbce None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:37.948822 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2ace8-6d0a-477b-9f55-45b9fe1bdbce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:37.999413 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-6ba2ace8-6d0a-477b-9f55-45b9fe1bdbce None None] MFA Rules not processed for user `81d0d9b31072413bb85259884df26c83`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:38.000690 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6ba2ace8-6d0a-477b-9f55-45b9fe1bdbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:38.129408 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1125/2227] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:38.130362 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d63563-06f5-4af0-85db-d4df5fc53924 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:38.192558 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa521c7-caff-4d63-b779-764caa005d1e None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:38.192908 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa521c7-caff-4d63-b779-764caa005d1e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:38.193200 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa521c7-caff-4d63-b779-764caa005d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:38.215976 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-8fa521c7-caff-4d63-b779-764caa005d1e None None] MFA Rules not processed for user `6cc1f9526a9f4802b121530a82b63a2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:38.217231 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-8fa521c7-caff-4d63-b779-764caa005d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:38.221598 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d63563-06f5-4af0-85db-d4df5fc53924 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:38.228350 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6488a-fb30-4d03-907e-51f06461b84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:38.229156 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6488a-fb30-4d03-907e-51f06461b84e admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:38.229527 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6488a-fb30-4d03-907e-51f06461b84e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:38.230045 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6488a-fb30-4d03-907e-51f06461b84e admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:38.230869 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6488a-fb30-4d03-907e-51f06461b84e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:38.232853 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6488a-fb30-4d03-907e-51f06461b84e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:38.266120 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1103/2228] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:12:38 2022] POST /identity/v3/projects => generated 403 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 04:12:38.270246 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6488a-fb30-4d03-907e-51f06461b84e admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:38.289629 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1126/2229] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:12:38.354050 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6488a-fb30-4d03-907e-51f06461b84e admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:38.362342 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15227834-d5b2-45fd-8347-3bb40672e28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:38.363153 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15227834-d5b2-45fd-8347-3bb40672e28d admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:38.363338 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15227834-d5b2-45fd-8347-3bb40672e28d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:38.363620 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15227834-d5b2-45fd-8347-3bb40672e28d admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:38.364337 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15227834-d5b2-45fd-8347-3bb40672e28d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:38.366995 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15227834-d5b2-45fd-8347-3bb40672e28d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:38.378340 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:DELETE=2,keystone:SELECT=92,keystone:INSERT=6 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:38.397330 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1104/2230] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:12:38 2022] POST /identity/v3/users => generated 308 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 04:12:38.402304 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa521c7-caff-4d63-b779-764caa005d1e None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:38.419170 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa521c7-caff-4d63-b779-764caa005d1e None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:38.425000 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641db687-8ea4-479a-81d2-d8e806d4c241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:38.425776 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641db687-8ea4-479a-81d2-d8e806d4c241 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:38.426017 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641db687-8ea4-479a-81d2-d8e806d4c241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:38.426329 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641db687-8ea4-479a-81d2-d8e806d4c241 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:38.427083 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641db687-8ea4-479a-81d2-d8e806d4c241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:38.428809 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641db687-8ea4-479a-81d2-d8e806d4c241 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:38.440401 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1127/2231] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:12:38.444378 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15227834-d5b2-45fd-8347-3bb40672e28d admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:38.457320 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15227834-d5b2-45fd-8347-3bb40672e28d admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:38.462591 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcdd68d-dbe8-4dfb-8528-64f560c72cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:38.463621 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcdd68d-dbe8-4dfb-8528-64f560c72cfd admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:38.463870 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcdd68d-dbe8-4dfb-8528-64f560c72cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:38.464151 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcdd68d-dbe8-4dfb-8528-64f560c72cfd admin admin] PATH_INFO: `/v3/projects/5b9549600de140a4b26d1acc7d3598b8/users/f0272e83ea3f4be185c88431cd6615f4/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:38.485596 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcdd68d-dbe8-4dfb-8528-64f560c72cfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b9549600de140a4b26d1acc7d3598b8, user_id=f0272e83ea3f4be185c88431cd6615f4, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:38.488676 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcdd68d-dbe8-4dfb-8528-64f560c72cfd admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:38.506635 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1105/2232] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:12:38 2022] PUT /identity/v3/projects/5b9549600de140a4b26d1acc7d3598b8/users/f0272e83ea3f4be185c88431cd6615f4/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:38.512063 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641db687-8ea4-479a-81d2-d8e806d4c241 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:38.529925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641db687-8ea4-479a-81d2-d8e806d4c241 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:38.613894 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:38.628551 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560d6b2-f101-4545-8685-5daff7065451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:38.629238 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560d6b2-f101-4545-8685-5daff7065451 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:38.629525 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560d6b2-f101-4545-8685-5daff7065451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:38.629805 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560d6b2-f101-4545-8685-5daff7065451 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:38.630879 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e560d6b2-f101-4545-8685-5daff7065451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:38.632709 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e560d6b2-f101-4545-8685-5daff7065451 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:38.647792 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1128/2233] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:12:38.649752 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcdd68d-dbe8-4dfb-8528-64f560c72cfd admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:38.662182 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcdd68d-dbe8-4dfb-8528-64f560c72cfd admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:38.668924 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303443e-5aa3-41a9-b6dc-e10134a99288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:38.670011 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303443e-5aa3-41a9-b6dc-e10134a99288 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:38.670372 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303443e-5aa3-41a9-b6dc-e10134a99288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:38.670709 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303443e-5aa3-41a9-b6dc-e10134a99288 admin admin] PATH_INFO: `/v3/projects/5b9549600de140a4b26d1acc7d3598b8/users/f0272e83ea3f4be185c88431cd6615f4/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:38.673430 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303443e-5aa3-41a9-b6dc-e10134a99288 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b9549600de140a4b26d1acc7d3598b8, user_id=f0272e83ea3f4be185c88431cd6615f4, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:38.676438 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303443e-5aa3-41a9-b6dc-e10134a99288 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:38.690187 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1106/2234] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:12:38 2022] PUT /identity/v3/projects/5b9549600de140a4b26d1acc7d3598b8/users/f0272e83ea3f4be185c88431cd6615f4/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:38.701463 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b740e1-ed2b-4d83-85b7-c24ab503ea08 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:38.701751 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b740e1-ed2b-4d83-85b7-c24ab503ea08 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:38.702189 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b740e1-ed2b-4d83-85b7-c24ab503ea08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:38.734926 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-e2b740e1-ed2b-4d83-85b7-c24ab503ea08 None None] MFA Rules not processed for user `f0272e83ea3f4be185c88431cd6615f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:38.736143 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e2b740e1-ed2b-4d83-85b7-c24ab503ea08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:38.824632 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1129/2235] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:38 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:38.844336 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303443e-5aa3-41a9-b6dc-e10134a99288 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:38.846906 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6303443e-5aa3-41a9-b6dc-e10134a99288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:38.912323 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303443e-5aa3-41a9-b6dc-e10134a99288 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:38.916612 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ab011-87f7-4d53-9031-1a07eec5c7af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:38.917455 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ab011-87f7-4d53-9031-1a07eec5c7af service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:38.917818 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ab011-87f7-4d53-9031-1a07eec5c7af service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:38.918178 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ab011-87f7-4d53-9031-1a07eec5c7af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:38.928602 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1ab011-87f7-4d53-9031-1a07eec5c7af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:38.930258 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1ab011-87f7-4d53-9031-1a07eec5c7af service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:38.941334 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1107/2236] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:12:38 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:12:39.172490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b740e1-ed2b-4d83-85b7-c24ab503ea08 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:39.253416 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b740e1-ed2b-4d83-85b7-c24ab503ea08 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:39.259078 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be8713-1aa9-4f35-83ee-eb5d876502b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:39.259982 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be8713-1aa9-4f35-83ee-eb5d876502b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:39.260269 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be8713-1aa9-4f35-83ee-eb5d876502b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:39.260684 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be8713-1aa9-4f35-83ee-eb5d876502b2 admin admin] PATH_INFO: `/v3/users/81d0d9b31072413bb85259884df26c83` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:39.261911 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be8713-1aa9-4f35-83ee-eb5d876502b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81d0d9b31072413bb85259884df26c83)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:39.264121 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be8713-1aa9-4f35-83ee-eb5d876502b2 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:39.328713 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-38be8713-1aa9-4f35-83ee-eb5d876502b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81d0d9b31072413bb85259884df26c83'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:39.338447 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-38be8713-1aa9-4f35-83ee-eb5d876502b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81d0d9b31072413bb85259884df26c83'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:39.339124 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-38be8713-1aa9-4f35-83ee-eb5d876502b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81d0d9b31072413bb85259884df26c83'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:39.352480 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-38be8713-1aa9-4f35-83ee-eb5d876502b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81d0d9b31072413bb85259884df26c83'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:39.353150 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-38be8713-1aa9-4f35-83ee-eb5d876502b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81d0d9b31072413bb85259884df26c83'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:39.361218 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:39.367440 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1130/2237] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:12:39 2022] DELETE /identity/v3/users/81d0d9b31072413bb85259884df26c83 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:39.372459 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf48bfa-365b-4ccf-a7f8-e9f76d23512d None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:39.372826 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf48bfa-365b-4ccf-a7f8-e9f76d23512d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:39.373126 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf48bfa-365b-4ccf-a7f8-e9f76d23512d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:39.392128 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-dcf48bfa-365b-4ccf-a7f8-e9f76d23512d None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:39.393351 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-dcf48bfa-365b-4ccf-a7f8-e9f76d23512d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:39.455667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1108/2238] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:39.465406 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be8713-1aa9-4f35-83ee-eb5d876502b2 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:39.466880 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-38be8713-1aa9-4f35-83ee-eb5d876502b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:39.533623 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be8713-1aa9-4f35-83ee-eb5d876502b2 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:39.538199 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294462a6-4d21-4a1d-9098-783992f68a7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:39.538859 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294462a6-4d21-4a1d-9098-783992f68a7d service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:39.539146 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294462a6-4d21-4a1d-9098-783992f68a7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:39.539425 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294462a6-4d21-4a1d-9098-783992f68a7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:39.550069 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294462a6-4d21-4a1d-9098-783992f68a7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:39.551556 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294462a6-4d21-4a1d-9098-783992f68a7d service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:39.562001 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1131/2239] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:12:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:12:39.869710 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf48bfa-365b-4ccf-a7f8-e9f76d23512d None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:39.871243 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-dcf48bfa-365b-4ccf-a7f8-e9f76d23512d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:39.889117 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf48bfa-365b-4ccf-a7f8-e9f76d23512d None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:39.893925 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11276c-a5eb-4566-8fb7-b182a6016ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:39.895098 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11276c-a5eb-4566-8fb7-b182a6016ea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:39.895183 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11276c-a5eb-4566-8fb7-b182a6016ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:39.895423 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11276c-a5eb-4566-8fb7-b182a6016ea6 admin admin] PATH_INFO: `/v3/projects/c3c5ae01e5974582a165f7b6151e1489` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:39.897644 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac11276c-a5eb-4566-8fb7-b182a6016ea6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3c5ae01e5974582a165f7b6151e1489)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:39.900162 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac11276c-a5eb-4566-8fb7-b182a6016ea6 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:39.957106 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ac11276c-a5eb-4566-8fb7-b182a6016ea6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3c5ae01e5974582a165f7b6151e1489', 'request_id': 'req-ac11276c-a5eb-4566-8fb7-b182a6016ea6'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:39.961306 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:INSERT=3,keystone:SELECT=92,keystone:DELETE=5 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:39.963504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ac11276c-a5eb-4566-8fb7-b182a6016ea6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3c5ae01e5974582a165f7b6151e1489', 'request_id': 'req-ac11276c-a5eb-4566-8fb7-b182a6016ea6'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:39.975145 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ac11276c-a5eb-4566-8fb7-b182a6016ea6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3c5ae01e5974582a165f7b6151e1489', 'request_id': 'req-ac11276c-a5eb-4566-8fb7-b182a6016ea6'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:39.989285 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ac11276c-a5eb-4566-8fb7-b182a6016ea6 admin admin] The token cache is being invalidate because project c3c5ae01e5974582a165f7b6151e1489 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:12:39.989580 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ac11276c-a5eb-4566-8fb7-b182a6016ea6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:39.990305 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ac11276c-a5eb-4566-8fb7-b182a6016ea6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:39.992302 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1109/2240] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:12:39 2022] DELETE /identity/v3/projects/c3c5ae01e5974582a165f7b6151e1489 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:39.996460 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294462a6-4d21-4a1d-9098-783992f68a7d service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:40.006728 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294462a6-4d21-4a1d-9098-783992f68a7d service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:40.074453 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb869da-994d-42e7-b4ca-00f08a199d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:40.075353 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb869da-994d-42e7-b4ca-00f08a199d9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:40.075636 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb869da-994d-42e7-b4ca-00f08a199d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:40.075936 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb869da-994d-42e7-b4ca-00f08a199d9d admin admin] PATH_INFO: `/v3/users/f0272e83ea3f4be185c88431cd6615f4` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:40.077139 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb869da-994d-42e7-b4ca-00f08a199d9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0272e83ea3f4be185c88431cd6615f4)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:40.079146 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb869da-994d-42e7-b4ca-00f08a199d9d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:40.136576 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5fb869da-994d-42e7-b4ca-00f08a199d9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0272e83ea3f4be185c88431cd6615f4'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:40.145265 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5fb869da-994d-42e7-b4ca-00f08a199d9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0272e83ea3f4be185c88431cd6615f4'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:40.146026 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5fb869da-994d-42e7-b4ca-00f08a199d9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0272e83ea3f4be185c88431cd6615f4'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:40.158715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5fb869da-994d-42e7-b4ca-00f08a199d9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0272e83ea3f4be185c88431cd6615f4'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:40.159559 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5fb869da-994d-42e7-b4ca-00f08a199d9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0272e83ea3f4be185c88431cd6615f4'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:40.173638 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1132/2241] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:12:39 2022] DELETE /identity/v3/users/f0272e83ea3f4be185c88431cd6615f4 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:40.561608 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11276c-a5eb-4566-8fb7-b182a6016ea6 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:40.563495 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ac11276c-a5eb-4566-8fb7-b182a6016ea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:40.577211 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11276c-a5eb-4566-8fb7-b182a6016ea6 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:40.642858 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37a0ae-99de-4aaf-890c-b165d391c14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:40.643644 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37a0ae-99de-4aaf-890c-b165d391c14d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:40.643930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37a0ae-99de-4aaf-890c-b165d391c14d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:40.644213 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37a0ae-99de-4aaf-890c-b165d391c14d admin admin] PATH_INFO: `/v3/projects/5b9549600de140a4b26d1acc7d3598b8` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:40.645460 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf37a0ae-99de-4aaf-890c-b165d391c14d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b9549600de140a4b26d1acc7d3598b8)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:40.647497 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf37a0ae-99de-4aaf-890c-b165d391c14d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:40.698415 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-bf37a0ae-99de-4aaf-890c-b165d391c14d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b9549600de140a4b26d1acc7d3598b8', 'request_id': 'req-bf37a0ae-99de-4aaf-890c-b165d391c14d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:40.704383 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-bf37a0ae-99de-4aaf-890c-b165d391c14d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b9549600de140a4b26d1acc7d3598b8', 'request_id': 'req-bf37a0ae-99de-4aaf-890c-b165d391c14d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:40.710782 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-bf37a0ae-99de-4aaf-890c-b165d391c14d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b9549600de140a4b26d1acc7d3598b8', 'request_id': 'req-bf37a0ae-99de-4aaf-890c-b165d391c14d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:40.725748 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-bf37a0ae-99de-4aaf-890c-b165d391c14d admin admin] The token cache is being invalidate because project 5b9549600de140a4b26d1acc7d3598b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:12:40.726044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-bf37a0ae-99de-4aaf-890c-b165d391c14d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:40.726708 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-bf37a0ae-99de-4aaf-890c-b165d391c14d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:40.728303 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1110/2242] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:12:40 2022] DELETE /identity/v3/projects/5b9549600de140a4b26d1acc7d3598b8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:40.733887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b11bb-df82-43fe-9e13-5695ffa18abc None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:40.734222 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b11bb-df82-43fe-9e13-5695ffa18abc None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:40.734510 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b11bb-df82-43fe-9e13-5695ffa18abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:40.754971 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ac9b11bb-df82-43fe-9e13-5695ffa18abc None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:40.756319 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ac9b11bb-df82-43fe-9e13-5695ffa18abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:40.772941 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:40.824543 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1133/2243] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:40.836271 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d954c69-3c2c-4d0a-a34a-7b32cc642e0f None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:40.836573 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d954c69-3c2c-4d0a-a34a-7b32cc642e0f None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:40.836860 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d954c69-3c2c-4d0a-a34a-7b32cc642e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:40.857049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-6d954c69-3c2c-4d0a-a34a-7b32cc642e0f None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:40.858472 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6d954c69-3c2c-4d0a-a34a-7b32cc642e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:40.867551 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1111/2244] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:40.871965 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b11bb-df82-43fe-9e13-5695ffa18abc None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:40.881758 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b11bb-df82-43fe-9e13-5695ffa18abc None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:40.886486 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8d990-b3ac-4a23-8bfc-b657b8c7d25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:40.887147 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8d990-b3ac-4a23-8bfc-b657b8c7d25a admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:40.887427 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8d990-b3ac-4a23-8bfc-b657b8c7d25a admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:40.887706 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8d990-b3ac-4a23-8bfc-b657b8c7d25a admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:40.888496 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8d990-b3ac-4a23-8bfc-b657b8c7d25a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:12:40.888807 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8d990-b3ac-4a23-8bfc-b657b8c7d25a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:40.890466 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8d990-b3ac-4a23-8bfc-b657b8c7d25a admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:40.904761 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1134/2245] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:12:40.909827 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d954c69-3c2c-4d0a-a34a-7b32cc642e0f None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:40.920230 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d954c69-3c2c-4d0a-a34a-7b32cc642e0f None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:40.926122 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd920b-8455-4eb2-8497-018202169139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:40.926800 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd920b-8455-4eb2-8497-018202169139 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:40.927104 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd920b-8455-4eb2-8497-018202169139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:40.934186 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd920b-8455-4eb2-8497-018202169139 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:40.934186 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd920b-8455-4eb2-8497-018202169139 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:40.934186 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd920b-8455-4eb2-8497-018202169139 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:40.964657 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1112/2246] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:12:40 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:12:40.968843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8d990-b3ac-4a23-8bfc-b657b8c7d25a admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:40.980943 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8d990-b3ac-4a23-8bfc-b657b8c7d25a admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:41.068645 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13558d1e-99c4-4be2-836a-74aadc7b10ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:41.070752 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13558d1e-99c4-4be2-836a-74aadc7b10ad admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:41.071066 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13558d1e-99c4-4be2-836a-74aadc7b10ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:41.071379 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13558d1e-99c4-4be2-836a-74aadc7b10ad admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:41.072087 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13558d1e-99c4-4be2-836a-74aadc7b10ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:41.081509 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13558d1e-99c4-4be2-836a-74aadc7b10ad admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:41.124998 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1135/2247] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:12:40 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:12:41.126980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd920b-8455-4eb2-8497-018202169139 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:41.141258 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd920b-8455-4eb2-8497-018202169139 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:41.146987 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687f2f92-37c5-4787-9415-8e7cffbc5069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:41.147770 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f2f92-37c5-4787-9415-8e7cffbc5069 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:41.148128 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f2f92-37c5-4787-9415-8e7cffbc5069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:41.148483 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f2f92-37c5-4787-9415-8e7cffbc5069 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:41.149305 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687f2f92-37c5-4787-9415-8e7cffbc5069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:41.151215 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687f2f92-37c5-4787-9415-8e7cffbc5069 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:41.166196 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1113/2248] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:12:41.168500 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13558d1e-99c4-4be2-836a-74aadc7b10ad admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:41.182569 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13558d1e-99c4-4be2-836a-74aadc7b10ad admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:41.192169 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5cdacb-f236-421b-8b3b-a3eb07f016c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:41.193295 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5cdacb-f236-421b-8b3b-a3eb07f016c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:41.194481 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5cdacb-f236-421b-8b3b-a3eb07f016c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:41.194959 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5cdacb-f236-421b-8b3b-a3eb07f016c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:41.197316 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5cdacb-f236-421b-8b3b-a3eb07f016c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:41.200055 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5cdacb-f236-421b-8b3b-a3eb07f016c0 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:41.216634 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1136/2249] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:12:41.221272 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687f2f92-37c5-4787-9415-8e7cffbc5069 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:41.234476 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687f2f92-37c5-4787-9415-8e7cffbc5069 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:41.241488 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce4b3b-7ea4-4757-bb58-db3e4af4f212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:41.242591 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce4b3b-7ea4-4757-bb58-db3e4af4f212 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:41.242983 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce4b3b-7ea4-4757-bb58-db3e4af4f212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:41.243367 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce4b3b-7ea4-4757-bb58-db3e4af4f212 admin admin] PATH_INFO: `/v3/projects/ee4d3d0504604dc2bf4243337514abf3/users/79636a7fdfca4f769e5dce42918ca78f/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:41.266187 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce4b3b-7ea4-4757-bb58-db3e4af4f212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee4d3d0504604dc2bf4243337514abf3, user_id=79636a7fdfca4f769e5dce42918ca78f, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:41.266924 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce4b3b-7ea4-4757-bb58-db3e4af4f212 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:41.288031 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1114/2250] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:12:41 2022] PUT /identity/v3/projects/ee4d3d0504604dc2bf4243337514abf3/users/79636a7fdfca4f769e5dce42918ca78f/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:41.298377 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a60819-4442-4b4b-aca6-08f24ff1a205 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:41.298677 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a60819-4442-4b4b-aca6-08f24ff1a205 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:41.298960 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a60819-4442-4b4b-aca6-08f24ff1a205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:41.327187 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-32a60819-4442-4b4b-aca6-08f24ff1a205 None None] MFA Rules not processed for user `79636a7fdfca4f769e5dce42918ca78f`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:41.328516 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-32a60819-4442-4b4b-aca6-08f24ff1a205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:41.400545 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1137/2251] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:41.407680 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce4b3b-7ea4-4757-bb58-db3e4af4f212 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:41.417782 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:41.476953 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce4b3b-7ea4-4757-bb58-db3e4af4f212 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:41.482870 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9768be5-282f-4c89-825c-b878cc2fbd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:41.483792 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9768be5-282f-4c89-825c-b878cc2fbd0e admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:41.484096 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9768be5-282f-4c89-825c-b878cc2fbd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:41.484355 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9768be5-282f-4c89-825c-b878cc2fbd0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:41.485237 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9768be5-282f-4c89-825c-b878cc2fbd0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:41.487980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9768be5-282f-4c89-825c-b878cc2fbd0e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:41.519863 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1115/2252] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:12:41 2022] POST /identity/v3/projects => generated 369 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:12:41.524056 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a60819-4442-4b4b-aca6-08f24ff1a205 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:41.535436 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a60819-4442-4b4b-aca6-08f24ff1a205 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:41.547891 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:41.623438 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ecffe-f18c-4a14-ab41-62381f1ac0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:41.624242 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ecffe-f18c-4a14-ab41-62381f1ac0f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:41.624596 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ecffe-f18c-4a14-ab41-62381f1ac0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:41.624941 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ecffe-f18c-4a14-ab41-62381f1ac0f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:41.625723 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ecffe-f18c-4a14-ab41-62381f1ac0f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:41.627792 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ecffe-f18c-4a14-ab41-62381f1ac0f2 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:41.655171 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1138/2253] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:12:41 2022] POST /identity/v3/users => generated 291 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:12:41.658771 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9768be5-282f-4c89-825c-b878cc2fbd0e admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:41.670542 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9768be5-282f-4c89-825c-b878cc2fbd0e admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:41.675653 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb53c10-5027-4e29-9b48-0fd883c72a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:41.676482 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb53c10-5027-4e29-9b48-0fd883c72a26 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:41.676892 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb53c10-5027-4e29-9b48-0fd883c72a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:41.677269 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb53c10-5027-4e29-9b48-0fd883c72a26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:41.678101 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb53c10-5027-4e29-9b48-0fd883c72a26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:41.679847 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb53c10-5027-4e29-9b48-0fd883c72a26 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:41.707964 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1116/2254] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:12:41.712293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ecffe-f18c-4a14-ab41-62381f1ac0f2 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:41.724528 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ecffe-f18c-4a14-ab41-62381f1ac0f2 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:41.729718 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e18c9-26ae-408b-966a-515890c9c2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:41.730664 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e18c9-26ae-408b-966a-515890c9c2bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:41.730945 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e18c9-26ae-408b-966a-515890c9c2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:41.731240 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e18c9-26ae-408b-966a-515890c9c2bf admin admin] PATH_INFO: `/v3/projects/99d47ae453dc4c848713a98f59f7c33d/users/c15ae4fb97e7407f9212e319e0435ec2/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:41.747214 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e18c9-26ae-408b-966a-515890c9c2bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=99d47ae453dc4c848713a98f59f7c33d, user_id=c15ae4fb97e7407f9212e319e0435ec2, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:41.749903 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e18c9-26ae-408b-966a-515890c9c2bf admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:41.763627 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1139/2255] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:12:41 2022] PUT /identity/v3/projects/99d47ae453dc4c848713a98f59f7c33d/users/c15ae4fb97e7407f9212e319e0435ec2/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 04:12:41.767685 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb53c10-5027-4e29-9b48-0fd883c72a26 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:41.778812 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb53c10-5027-4e29-9b48-0fd883c72a26 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:41.842728 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842d441-8bf9-4c21-8fdd-1b71d3a9cf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:41.843462 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842d441-8bf9-4c21-8fdd-1b71d3a9cf86 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:41.843757 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842d441-8bf9-4c21-8fdd-1b71d3a9cf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:41.844038 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842d441-8bf9-4c21-8fdd-1b71d3a9cf86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:41.844789 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d842d441-8bf9-4c21-8fdd-1b71d3a9cf86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:41.846490 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d842d441-8bf9-4c21-8fdd-1b71d3a9cf86 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:41.856762 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1117/2256] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:12:41.861859 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e18c9-26ae-408b-966a-515890c9c2bf admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:41.874276 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e18c9-26ae-408b-966a-515890c9c2bf admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:41.880194 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bafd6e-2ce2-4819-9e01-08f55e3be09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:41.881123 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bafd6e-2ce2-4819-9e01-08f55e3be09c admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:41.881414 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bafd6e-2ce2-4819-9e01-08f55e3be09c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:41.881690 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bafd6e-2ce2-4819-9e01-08f55e3be09c admin admin] PATH_INFO: `/v3/projects/99d47ae453dc4c848713a98f59f7c33d/users/c15ae4fb97e7407f9212e319e0435ec2/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:41.883944 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bafd6e-2ce2-4819-9e01-08f55e3be09c admin admin] RBAC: Authorizing `identity:create_grant(project_id=99d47ae453dc4c848713a98f59f7c33d, user_id=c15ae4fb97e7407f9212e319e0435ec2, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:41.886711 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bafd6e-2ce2-4819-9e01-08f55e3be09c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:41.898709 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1140/2257] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:12:41 2022] PUT /identity/v3/projects/99d47ae453dc4c848713a98f59f7c33d/users/c15ae4fb97e7407f9212e319e0435ec2/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:41.910183 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be5c99-cbe7-4090-bedb-68112aafb560 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:41.910359 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be5c99-cbe7-4090-bedb-68112aafb560 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:41.910672 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be5c99-cbe7-4090-bedb-68112aafb560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:41.939239 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-39be5c99-cbe7-4090-bedb-68112aafb560 None None] MFA Rules not processed for user `c15ae4fb97e7407f9212e319e0435ec2`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:41.940485 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-39be5c99-cbe7-4090-bedb-68112aafb560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:42.015828 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1118/2258] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:41 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:12:42.029414 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bafd6e-2ce2-4819-9e01-08f55e3be09c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:42.031466 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-17bafd6e-2ce2-4819-9e01-08f55e3be09c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:42.128899 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bafd6e-2ce2-4819-9e01-08f55e3be09c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:42.135451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8dba4-ffa2-41f7-a2dc-0e79254d0ec3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:42.136284 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8dba4-ffa2-41f7-a2dc-0e79254d0ec3 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:42.136577 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8dba4-ffa2-41f7-a2dc-0e79254d0ec3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:42.136860 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8dba4-ffa2-41f7-a2dc-0e79254d0ec3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:42.148263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e8dba4-ffa2-41f7-a2dc-0e79254d0ec3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:42.149667 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e8dba4-ffa2-41f7-a2dc-0e79254d0ec3 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:42.161455 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1141/2259] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:12:42 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:12:42.244439 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be5c99-cbe7-4090-bedb-68112aafb560 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:42.256203 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be5c99-cbe7-4090-bedb-68112aafb560 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:42.257198 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:42.261515 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f49e1-9ac2-49b9-813e-c25ac12b2c9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:42.262731 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f49e1-9ac2-49b9-813e-c25ac12b2c9a service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:42.263158 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f49e1-9ac2-49b9-813e-c25ac12b2c9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:42.263449 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f49e1-9ac2-49b9-813e-c25ac12b2c9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:42.326077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f49e1-9ac2-49b9-813e-c25ac12b2c9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:42.327792 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f49e1-9ac2-49b9-813e-c25ac12b2c9a service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:42.337606 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1119/2260] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:12:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:12:52.156012 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=63,keystone:INSERT=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:52.333455 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=26 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:12:59.286843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8dba4-ffa2-41f7-a2dc-0e79254d0ec3 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:59.288449 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f6e8dba4-ffa2-41f7-a2dc-0e79254d0ec3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:59.354349 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8dba4-ffa2-41f7-a2dc-0e79254d0ec3 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:59.359249 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d832a63-1ca5-4b93-920b-c6ed9e562706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:59.360131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d832a63-1ca5-4b93-920b-c6ed9e562706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:59.360454 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d832a63-1ca5-4b93-920b-c6ed9e562706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:59.360738 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d832a63-1ca5-4b93-920b-c6ed9e562706 admin admin] PATH_INFO: `/v3/users/748e0708acdb41a8ad951334d4275888` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:59.361962 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d832a63-1ca5-4b93-920b-c6ed9e562706 admin admin] RBAC: Authorizing `identity:delete_user(user_id=748e0708acdb41a8ad951334d4275888)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:59.364044 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d832a63-1ca5-4b93-920b-c6ed9e562706 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:59.420020 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4d832a63-1ca5-4b93-920b-c6ed9e562706 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '748e0708acdb41a8ad951334d4275888'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:59.428232 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4d832a63-1ca5-4b93-920b-c6ed9e562706 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '748e0708acdb41a8ad951334d4275888'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:59.428883 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4d832a63-1ca5-4b93-920b-c6ed9e562706 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '748e0708acdb41a8ad951334d4275888'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:59.441274 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4d832a63-1ca5-4b93-920b-c6ed9e562706 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '748e0708acdb41a8ad951334d4275888'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:59.441878 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4d832a63-1ca5-4b93-920b-c6ed9e562706 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '748e0708acdb41a8ad951334d4275888'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:12:59.454683 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1142/2261] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:12:59 2022] DELETE /identity/v3/users/748e0708acdb41a8ad951334d4275888 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:12:59.459348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4807b70-2267-47cd-b085-94cd28887579 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:59.459884 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4807b70-2267-47cd-b085-94cd28887579 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:59.459977 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4807b70-2267-47cd-b085-94cd28887579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:59.477855 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-b4807b70-2267-47cd-b085-94cd28887579 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:12:59.479244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b4807b70-2267-47cd-b085-94cd28887579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:59.541586 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1120/2262] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:12:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:12:59.551508 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d832a63-1ca5-4b93-920b-c6ed9e562706 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:59.552924 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4d832a63-1ca5-4b93-920b-c6ed9e562706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:59.611630 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d832a63-1ca5-4b93-920b-c6ed9e562706 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:59.615761 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa64c1d-5a04-458d-9adb-62514f153e76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:59.616417 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa64c1d-5a04-458d-9adb-62514f153e76 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:59.616702 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa64c1d-5a04-458d-9adb-62514f153e76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:59.616955 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa64c1d-5a04-458d-9adb-62514f153e76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:59.626517 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa64c1d-5a04-458d-9adb-62514f153e76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:59.627980 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa64c1d-5a04-458d-9adb-62514f153e76 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:12:59.638252 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1143/2263] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:12:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:12:59.950890 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4807b70-2267-47cd-b085-94cd28887579 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:12:59.952924 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b4807b70-2267-47cd-b085-94cd28887579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:12:59.975129 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4807b70-2267-47cd-b085-94cd28887579 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:12:59.983692 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc676c1-93f3-499d-b038-5b7c2e191ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:12:59.984687 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc676c1-93f3-499d-b038-5b7c2e191ca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:12:59.985003 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc676c1-93f3-499d-b038-5b7c2e191ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:12:59.985170 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc676c1-93f3-499d-b038-5b7c2e191ca1 admin admin] PATH_INFO: `/v3/projects/c2a9b4e6a4a547639814a222e43e2bce` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:12:59.986609 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc676c1-93f3-499d-b038-5b7c2e191ca1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2a9b4e6a4a547639814a222e43e2bce)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:12:59.988564 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc676c1-93f3-499d-b038-5b7c2e191ca1 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:00.038214 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0dc676c1-93f3-499d-b038-5b7c2e191ca1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2a9b4e6a4a547639814a222e43e2bce', 'request_id': 'req-0dc676c1-93f3-499d-b038-5b7c2e191ca1'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:00.044181 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0dc676c1-93f3-499d-b038-5b7c2e191ca1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2a9b4e6a4a547639814a222e43e2bce', 'request_id': 'req-0dc676c1-93f3-499d-b038-5b7c2e191ca1'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:00.050442 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0dc676c1-93f3-499d-b038-5b7c2e191ca1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2a9b4e6a4a547639814a222e43e2bce', 'request_id': 'req-0dc676c1-93f3-499d-b038-5b7c2e191ca1'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:00.064059 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0dc676c1-93f3-499d-b038-5b7c2e191ca1 admin admin] The token cache is being invalidate because project c2a9b4e6a4a547639814a222e43e2bce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:13:00.064356 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0dc676c1-93f3-499d-b038-5b7c2e191ca1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:00.065025 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0dc676c1-93f3-499d-b038-5b7c2e191ca1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:00.066658 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1121/2264] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:12:59 2022] DELETE /identity/v3/projects/c2a9b4e6a4a547639814a222e43e2bce => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:13:09.633298 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:10.060841 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:18.394396 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa64c1d-5a04-458d-9adb-62514f153e76 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:18.396107 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7aa64c1d-5a04-458d-9adb-62514f153e76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:18.409921 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa64c1d-5a04-458d-9adb-62514f153e76 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:18.477780 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138c0d7-37ef-4712-aac0-0b8e99f2623e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:18.478761 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138c0d7-37ef-4712-aac0-0b8e99f2623e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:18.479369 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138c0d7-37ef-4712-aac0-0b8e99f2623e admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:18.479369 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138c0d7-37ef-4712-aac0-0b8e99f2623e admin admin] PATH_INFO: `/v3/users/af11369a58ec4cb18b764df886007447` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:18.480586 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138c0d7-37ef-4712-aac0-0b8e99f2623e admin admin] RBAC: Authorizing `identity:delete_user(user_id=af11369a58ec4cb18b764df886007447)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:18.486949 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138c0d7-37ef-4712-aac0-0b8e99f2623e admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:18.543221 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6138c0d7-37ef-4712-aac0-0b8e99f2623e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af11369a58ec4cb18b764df886007447'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:18.555263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6138c0d7-37ef-4712-aac0-0b8e99f2623e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af11369a58ec4cb18b764df886007447'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:18.555887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6138c0d7-37ef-4712-aac0-0b8e99f2623e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af11369a58ec4cb18b764df886007447'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:18.567835 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6138c0d7-37ef-4712-aac0-0b8e99f2623e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af11369a58ec4cb18b764df886007447'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:18.568560 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6138c0d7-37ef-4712-aac0-0b8e99f2623e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af11369a58ec4cb18b764df886007447'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:18.581164 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1144/2265] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:13:18 2022] DELETE /identity/v3/users/af11369a58ec4cb18b764df886007447 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:13:18.587879 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89677473-6172-4680-b893-ddae268f71d9 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:18.588414 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89677473-6172-4680-b893-ddae268f71d9 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:18.588414 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89677473-6172-4680-b893-ddae268f71d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:18.606960 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-89677473-6172-4680-b893-ddae268f71d9 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:13:18.608167 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-89677473-6172-4680-b893-ddae268f71d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:18.672171 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1122/2266] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:13:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:13:18.682797 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138c0d7-37ef-4712-aac0-0b8e99f2623e admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:18.684433 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6138c0d7-37ef-4712-aac0-0b8e99f2623e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:18.749714 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138c0d7-37ef-4712-aac0-0b8e99f2623e admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:18.753428 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26be3d9-5e82-41dd-aaa6-08ba353652f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:18.754102 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26be3d9-5e82-41dd-aaa6-08ba353652f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:18.754423 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26be3d9-5e82-41dd-aaa6-08ba353652f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:18.754708 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26be3d9-5e82-41dd-aaa6-08ba353652f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:18.767392 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26be3d9-5e82-41dd-aaa6-08ba353652f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:18.769040 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26be3d9-5e82-41dd-aaa6-08ba353652f2 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:18.780602 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1145/2267] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:13:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:13:19.085724 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89677473-6172-4680-b893-ddae268f71d9 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:19.087197 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-89677473-6172-4680-b893-ddae268f71d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:19.100195 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89677473-6172-4680-b893-ddae268f71d9 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:19.106662 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b6cc5-a2c1-4693-894a-d72a7588714d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:19.107552 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b6cc5-a2c1-4693-894a-d72a7588714d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:19.108061 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b6cc5-a2c1-4693-894a-d72a7588714d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:19.108354 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b6cc5-a2c1-4693-894a-d72a7588714d admin admin] PATH_INFO: `/v3/projects/88f18b3ceb1b4f3c8b4e4e2f1629ec48` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:19.111274 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b6cc5-a2c1-4693-894a-d72a7588714d admin admin] RBAC: Authorizing `identity:delete_project(project_id=88f18b3ceb1b4f3c8b4e4e2f1629ec48)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:19.113691 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b6cc5-a2c1-4693-894a-d72a7588714d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:19.165712 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a33b6cc5-a2c1-4693-894a-d72a7588714d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88f18b3ceb1b4f3c8b4e4e2f1629ec48', 'request_id': 'req-a33b6cc5-a2c1-4693-894a-d72a7588714d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:19.172374 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a33b6cc5-a2c1-4693-894a-d72a7588714d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88f18b3ceb1b4f3c8b4e4e2f1629ec48', 'request_id': 'req-a33b6cc5-a2c1-4693-894a-d72a7588714d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:19.179013 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a33b6cc5-a2c1-4693-894a-d72a7588714d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88f18b3ceb1b4f3c8b4e4e2f1629ec48', 'request_id': 'req-a33b6cc5-a2c1-4693-894a-d72a7588714d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:19.192318 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a33b6cc5-a2c1-4693-894a-d72a7588714d admin admin] The token cache is being invalidate because project 88f18b3ceb1b4f3c8b4e4e2f1629ec48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:13:19.192610 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a33b6cc5-a2c1-4693-894a-d72a7588714d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:19.193230 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a33b6cc5-a2c1-4693-894a-d72a7588714d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:19.194946 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1123/2268] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:13:19 2022] DELETE /identity/v3/projects/88f18b3ceb1b4f3c8b4e4e2f1629ec48 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:13:19.200150 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced9afc-0578-4caf-bb18-4e41b4f128a7 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:19.200446 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced9afc-0578-4caf-bb18-4e41b4f128a7 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:19.200732 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced9afc-0578-4caf-bb18-4e41b4f128a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:19.224234 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-1ced9afc-0578-4caf-bb18-4e41b4f128a7 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:13:19.225490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1ced9afc-0578-4caf-bb18-4e41b4f128a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:19.249781 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:19.299237 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1146/2269] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:13:19.307727 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f2444-fa60-4a31-848b-4601cdf65d9b None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:19.308049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f2444-fa60-4a31-848b-4601cdf65d9b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:19.308336 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f2444-fa60-4a31-848b-4601cdf65d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:19.327761 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-250f2444-fa60-4a31-848b-4601cdf65d9b None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:13:19.329040 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-250f2444-fa60-4a31-848b-4601cdf65d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:19.338083 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1124/2270] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:13:19.342360 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced9afc-0578-4caf-bb18-4e41b4f128a7 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:19.352651 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced9afc-0578-4caf-bb18-4e41b4f128a7 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:19.358409 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88688287-0aad-4ba9-8b84-517b10864681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:19.359070 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88688287-0aad-4ba9-8b84-517b10864681 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:19.359350 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88688287-0aad-4ba9-8b84-517b10864681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:19.359622 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88688287-0aad-4ba9-8b84-517b10864681 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:19.360358 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88688287-0aad-4ba9-8b84-517b10864681 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:13:19.360670 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88688287-0aad-4ba9-8b84-517b10864681 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:19.362357 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88688287-0aad-4ba9-8b84-517b10864681 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:19.374939 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1147/2271] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:13:19.379212 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f2444-fa60-4a31-848b-4601cdf65d9b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:19.389144 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f2444-fa60-4a31-848b-4601cdf65d9b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:19.395142 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2cf664-9645-47f5-8103-2a9e6e35887d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:19.395802 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cf664-9645-47f5-8103-2a9e6e35887d admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:19.396088 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cf664-9645-47f5-8103-2a9e6e35887d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:19.396363 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cf664-9645-47f5-8103-2a9e6e35887d admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:19.397060 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2cf664-9645-47f5-8103-2a9e6e35887d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:19.399145 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2cf664-9645-47f5-8103-2a9e6e35887d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:19.458055 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1125/2272] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:13:19 2022] POST /identity/v3/projects => generated 385 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:13:19.462670 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88688287-0aad-4ba9-8b84-517b10864681 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:19.472960 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88688287-0aad-4ba9-8b84-517b10864681 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:19.581080 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa259569-4ad9-4c6b-91a2-546a332f63f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:19.581676 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa259569-4ad9-4c6b-91a2-546a332f63f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:19.581966 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa259569-4ad9-4c6b-91a2-546a332f63f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:19.582268 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa259569-4ad9-4c6b-91a2-546a332f63f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:19.582962 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa259569-4ad9-4c6b-91a2-546a332f63f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:19.584921 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa259569-4ad9-4c6b-91a2-546a332f63f2 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:19.604342 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1148/2273] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:13:19 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:13:19.608707 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2cf664-9645-47f5-8103-2a9e6e35887d admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:19.654196 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:19.657380 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2cf664-9645-47f5-8103-2a9e6e35887d admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:19.663758 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4c5d2-cf10-4f58-8e2b-378b9c8526e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:19.664803 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4c5d2-cf10-4f58-8e2b-378b9c8526e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:19.665144 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4c5d2-cf10-4f58-8e2b-378b9c8526e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:19.666282 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4c5d2-cf10-4f58-8e2b-378b9c8526e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:19.666529 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4c5d2-cf10-4f58-8e2b-378b9c8526e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:19.668136 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4c5d2-cf10-4f58-8e2b-378b9c8526e4 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:19.680322 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1126/2274] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:13:19.684546 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa259569-4ad9-4c6b-91a2-546a332f63f2 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:19.695710 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa259569-4ad9-4c6b-91a2-546a332f63f2 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:19.701267 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4c98d-65c7-4687-a0f3-dba7211b2a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:19.701941 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4c98d-65c7-4687-a0f3-dba7211b2a8a admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:19.702271 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4c98d-65c7-4687-a0f3-dba7211b2a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:19.702557 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4c98d-65c7-4687-a0f3-dba7211b2a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:19.703312 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab4c98d-65c7-4687-a0f3-dba7211b2a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:19.704949 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab4c98d-65c7-4687-a0f3-dba7211b2a8a admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:19.716221 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1149/2275] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:13:19.720640 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4c5d2-cf10-4f58-8e2b-378b9c8526e4 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:19.731606 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4c5d2-cf10-4f58-8e2b-378b9c8526e4 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:19.737769 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ffd2b-d0e2-498b-a048-ad4cb1ca21ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:19.738725 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ffd2b-d0e2-498b-a048-ad4cb1ca21ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:19.739026 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ffd2b-d0e2-498b-a048-ad4cb1ca21ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:19.739793 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ffd2b-d0e2-498b-a048-ad4cb1ca21ee admin admin] PATH_INFO: `/v3/projects/95a09adae8c34b72bd91e748680a5b71/users/99532a1154f541d5ae1a95b452d91bbc/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:19.755750 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ffd2b-d0e2-498b-a048-ad4cb1ca21ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=95a09adae8c34b72bd91e748680a5b71, user_id=99532a1154f541d5ae1a95b452d91bbc, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:19.758674 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ffd2b-d0e2-498b-a048-ad4cb1ca21ee admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:19.773643 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1127/2276] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:13:19 2022] PUT /identity/v3/projects/95a09adae8c34b72bd91e748680a5b71/users/99532a1154f541d5ae1a95b452d91bbc/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:13:19.784786 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d04f49-16f9-47a4-bd94-f739b3f212c2 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:19.785082 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d04f49-16f9-47a4-bd94-f739b3f212c2 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:19.785363 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d04f49-16f9-47a4-bd94-f739b3f212c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:19.811698 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-26d04f49-16f9-47a4-bd94-f739b3f212c2 None None] MFA Rules not processed for user `99532a1154f541d5ae1a95b452d91bbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:13:19.812951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-26d04f49-16f9-47a4-bd94-f739b3f212c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:19.846916 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:19.879131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1150/2277] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:13:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:13:19.883889 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ffd2b-d0e2-498b-a048-ad4cb1ca21ee admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:19.951110 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ffd2b-d0e2-498b-a048-ad4cb1ca21ee admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:19.956021 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78c448-c4c5-4943-b291-ddf1c77cea52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:19.956693 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78c448-c4c5-4943-b291-ddf1c77cea52 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:19.956985 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78c448-c4c5-4943-b291-ddf1c77cea52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:19.957268 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78c448-c4c5-4943-b291-ddf1c77cea52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:19.957967 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de78c448-c4c5-4943-b291-ddf1c77cea52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:19.959939 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de78c448-c4c5-4943-b291-ddf1c77cea52 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:19.992009 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1128/2278] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:13:19 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:13:19.996392 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d04f49-16f9-47a4-bd94-f739b3f212c2 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:20.007802 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d04f49-16f9-47a4-bd94-f739b3f212c2 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:20.072386 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bad29e-9e5d-44e1-b106-b94bbc12bdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:20.073514 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bad29e-9e5d-44e1-b106-b94bbc12bdad admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:20.073514 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bad29e-9e5d-44e1-b106-b94bbc12bdad admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:20.073694 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bad29e-9e5d-44e1-b106-b94bbc12bdad admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:20.074499 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bad29e-9e5d-44e1-b106-b94bbc12bdad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:20.076638 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bad29e-9e5d-44e1-b106-b94bbc12bdad admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:20.101384 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1151/2279] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:13:19 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:13:20.105331 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78c448-c4c5-4943-b291-ddf1c77cea52 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:20.117380 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78c448-c4c5-4943-b291-ddf1c77cea52 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:20.124170 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838442b-7ec7-4261-81cf-2f1e517ddfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:20.124859 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838442b-7ec7-4261-81cf-2f1e517ddfeb admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:20.125148 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838442b-7ec7-4261-81cf-2f1e517ddfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:20.125428 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838442b-7ec7-4261-81cf-2f1e517ddfeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:20.126203 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838442b-7ec7-4261-81cf-2f1e517ddfeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:20.127872 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838442b-7ec7-4261-81cf-2f1e517ddfeb admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:20.139692 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1129/2280] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 04:13:20.144642 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bad29e-9e5d-44e1-b106-b94bbc12bdad admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:20.157019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bad29e-9e5d-44e1-b106-b94bbc12bdad admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:20.161938 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24805137-b61a-417f-ac67-0e995591200d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:20.162716 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24805137-b61a-417f-ac67-0e995591200d admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:20.163193 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24805137-b61a-417f-ac67-0e995591200d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:20.163547 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24805137-b61a-417f-ac67-0e995591200d admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:20.164413 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24805137-b61a-417f-ac67-0e995591200d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:20.166489 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24805137-b61a-417f-ac67-0e995591200d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:20.182767 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1152/2281] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:13:20.184024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838442b-7ec7-4261-81cf-2f1e517ddfeb admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:20.196058 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838442b-7ec7-4261-81cf-2f1e517ddfeb admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:20.200938 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726631a-cdf8-44a5-9dcc-a83b1c0c7965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:20.201962 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726631a-cdf8-44a5-9dcc-a83b1c0c7965 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:20.202345 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726631a-cdf8-44a5-9dcc-a83b1c0c7965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:20.202698 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726631a-cdf8-44a5-9dcc-a83b1c0c7965 admin admin] PATH_INFO: `/v3/projects/879add49aad24c629836a749e9220105/users/f3ee00b36a9049009d1f89e30b83a7e3/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:20.220598 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d726631a-cdf8-44a5-9dcc-a83b1c0c7965 admin admin] RBAC: Authorizing `identity:create_grant(project_id=879add49aad24c629836a749e9220105, user_id=f3ee00b36a9049009d1f89e30b83a7e3, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:20.223375 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d726631a-cdf8-44a5-9dcc-a83b1c0c7965 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:20.242492 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1130/2282] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:13:20 2022] PUT /identity/v3/projects/879add49aad24c629836a749e9220105/users/f3ee00b36a9049009d1f89e30b83a7e3/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:13:20.254658 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a9d4b-6faa-4d29-a5fb-5b48949a8d36 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:20.254949 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a9d4b-6faa-4d29-a5fb-5b48949a8d36 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:20.255227 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a9d4b-6faa-4d29-a5fb-5b48949a8d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:20.290523 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-692a9d4b-6faa-4d29-a5fb-5b48949a8d36 None None] MFA Rules not processed for user `f3ee00b36a9049009d1f89e30b83a7e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:13:20.292512 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-692a9d4b-6faa-4d29-a5fb-5b48949a8d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:20.378310 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1153/2283] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:13:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:13:20.382121 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726631a-cdf8-44a5-9dcc-a83b1c0c7965 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:20.456359 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726631a-cdf8-44a5-9dcc-a83b1c0c7965 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:20.461316 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639c229-af8a-4f94-9af1-ac484c449cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:20.462027 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639c229-af8a-4f94-9af1-ac484c449cab admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:20.462351 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639c229-af8a-4f94-9af1-ac484c449cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:20.462634 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639c229-af8a-4f94-9af1-ac484c449cab admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:20.463360 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639c229-af8a-4f94-9af1-ac484c449cab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:20.465562 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639c229-af8a-4f94-9af1-ac484c449cab admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:20.496916 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1131/2284] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:13:20 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:13:20.502108 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a9d4b-6faa-4d29-a5fb-5b48949a8d36 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:20.523578 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a9d4b-6faa-4d29-a5fb-5b48949a8d36 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:20.588876 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:20.616408 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33eade-3bd3-4921-bff7-445b5047b90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:20.617077 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33eade-3bd3-4921-bff7-445b5047b90b admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:20.617481 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33eade-3bd3-4921-bff7-445b5047b90b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:20.617818 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33eade-3bd3-4921-bff7-445b5047b90b admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:20.618567 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed33eade-3bd3-4921-bff7-445b5047b90b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:20.620559 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed33eade-3bd3-4921-bff7-445b5047b90b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:20.645263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1154/2285] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:13:20 2022] POST /identity/v3/users => generated 297 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:13:20.649516 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639c229-af8a-4f94-9af1-ac484c449cab admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:20.655402 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:20.664942 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639c229-af8a-4f94-9af1-ac484c449cab admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:20.670037 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af976d0-6081-4a28-8538-0d6a245b3186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:20.670832 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af976d0-6081-4a28-8538-0d6a245b3186 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:20.671120 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af976d0-6081-4a28-8538-0d6a245b3186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:20.671397 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af976d0-6081-4a28-8538-0d6a245b3186 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:20.672280 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af976d0-6081-4a28-8538-0d6a245b3186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:20.673927 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af976d0-6081-4a28-8538-0d6a245b3186 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:20.689860 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1132/2286] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:13:20.690852 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33eade-3bd3-4921-bff7-445b5047b90b admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:20.705180 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33eade-3bd3-4921-bff7-445b5047b90b admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:20.711023 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c7fac-ecfa-4390-b03e-ac23849ce40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:20.711946 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c7fac-ecfa-4390-b03e-ac23849ce40f admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:20.712227 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c7fac-ecfa-4390-b03e-ac23849ce40f admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:20.712503 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c7fac-ecfa-4390-b03e-ac23849ce40f admin admin] PATH_INFO: `/v3/projects/bb4d9b8d4d6b443a98ad056a858662bd/users/6463870052814c80879322b64ede27ba/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:20.731496 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c7fac-ecfa-4390-b03e-ac23849ce40f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb4d9b8d4d6b443a98ad056a858662bd, user_id=6463870052814c80879322b64ede27ba, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:20.734358 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c7fac-ecfa-4390-b03e-ac23849ce40f admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:20.761579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af976d0-6081-4a28-8538-0d6a245b3186 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:20.762260 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1155/2287] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:13:20 2022] PUT /identity/v3/projects/bb4d9b8d4d6b443a98ad056a858662bd/users/6463870052814c80879322b64ede27ba/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:13:20.774575 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af976d0-6081-4a28-8538-0d6a245b3186 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:20.852510 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc37f3-11bc-4c11-ac94-2378572c652e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:20.853456 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc37f3-11bc-4c11-ac94-2378572c652e admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:20.853926 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc37f3-11bc-4c11-ac94-2378572c652e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:20.854425 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc37f3-11bc-4c11-ac94-2378572c652e admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:20.855360 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc37f3-11bc-4c11-ac94-2378572c652e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:20.857384 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc37f3-11bc-4c11-ac94-2378572c652e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:20.875768 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1133/2288] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:13:20.876930 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c7fac-ecfa-4390-b03e-ac23849ce40f admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:20.891746 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c7fac-ecfa-4390-b03e-ac23849ce40f admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:20.899025 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa621f45-8166-42ef-bfd0-e95433ea2cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:20.900047 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa621f45-8166-42ef-bfd0-e95433ea2cf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:20.900339 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa621f45-8166-42ef-bfd0-e95433ea2cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:20.900958 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa621f45-8166-42ef-bfd0-e95433ea2cf1 admin admin] PATH_INFO: `/v3/projects/bb4d9b8d4d6b443a98ad056a858662bd/users/6463870052814c80879322b64ede27ba/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:20.903233 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa621f45-8166-42ef-bfd0-e95433ea2cf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb4d9b8d4d6b443a98ad056a858662bd, user_id=6463870052814c80879322b64ede27ba, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:20.905993 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa621f45-8166-42ef-bfd0-e95433ea2cf1 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:20.926955 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1156/2289] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:13:20 2022] PUT /identity/v3/projects/bb4d9b8d4d6b443a98ad056a858662bd/users/6463870052814c80879322b64ede27ba/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 04:13:20.933752 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead44b9-7e62-4369-bb72-51ac710013dd None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:20.933752 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead44b9-7e62-4369-bb72-51ac710013dd None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:20.933752 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead44b9-7e62-4369-bb72-51ac710013dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:21.022992 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-cead44b9-7e62-4369-bb72-51ac710013dd None None] MFA Rules not processed for user `6463870052814c80879322b64ede27ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:13:21.024605 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-cead44b9-7e62-4369-bb72-51ac710013dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:21.112469 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1134/2290] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:13:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:13:21.126316 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa621f45-8166-42ef-bfd0-e95433ea2cf1 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:21.128285 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-aa621f45-8166-42ef-bfd0-e95433ea2cf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:21.219912 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa621f45-8166-42ef-bfd0-e95433ea2cf1 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:21.223596 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4d2e5-ca5e-4f5a-9013-f1a7b7d2a38c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:21.224336 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4d2e5-ca5e-4f5a-9013-f1a7b7d2a38c service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:21.224571 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4d2e5-ca5e-4f5a-9013-f1a7b7d2a38c service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:21.224852 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4d2e5-ca5e-4f5a-9013-f1a7b7d2a38c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:21.288032 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4d2e5-ca5e-4f5a-9013-f1a7b7d2a38c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:21.289668 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4d2e5-ca5e-4f5a-9013-f1a7b7d2a38c service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:21.302294 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1157/2291] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:13:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:13:22.352780 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead44b9-7e62-4369-bb72-51ac710013dd None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:22.354621 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-cead44b9-7e62-4369-bb72-51ac710013dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:22.423369 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead44b9-7e62-4369-bb72-51ac710013dd None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:22.428523 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f1028-6868-4e75-886d-4a4c1f2bc49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:22.429401 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f1028-6868-4e75-886d-4a4c1f2bc49e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:22.429683 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f1028-6868-4e75-886d-4a4c1f2bc49e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:22.429957 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f1028-6868-4e75-886d-4a4c1f2bc49e admin admin] PATH_INFO: `/v3/users/79636a7fdfca4f769e5dce42918ca78f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:22.431308 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f1028-6868-4e75-886d-4a4c1f2bc49e admin admin] RBAC: Authorizing `identity:delete_user(user_id=79636a7fdfca4f769e5dce42918ca78f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:22.433297 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f1028-6868-4e75-886d-4a4c1f2bc49e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:22.448042 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:22.484590 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-b57f1028-6868-4e75-886d-4a4c1f2bc49e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79636a7fdfca4f769e5dce42918ca78f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:22.485245 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-b57f1028-6868-4e75-886d-4a4c1f2bc49e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79636a7fdfca4f769e5dce42918ca78f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:22.494846 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-b57f1028-6868-4e75-886d-4a4c1f2bc49e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79636a7fdfca4f769e5dce42918ca78f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:22.506603 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-b57f1028-6868-4e75-886d-4a4c1f2bc49e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79636a7fdfca4f769e5dce42918ca78f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:22.507275 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-b57f1028-6868-4e75-886d-4a4c1f2bc49e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79636a7fdfca4f769e5dce42918ca78f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:22.521712 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1135/2292] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:13:22 2022] DELETE /identity/v3/users/79636a7fdfca4f769e5dce42918ca78f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:13:22.526882 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e4784-5349-4992-9dc2-fadc75df72fd None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:22.527387 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e4784-5349-4992-9dc2-fadc75df72fd None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:22.527387 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e4784-5349-4992-9dc2-fadc75df72fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:22.555864 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ab3e4784-5349-4992-9dc2-fadc75df72fd None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:13:22.557510 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ab3e4784-5349-4992-9dc2-fadc75df72fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:22.585017 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:22.630387 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1158/2293] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:13:22.640109 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f1028-6868-4e75-886d-4a4c1f2bc49e admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:22.641730 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b57f1028-6868-4e75-886d-4a4c1f2bc49e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:22.722968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f1028-6868-4e75-886d-4a4c1f2bc49e admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:22.726893 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587fc94b-c917-4f8b-af4f-44997e9f9e4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:22.727565 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587fc94b-c917-4f8b-af4f-44997e9f9e4c service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:22.727831 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587fc94b-c917-4f8b-af4f-44997e9f9e4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:22.728175 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587fc94b-c917-4f8b-af4f-44997e9f9e4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:22.738521 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587fc94b-c917-4f8b-af4f-44997e9f9e4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:22.740380 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587fc94b-c917-4f8b-af4f-44997e9f9e4c service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:22.751300 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1136/2294] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:13:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:13:23.116534 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e4784-5349-4992-9dc2-fadc75df72fd None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:23.118094 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ab3e4784-5349-4992-9dc2-fadc75df72fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:23.132133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e4784-5349-4992-9dc2-fadc75df72fd None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:23.137053 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a02dc9-8c17-477e-8250-7f43c031418d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:23.138039 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a02dc9-8c17-477e-8250-7f43c031418d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:23.138509 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a02dc9-8c17-477e-8250-7f43c031418d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:23.138863 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a02dc9-8c17-477e-8250-7f43c031418d admin admin] PATH_INFO: `/v3/projects/ee4d3d0504604dc2bf4243337514abf3` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:23.140362 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a02dc9-8c17-477e-8250-7f43c031418d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee4d3d0504604dc2bf4243337514abf3)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:23.142426 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a02dc9-8c17-477e-8250-7f43c031418d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:23.189855 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-27a02dc9-8c17-477e-8250-7f43c031418d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee4d3d0504604dc2bf4243337514abf3', 'request_id': 'req-27a02dc9-8c17-477e-8250-7f43c031418d'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:23.196679 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-27a02dc9-8c17-477e-8250-7f43c031418d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee4d3d0504604dc2bf4243337514abf3', 'request_id': 'req-27a02dc9-8c17-477e-8250-7f43c031418d'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:23.202823 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-27a02dc9-8c17-477e-8250-7f43c031418d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee4d3d0504604dc2bf4243337514abf3', 'request_id': 'req-27a02dc9-8c17-477e-8250-7f43c031418d'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:23.222144 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-27a02dc9-8c17-477e-8250-7f43c031418d admin admin] The token cache is being invalidate because project ee4d3d0504604dc2bf4243337514abf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:13:23.222615 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-27a02dc9-8c17-477e-8250-7f43c031418d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:23.223336 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-27a02dc9-8c17-477e-8250-7f43c031418d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:23.225011 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1159/2295] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:13:23 2022] DELETE /identity/v3/projects/ee4d3d0504604dc2bf4243337514abf3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:13:23.229306 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587fc94b-c917-4f8b-af4f-44997e9f9e4c service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:23.240047 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587fc94b-c917-4f8b-af4f-44997e9f9e4c service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:23.301997 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ee5a7-27bb-4f2f-afcf-c8ab3d915f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:23.302929 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ee5a7-27bb-4f2f-afcf-c8ab3d915f8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:23.303220 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ee5a7-27bb-4f2f-afcf-c8ab3d915f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:23.303506 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ee5a7-27bb-4f2f-afcf-c8ab3d915f8c admin admin] PATH_INFO: `/v3/users/c15ae4fb97e7407f9212e319e0435ec2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:23.304732 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ee5a7-27bb-4f2f-afcf-c8ab3d915f8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c15ae4fb97e7407f9212e319e0435ec2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:23.306733 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ee5a7-27bb-4f2f-afcf-c8ab3d915f8c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:23.322258 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:23.357280 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-6d2ee5a7-27bb-4f2f-afcf-c8ab3d915f8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c15ae4fb97e7407f9212e319e0435ec2'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:23.358364 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-6d2ee5a7-27bb-4f2f-afcf-c8ab3d915f8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c15ae4fb97e7407f9212e319e0435ec2'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:23.367393 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-6d2ee5a7-27bb-4f2f-afcf-c8ab3d915f8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c15ae4fb97e7407f9212e319e0435ec2'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:23.379213 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-6d2ee5a7-27bb-4f2f-afcf-c8ab3d915f8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c15ae4fb97e7407f9212e319e0435ec2'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:23.379844 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-6d2ee5a7-27bb-4f2f-afcf-c8ab3d915f8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c15ae4fb97e7407f9212e319e0435ec2'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:23.391778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1137/2296] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:13:23 2022] DELETE /identity/v3/users/c15ae4fb97e7407f9212e319e0435ec2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:13:23.667675 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a02dc9-8c17-477e-8250-7f43c031418d admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:23.669261 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-27a02dc9-8c17-477e-8250-7f43c031418d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:23.686049 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a02dc9-8c17-477e-8250-7f43c031418d admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:23.760228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac34e1cf-5d58-4a27-8275-bbed71266212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:23.761120 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34e1cf-5d58-4a27-8275-bbed71266212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:23.761409 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34e1cf-5d58-4a27-8275-bbed71266212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:23.761693 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34e1cf-5d58-4a27-8275-bbed71266212 admin admin] PATH_INFO: `/v3/projects/99d47ae453dc4c848713a98f59f7c33d` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:23.763074 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac34e1cf-5d58-4a27-8275-bbed71266212 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99d47ae453dc4c848713a98f59f7c33d)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:23.765218 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac34e1cf-5d58-4a27-8275-bbed71266212 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:23.820327 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ac34e1cf-5d58-4a27-8275-bbed71266212 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99d47ae453dc4c848713a98f59f7c33d', 'request_id': 'req-ac34e1cf-5d58-4a27-8275-bbed71266212'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:23.827265 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ac34e1cf-5d58-4a27-8275-bbed71266212 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99d47ae453dc4c848713a98f59f7c33d', 'request_id': 'req-ac34e1cf-5d58-4a27-8275-bbed71266212'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:23.828578 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:23.834122 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ac34e1cf-5d58-4a27-8275-bbed71266212 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99d47ae453dc4c848713a98f59f7c33d', 'request_id': 'req-ac34e1cf-5d58-4a27-8275-bbed71266212'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:23.851571 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ac34e1cf-5d58-4a27-8275-bbed71266212 admin admin] The token cache is being invalidate because project 99d47ae453dc4c848713a98f59f7c33d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:13:23.851866 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ac34e1cf-5d58-4a27-8275-bbed71266212 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:23.852580 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ac34e1cf-5d58-4a27-8275-bbed71266212 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:23.854412 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1160/2297] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:13:23 2022] DELETE /identity/v3/projects/99d47ae453dc4c848713a98f59f7c33d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:13:23.859276 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c61bcc-0b2a-4e52-bfb9-c659e157e339 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:23.859564 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c61bcc-0b2a-4e52-bfb9-c659e157e339 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:23.859851 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c61bcc-0b2a-4e52-bfb9-c659e157e339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:23.882495 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac34e1cf-5d58-4a27-8275-bbed71266212 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:23.884001 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ac34e1cf-5d58-4a27-8275-bbed71266212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:23.901313 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-b7c61bcc-0b2a-4e52-bfb9-c659e157e339 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:13:23.902812 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b7c61bcc-0b2a-4e52-bfb9-c659e157e339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:23.944753 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac34e1cf-5d58-4a27-8275-bbed71266212 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:23.948481 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6952b-318f-496a-8e95-4af85d738cbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:23.949138 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6952b-318f-496a-8e95-4af85d738cbe service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:23.949423 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6952b-318f-496a-8e95-4af85d738cbe service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:23.949767 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6952b-318f-496a-8e95-4af85d738cbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:23.951592 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d4d6952b-318f-496a-8e95-4af85d738cbe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:23.971028 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1138/2298] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:13:23.978847 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5c050-5abb-458b-b0b6-e6b788ef2d23 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:23.979140 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5c050-5abb-458b-b0b6-e6b788ef2d23 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:23.979442 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5c050-5abb-458b-b0b6-e6b788ef2d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:24.006952 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-dbc5c050-5abb-458b-b0b6-e6b788ef2d23 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:13:24.008092 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-dbc5c050-5abb-458b-b0b6-e6b788ef2d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:24.016509 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1139/2299] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:13:24.020345 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5c050-5abb-458b-b0b6-e6b788ef2d23 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:24.021478 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d6952b-318f-496a-8e95-4af85d738cbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:24.023035 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d6952b-318f-496a-8e95-4af85d738cbe service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:24.030209 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5c050-5abb-458b-b0b6-e6b788ef2d23 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:24.035271 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448172c-c7e4-4cec-a689-c3906e34495f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:24.036374 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448172c-c7e4-4cec-a689-c3906e34495f admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:24.036374 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448172c-c7e4-4cec-a689-c3906e34495f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:24.036556 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448172c-c7e4-4cec-a689-c3906e34495f admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:24.037220 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448172c-c7e4-4cec-a689-c3906e34495f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:13:24.037540 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448172c-c7e4-4cec-a689-c3906e34495f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:24.038343 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1161/2300] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:13:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 04:13:24.039238 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448172c-c7e4-4cec-a689-c3906e34495f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:24.055081 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1140/2301] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:13:24.056388 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6952b-318f-496a-8e95-4af85d738cbe service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:24.068306 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6952b-318f-496a-8e95-4af85d738cbe service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:24.074028 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb3562-4ab0-407c-bbf3-7fedf3160322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:24.074802 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb3562-4ab0-407c-bbf3-7fedf3160322 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:24.075810 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb3562-4ab0-407c-bbf3-7fedf3160322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:24.076164 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb3562-4ab0-407c-bbf3-7fedf3160322 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:24.077537 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb3562-4ab0-407c-bbf3-7fedf3160322 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:24.079755 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb3562-4ab0-407c-bbf3-7fedf3160322 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:24.117587 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1162/2302] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:13:24 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:13:24.117799 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448172c-c7e4-4cec-a689-c3906e34495f admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:24.126243 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448172c-c7e4-4cec-a689-c3906e34495f admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:24.203312 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a2bfb-7c50-465b-8d83-4824300e3398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:24.204000 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a2bfb-7c50-465b-8d83-4824300e3398 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:24.204405 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a2bfb-7c50-465b-8d83-4824300e3398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:24.204799 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a2bfb-7c50-465b-8d83-4824300e3398 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:24.205502 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147a2bfb-7c50-465b-8d83-4824300e3398 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:24.207481 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147a2bfb-7c50-465b-8d83-4824300e3398 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:24.214315 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:24.232773 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1141/2303] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:13:24 2022] POST /identity/v3/users => generated 291 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:13:24.234057 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb3562-4ab0-407c-bbf3-7fedf3160322 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:24.244883 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb3562-4ab0-407c-bbf3-7fedf3160322 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:24.249625 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd2ff23-94d7-4340-9696-58e68dfbb863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:24.250320 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2ff23-94d7-4340-9696-58e68dfbb863 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:24.250604 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2ff23-94d7-4340-9696-58e68dfbb863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:24.250877 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2ff23-94d7-4340-9696-58e68dfbb863 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:24.251612 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd2ff23-94d7-4340-9696-58e68dfbb863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:24.253320 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd2ff23-94d7-4340-9696-58e68dfbb863 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:24.264346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1163/2304] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:13:24.269126 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a2bfb-7c50-465b-8d83-4824300e3398 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:24.279113 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a2bfb-7c50-465b-8d83-4824300e3398 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:24.283827 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229dfc4-b9c2-4cbf-a733-141c69fe8db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:24.284491 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229dfc4-b9c2-4cbf-a733-141c69fe8db4 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:24.284776 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229dfc4-b9c2-4cbf-a733-141c69fe8db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:24.285053 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229dfc4-b9c2-4cbf-a733-141c69fe8db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:24.285803 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229dfc4-b9c2-4cbf-a733-141c69fe8db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:24.287733 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229dfc4-b9c2-4cbf-a733-141c69fe8db4 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:24.300923 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1142/2305] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:13:24.305367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd2ff23-94d7-4340-9696-58e68dfbb863 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:24.316835 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd2ff23-94d7-4340-9696-58e68dfbb863 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:24.322365 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3be911-d462-4030-820d-ca3c7dfb163a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:24.323266 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3be911-d462-4030-820d-ca3c7dfb163a admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:24.323547 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3be911-d462-4030-820d-ca3c7dfb163a admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:24.323823 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3be911-d462-4030-820d-ca3c7dfb163a admin admin] PATH_INFO: `/v3/projects/8a25e660b1ba4ba683f3e10c2e4a0c5a/users/2c8d7a7287604fd5a56d57c2595218e0/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:24.340502 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3be911-d462-4030-820d-ca3c7dfb163a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a25e660b1ba4ba683f3e10c2e4a0c5a, user_id=2c8d7a7287604fd5a56d57c2595218e0, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:24.343292 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3be911-d462-4030-820d-ca3c7dfb163a admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:24.360691 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1164/2306] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:13:24 2022] PUT /identity/v3/projects/8a25e660b1ba4ba683f3e10c2e4a0c5a/users/2c8d7a7287604fd5a56d57c2595218e0/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 04:13:24.373728 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f8a18-0977-4ae8-a201-21c872a264e9 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:24.373728 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f8a18-0977-4ae8-a201-21c872a264e9 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:24.373728 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f8a18-0977-4ae8-a201-21c872a264e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:24.401771 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e38f8a18-0977-4ae8-a201-21c872a264e9 None None] MFA Rules not processed for user `2c8d7a7287604fd5a56d57c2595218e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:13:24.403072 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e38f8a18-0977-4ae8-a201-21c872a264e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:24.474988 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1143/2307] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:13:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:13:24.479630 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3be911-d462-4030-820d-ca3c7dfb163a admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:24.526272 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:24.549234 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3be911-d462-4030-820d-ca3c7dfb163a admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:24.553951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d47750-f0f1-40c3-a1c7-f028fcba0d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:24.554657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d47750-f0f1-40c3-a1c7-f028fcba0d20 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:24.554943 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d47750-f0f1-40c3-a1c7-f028fcba0d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:24.555218 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d47750-f0f1-40c3-a1c7-f028fcba0d20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:24.555924 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d47750-f0f1-40c3-a1c7-f028fcba0d20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:24.557870 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d47750-f0f1-40c3-a1c7-f028fcba0d20 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:24.585818 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1165/2308] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:13:24 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 04:13:24.590041 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f8a18-0977-4ae8-a201-21c872a264e9 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:24.601195 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f8a18-0977-4ae8-a201-21c872a264e9 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:24.607870 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d47750-f0f1-40c3-a1c7-f028fcba0d20 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:24.664782 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776e998-142c-4fc7-8cab-54fb8f15b7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:24.665738 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776e998-142c-4fc7-8cab-54fb8f15b7da admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:24.666019 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776e998-142c-4fc7-8cab-54fb8f15b7da admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:24.666348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776e998-142c-4fc7-8cab-54fb8f15b7da admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:24.667057 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e776e998-142c-4fc7-8cab-54fb8f15b7da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:24.669014 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e776e998-142c-4fc7-8cab-54fb8f15b7da admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:24.669235 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d47750-f0f1-40c3-a1c7-f028fcba0d20 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:24.673069 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fca804-df51-4baf-83df-99b8bfbeafb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:24.679515 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fca804-df51-4baf-83df-99b8bfbeafb5 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:24.680078 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fca804-df51-4baf-83df-99b8bfbeafb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:24.680494 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fca804-df51-4baf-83df-99b8bfbeafb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:24.683177 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b1fca804-df51-4baf-83df-99b8bfbeafb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:24.692447 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1144/2309] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:13:24 2022] POST /identity/v3/users => generated 296 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:13:24.696047 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776e998-142c-4fc7-8cab-54fb8f15b7da admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:24.705852 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776e998-142c-4fc7-8cab-54fb8f15b7da admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:24.710701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d047a4f-32a0-4dd4-ad0a-1a06d4590fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:24.711439 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d047a4f-32a0-4dd4-ad0a-1a06d4590fed admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:24.711728 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d047a4f-32a0-4dd4-ad0a-1a06d4590fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:24.712008 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d047a4f-32a0-4dd4-ad0a-1a06d4590fed admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:24.712819 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d047a4f-32a0-4dd4-ad0a-1a06d4590fed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:24.714486 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d047a4f-32a0-4dd4-ad0a-1a06d4590fed admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:24.728283 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1145/2310] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 04:13:24.729323 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d047a4f-32a0-4dd4-ad0a-1a06d4590fed admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:24.739461 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d047a4f-32a0-4dd4-ad0a-1a06d4590fed admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:24.744233 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ded6ae-303f-4761-8017-7cb366f52c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:24.745108 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ded6ae-303f-4761-8017-7cb366f52c24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:24.745534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ded6ae-303f-4761-8017-7cb366f52c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:24.745802 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ded6ae-303f-4761-8017-7cb366f52c24 admin admin] PATH_INFO: `/v3/projects/81a76c539c6a400ba65d9ae4be858e2e/users/b0d8ee70b50842578c638c15dcb49e79/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:24.750351 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fca804-df51-4baf-83df-99b8bfbeafb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:24.750351 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fca804-df51-4baf-83df-99b8bfbeafb5 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:24.762475 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1166/2311] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:13:24 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 04:13:24.775341 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ded6ae-303f-4761-8017-7cb366f52c24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81a76c539c6a400ba65d9ae4be858e2e, user_id=b0d8ee70b50842578c638c15dcb49e79, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:24.778192 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ded6ae-303f-4761-8017-7cb366f52c24 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:24.794268 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1146/2312] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:13:24 2022] PUT /identity/v3/projects/81a76c539c6a400ba65d9ae4be858e2e/users/b0d8ee70b50842578c638c15dcb49e79/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 04:13:24.798386 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fca804-df51-4baf-83df-99b8bfbeafb5 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:24.809334 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fca804-df51-4baf-83df-99b8bfbeafb5 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:24.872297 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e39f520-b2f0-4723-8ecd-1c9e4154b731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:24.872971 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39f520-b2f0-4723-8ecd-1c9e4154b731 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:24.873250 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39f520-b2f0-4723-8ecd-1c9e4154b731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:24.873527 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39f520-b2f0-4723-8ecd-1c9e4154b731 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:24.874890 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e39f520-b2f0-4723-8ecd-1c9e4154b731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:24.876882 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e39f520-b2f0-4723-8ecd-1c9e4154b731 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:24.889412 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1167/2313] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:13:24.894088 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ded6ae-303f-4761-8017-7cb366f52c24 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:24.906201 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ded6ae-303f-4761-8017-7cb366f52c24 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:24.911626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78433b-8369-4946-b416-9a5c72315eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:24.912528 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78433b-8369-4946-b416-9a5c72315eec admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:24.912847 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78433b-8369-4946-b416-9a5c72315eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:24.913127 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78433b-8369-4946-b416-9a5c72315eec admin admin] PATH_INFO: `/v3/projects/81a76c539c6a400ba65d9ae4be858e2e/users/b0d8ee70b50842578c638c15dcb49e79/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:24.915358 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad78433b-8369-4946-b416-9a5c72315eec admin admin] RBAC: Authorizing `identity:create_grant(project_id=81a76c539c6a400ba65d9ae4be858e2e, user_id=b0d8ee70b50842578c638c15dcb49e79, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:24.918096 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad78433b-8369-4946-b416-9a5c72315eec admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:24.932100 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1147/2314] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:13:24 2022] PUT /identity/v3/projects/81a76c539c6a400ba65d9ae4be858e2e/users/b0d8ee70b50842578c638c15dcb49e79/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:13:24.946280 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1531d80-4495-4d54-9a5c-79048e45f43c None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:24.946606 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1531d80-4495-4d54-9a5c-79048e45f43c None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:24.946944 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1531d80-4495-4d54-9a5c-79048e45f43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:24.972144 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:24.981562 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-b1531d80-4495-4d54-9a5c-79048e45f43c None None] MFA Rules not processed for user `b0d8ee70b50842578c638c15dcb49e79`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:13:24.982827 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b1531d80-4495-4d54-9a5c-79048e45f43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:25.054440 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1168/2315] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:13:24 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:13:25.066225 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78433b-8369-4946-b416-9a5c72315eec admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:25.077446 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:25.126205 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78433b-8369-4946-b416-9a5c72315eec admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:25.129654 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808d571-8fd5-4a55-971f-50320b2b34d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:25.130341 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808d571-8fd5-4a55-971f-50320b2b34d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:25.130633 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808d571-8fd5-4a55-971f-50320b2b34d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:25.130915 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808d571-8fd5-4a55-971f-50320b2b34d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:25.140925 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808d571-8fd5-4a55-971f-50320b2b34d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:25.142453 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808d571-8fd5-4a55-971f-50320b2b34d0 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:25.152756 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1148/2316] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:13:25 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:13:25.264624 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1531d80-4495-4d54-9a5c-79048e45f43c None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:25.266046 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b1531d80-4495-4d54-9a5c-79048e45f43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:25.280887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1531d80-4495-4d54-9a5c-79048e45f43c None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:25.284817 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33feb7fb-77c6-4286-bcb5-0db9a7914446 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:25.285506 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33feb7fb-77c6-4286-bcb5-0db9a7914446 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:25.285794 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33feb7fb-77c6-4286-bcb5-0db9a7914446 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:25.286077 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33feb7fb-77c6-4286-bcb5-0db9a7914446 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:25.344448 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33feb7fb-77c6-4286-bcb5-0db9a7914446 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:25.345833 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33feb7fb-77c6-4286-bcb5-0db9a7914446 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:25.354923 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1169/2317] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:13:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:13:29.339097 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff33ed6-efab-449b-86f7-0d0bff25af29 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:29.339631 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff33ed6-efab-449b-86f7-0d0bff25af29 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:29.339631 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff33ed6-efab-449b-86f7-0d0bff25af29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:29.358414 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-aff33ed6-efab-449b-86f7-0d0bff25af29 None None] MFA Rules not processed for user `2648301ff6d24e14a2b0b8e34f742c9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:13:29.359629 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-aff33ed6-efab-449b-86f7-0d0bff25af29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:29.417296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1149/2318] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:13:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:13:29.761478 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33feb7fb-77c6-4286-bcb5-0db9a7914446 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:29.763064 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-33feb7fb-77c6-4286-bcb5-0db9a7914446 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:29.845451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33feb7fb-77c6-4286-bcb5-0db9a7914446 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:29.850371 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05782e3c-4213-4b86-b2fb-0b0e3f55bbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:29.851210 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05782e3c-4213-4b86-b2fb-0b0e3f55bbfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:29.851499 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05782e3c-4213-4b86-b2fb-0b0e3f55bbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:29.851786 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05782e3c-4213-4b86-b2fb-0b0e3f55bbfb admin admin] PATH_INFO: `/v3/users/99532a1154f541d5ae1a95b452d91bbc` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:29.853039 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05782e3c-4213-4b86-b2fb-0b0e3f55bbfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=99532a1154f541d5ae1a95b452d91bbc)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:29.855054 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05782e3c-4213-4b86-b2fb-0b0e3f55bbfb admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:29.908936 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:29.923179 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-05782e3c-4213-4b86-b2fb-0b0e3f55bbfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99532a1154f541d5ae1a95b452d91bbc'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:29.938038 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-05782e3c-4213-4b86-b2fb-0b0e3f55bbfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99532a1154f541d5ae1a95b452d91bbc'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:29.938813 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-05782e3c-4213-4b86-b2fb-0b0e3f55bbfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99532a1154f541d5ae1a95b452d91bbc'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:29.955764 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-05782e3c-4213-4b86-b2fb-0b0e3f55bbfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99532a1154f541d5ae1a95b452d91bbc'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:29.956490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-05782e3c-4213-4b86-b2fb-0b0e3f55bbfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99532a1154f541d5ae1a95b452d91bbc'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:29.986310 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1170/2319] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:13:29 2022] DELETE /identity/v3/users/99532a1154f541d5ae1a95b452d91bbc => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:13:29.987938 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc51e4-2262-4615-8d9d-886995f3b6a0 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:29.988237 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc51e4-2262-4615-8d9d-886995f3b6a0 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:29.988575 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc51e4-2262-4615-8d9d-886995f3b6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:30.010525 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-75cc51e4-2262-4615-8d9d-886995f3b6a0 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:13:30.011898 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-75cc51e4-2262-4615-8d9d-886995f3b6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:30.097110 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1150/2320] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:13:30.106786 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05782e3c-4213-4b86-b2fb-0b0e3f55bbfb admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:30.109093 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-05782e3c-4213-4b86-b2fb-0b0e3f55bbfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:30.189415 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05782e3c-4213-4b86-b2fb-0b0e3f55bbfb admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:30.197838 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0680a4-7259-42d7-9698-4d501f4f2a9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:30.198577 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0680a4-7259-42d7-9698-4d501f4f2a9b service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:30.199115 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0680a4-7259-42d7-9698-4d501f4f2a9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:30.199403 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0680a4-7259-42d7-9698-4d501f4f2a9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:30.209780 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0680a4-7259-42d7-9698-4d501f4f2a9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:30.211397 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0680a4-7259-42d7-9698-4d501f4f2a9b service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:30.222206 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1171/2321] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:13:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:13:30.515723 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc51e4-2262-4615-8d9d-886995f3b6a0 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:30.517285 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-75cc51e4-2262-4615-8d9d-886995f3b6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:30.533448 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc51e4-2262-4615-8d9d-886995f3b6a0 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:30.540927 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58da27-b2a9-4e33-a00b-1d93a4eb0665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:30.542232 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58da27-b2a9-4e33-a00b-1d93a4eb0665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:30.542595 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58da27-b2a9-4e33-a00b-1d93a4eb0665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:30.542896 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58da27-b2a9-4e33-a00b-1d93a4eb0665 admin admin] PATH_INFO: `/v3/projects/95a09adae8c34b72bd91e748680a5b71` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:30.544369 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe58da27-b2a9-4e33-a00b-1d93a4eb0665 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95a09adae8c34b72bd91e748680a5b71)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:30.549663 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe58da27-b2a9-4e33-a00b-1d93a4eb0665 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:30.601775 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fe58da27-b2a9-4e33-a00b-1d93a4eb0665 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95a09adae8c34b72bd91e748680a5b71', 'request_id': 'req-fe58da27-b2a9-4e33-a00b-1d93a4eb0665'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:30.603910 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:30.609033 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fe58da27-b2a9-4e33-a00b-1d93a4eb0665 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95a09adae8c34b72bd91e748680a5b71', 'request_id': 'req-fe58da27-b2a9-4e33-a00b-1d93a4eb0665'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:30.616549 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fe58da27-b2a9-4e33-a00b-1d93a4eb0665 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95a09adae8c34b72bd91e748680a5b71', 'request_id': 'req-fe58da27-b2a9-4e33-a00b-1d93a4eb0665'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:30.630924 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fe58da27-b2a9-4e33-a00b-1d93a4eb0665 admin admin] The token cache is being invalidate because project 95a09adae8c34b72bd91e748680a5b71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:13:30.631149 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fe58da27-b2a9-4e33-a00b-1d93a4eb0665 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:30.631783 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fe58da27-b2a9-4e33-a00b-1d93a4eb0665 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:30.633377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1151/2322] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:13:30 2022] DELETE /identity/v3/projects/95a09adae8c34b72bd91e748680a5b71 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:13:30.637492 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0680a4-7259-42d7-9698-4d501f4f2a9b service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:30.647530 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0680a4-7259-42d7-9698-4d501f4f2a9b service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:30.712068 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24926157-1512-43c8-ae06-2567b06bc2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:30.712946 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24926157-1512-43c8-ae06-2567b06bc2e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:30.713240 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24926157-1512-43c8-ae06-2567b06bc2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:30.713523 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24926157-1512-43c8-ae06-2567b06bc2e9 admin admin] PATH_INFO: `/v3/users/f3ee00b36a9049009d1f89e30b83a7e3` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:30.714795 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24926157-1512-43c8-ae06-2567b06bc2e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3ee00b36a9049009d1f89e30b83a7e3)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:30.716760 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24926157-1512-43c8-ae06-2567b06bc2e9 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:30.778562 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-24926157-1512-43c8-ae06-2567b06bc2e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3ee00b36a9049009d1f89e30b83a7e3'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:30.788135 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-24926157-1512-43c8-ae06-2567b06bc2e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3ee00b36a9049009d1f89e30b83a7e3'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:30.788833 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-24926157-1512-43c8-ae06-2567b06bc2e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3ee00b36a9049009d1f89e30b83a7e3'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:30.793673 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:30.802945 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-24926157-1512-43c8-ae06-2567b06bc2e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3ee00b36a9049009d1f89e30b83a7e3'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:30.803774 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-24926157-1512-43c8-ae06-2567b06bc2e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3ee00b36a9049009d1f89e30b83a7e3'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:30.816432 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1172/2323] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:13:30 2022] DELETE /identity/v3/users/f3ee00b36a9049009d1f89e30b83a7e3 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:13:31.101354 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58da27-b2a9-4e33-a00b-1d93a4eb0665 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:31.103112 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-fe58da27-b2a9-4e33-a00b-1d93a4eb0665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:31.117415 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58da27-b2a9-4e33-a00b-1d93a4eb0665 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:31.185707 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bb2bc-e447-404e-8b51-e7a3eaf6fc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:31.186669 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bb2bc-e447-404e-8b51-e7a3eaf6fc2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:31.186969 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bb2bc-e447-404e-8b51-e7a3eaf6fc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:31.187244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bb2bc-e447-404e-8b51-e7a3eaf6fc2c admin admin] PATH_INFO: `/v3/projects/879add49aad24c629836a749e9220105` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:31.188505 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389bb2bc-e447-404e-8b51-e7a3eaf6fc2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=879add49aad24c629836a749e9220105)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:31.190493 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389bb2bc-e447-404e-8b51-e7a3eaf6fc2c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:31.251082 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-389bb2bc-e447-404e-8b51-e7a3eaf6fc2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '879add49aad24c629836a749e9220105', 'request_id': 'req-389bb2bc-e447-404e-8b51-e7a3eaf6fc2c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:31.257995 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-389bb2bc-e447-404e-8b51-e7a3eaf6fc2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '879add49aad24c629836a749e9220105', 'request_id': 'req-389bb2bc-e447-404e-8b51-e7a3eaf6fc2c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:31.265174 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-389bb2bc-e447-404e-8b51-e7a3eaf6fc2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '879add49aad24c629836a749e9220105', 'request_id': 'req-389bb2bc-e447-404e-8b51-e7a3eaf6fc2c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:31.282575 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-389bb2bc-e447-404e-8b51-e7a3eaf6fc2c admin admin] The token cache is being invalidate because project 879add49aad24c629836a749e9220105 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:13:31.282575 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-389bb2bc-e447-404e-8b51-e7a3eaf6fc2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:31.282575 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-389bb2bc-e447-404e-8b51-e7a3eaf6fc2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:31.283927 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1152/2324] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:13:31 2022] DELETE /identity/v3/projects/879add49aad24c629836a749e9220105 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:13:31.287947 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24926157-1512-43c8-ae06-2567b06bc2e9 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:31.289367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-24926157-1512-43c8-ae06-2567b06bc2e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:31.302988 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24926157-1512-43c8-ae06-2567b06bc2e9 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:31.369162 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68df191-31c7-4a0f-889a-d3d1557761c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:31.370214 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68df191-31c7-4a0f-889a-d3d1557761c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:31.370605 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68df191-31c7-4a0f-889a-d3d1557761c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:31.371038 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68df191-31c7-4a0f-889a-d3d1557761c9 admin admin] PATH_INFO: `/v3/users/6463870052814c80879322b64ede27ba` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:31.372486 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68df191-31c7-4a0f-889a-d3d1557761c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6463870052814c80879322b64ede27ba)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:31.375184 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68df191-31c7-4a0f-889a-d3d1557761c9 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:31.437713 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a68df191-31c7-4a0f-889a-d3d1557761c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6463870052814c80879322b64ede27ba'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:31.448036 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a68df191-31c7-4a0f-889a-d3d1557761c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6463870052814c80879322b64ede27ba'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:31.448782 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a68df191-31c7-4a0f-889a-d3d1557761c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6463870052814c80879322b64ede27ba'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:31.463733 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a68df191-31c7-4a0f-889a-d3d1557761c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6463870052814c80879322b64ede27ba'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:31.464531 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a68df191-31c7-4a0f-889a-d3d1557761c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6463870052814c80879322b64ede27ba'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:31.478199 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1173/2325] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:13:31 2022] DELETE /identity/v3/users/6463870052814c80879322b64ede27ba => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:13:31.760460 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bb2bc-e447-404e-8b51-e7a3eaf6fc2c admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:31.762083 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-389bb2bc-e447-404e-8b51-e7a3eaf6fc2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:31.776444 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bb2bc-e447-404e-8b51-e7a3eaf6fc2c admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:31.836386 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e631f3-51bb-4ea0-a0c1-e408a9bc8919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:31.837333 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e631f3-51bb-4ea0-a0c1-e408a9bc8919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:31.837624 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e631f3-51bb-4ea0-a0c1-e408a9bc8919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:31.837909 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e631f3-51bb-4ea0-a0c1-e408a9bc8919 admin admin] PATH_INFO: `/v3/projects/bb4d9b8d4d6b443a98ad056a858662bd` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:31.839132 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e631f3-51bb-4ea0-a0c1-e408a9bc8919 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb4d9b8d4d6b443a98ad056a858662bd)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:31.841127 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e631f3-51bb-4ea0-a0c1-e408a9bc8919 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:31.853012 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:31.890835 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-50e631f3-51bb-4ea0-a0c1-e408a9bc8919 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb4d9b8d4d6b443a98ad056a858662bd', 'request_id': 'req-50e631f3-51bb-4ea0-a0c1-e408a9bc8919'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:31.896447 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-50e631f3-51bb-4ea0-a0c1-e408a9bc8919 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb4d9b8d4d6b443a98ad056a858662bd', 'request_id': 'req-50e631f3-51bb-4ea0-a0c1-e408a9bc8919'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:31.902974 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-50e631f3-51bb-4ea0-a0c1-e408a9bc8919 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb4d9b8d4d6b443a98ad056a858662bd', 'request_id': 'req-50e631f3-51bb-4ea0-a0c1-e408a9bc8919'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:31.917539 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-50e631f3-51bb-4ea0-a0c1-e408a9bc8919 admin admin] The token cache is being invalidate because project bb4d9b8d4d6b443a98ad056a858662bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:13:31.918007 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-50e631f3-51bb-4ea0-a0c1-e408a9bc8919 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:31.918525 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-50e631f3-51bb-4ea0-a0c1-e408a9bc8919 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:31.920133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1153/2326] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:13:31 2022] DELETE /identity/v3/projects/bb4d9b8d4d6b443a98ad056a858662bd => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:13:32.703549 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68df191-31c7-4a0f-889a-d3d1557761c9 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:32.705358 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a68df191-31c7-4a0f-889a-d3d1557761c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:32.725949 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68df191-31c7-4a0f-889a-d3d1557761c9 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:32.782720 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:32.802948 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a468f-cf64-4af0-b853-e183d0d90f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:32.805259 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a468f-cf64-4af0-b853-e183d0d90f3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:32.805746 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a468f-cf64-4af0-b853-e183d0d90f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:32.806710 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a468f-cf64-4af0-b853-e183d0d90f3c admin admin] PATH_INFO: `/v3/users/2c8d7a7287604fd5a56d57c2595218e0` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:32.809413 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a468f-cf64-4af0-b853-e183d0d90f3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c8d7a7287604fd5a56d57c2595218e0)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:32.812136 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a468f-cf64-4af0-b853-e183d0d90f3c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:32.870748 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-040a468f-cf64-4af0-b853-e183d0d90f3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c8d7a7287604fd5a56d57c2595218e0'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:32.879263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-040a468f-cf64-4af0-b853-e183d0d90f3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c8d7a7287604fd5a56d57c2595218e0'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:32.886643 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-040a468f-cf64-4af0-b853-e183d0d90f3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c8d7a7287604fd5a56d57c2595218e0'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:32.902334 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-040a468f-cf64-4af0-b853-e183d0d90f3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c8d7a7287604fd5a56d57c2595218e0'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:32.903339 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-040a468f-cf64-4af0-b853-e183d0d90f3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c8d7a7287604fd5a56d57c2595218e0'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:32.922363 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1174/2327] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:13:32 2022] DELETE /identity/v3/users/2c8d7a7287604fd5a56d57c2595218e0 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:13:32.926032 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b241afb-eb1c-486b-8b37-5b3822bebb1b None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:32.927045 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b241afb-eb1c-486b-8b37-5b3822bebb1b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:32.927338 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b241afb-eb1c-486b-8b37-5b3822bebb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:32.946875 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-4b241afb-eb1c-486b-8b37-5b3822bebb1b None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:13:32.948226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4b241afb-eb1c-486b-8b37-5b3822bebb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:33.010177 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1154/2328] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:13:33.020079 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a468f-cf64-4af0-b853-e183d0d90f3c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:33.021634 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-040a468f-cf64-4af0-b853-e183d0d90f3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:33.098127 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a468f-cf64-4af0-b853-e183d0d90f3c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:33.102990 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f18116-8425-4e4c-9fcc-93ecaad40d48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:33.103688 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f18116-8425-4e4c-9fcc-93ecaad40d48 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:33.103951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f18116-8425-4e4c-9fcc-93ecaad40d48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:33.104231 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f18116-8425-4e4c-9fcc-93ecaad40d48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:33.115205 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f18116-8425-4e4c-9fcc-93ecaad40d48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:33.116708 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f18116-8425-4e4c-9fcc-93ecaad40d48 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:33.126969 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1175/2329] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:13:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:13:33.638872 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b241afb-eb1c-486b-8b37-5b3822bebb1b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:33.640472 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4b241afb-eb1c-486b-8b37-5b3822bebb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:33.653970 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b241afb-eb1c-486b-8b37-5b3822bebb1b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:33.658908 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc4f73-3523-49e7-9c24-c58496a4785e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:33.659788 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc4f73-3523-49e7-9c24-c58496a4785e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:33.660073 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc4f73-3523-49e7-9c24-c58496a4785e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:33.660348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc4f73-3523-49e7-9c24-c58496a4785e admin admin] PATH_INFO: `/v3/projects/8a25e660b1ba4ba683f3e10c2e4a0c5a` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:33.661540 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfc4f73-3523-49e7-9c24-c58496a4785e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a25e660b1ba4ba683f3e10c2e4a0c5a)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:33.663538 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfc4f73-3523-49e7-9c24-c58496a4785e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:33.715056 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8cfc4f73-3523-49e7-9c24-c58496a4785e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a25e660b1ba4ba683f3e10c2e4a0c5a', 'request_id': 'req-8cfc4f73-3523-49e7-9c24-c58496a4785e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:33.720498 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8cfc4f73-3523-49e7-9c24-c58496a4785e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a25e660b1ba4ba683f3e10c2e4a0c5a', 'request_id': 'req-8cfc4f73-3523-49e7-9c24-c58496a4785e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:33.726815 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8cfc4f73-3523-49e7-9c24-c58496a4785e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a25e660b1ba4ba683f3e10c2e4a0c5a', 'request_id': 'req-8cfc4f73-3523-49e7-9c24-c58496a4785e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:33.741553 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8cfc4f73-3523-49e7-9c24-c58496a4785e admin admin] The token cache is being invalidate because project 8a25e660b1ba4ba683f3e10c2e4a0c5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:13:33.741897 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8cfc4f73-3523-49e7-9c24-c58496a4785e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:33.742541 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8cfc4f73-3523-49e7-9c24-c58496a4785e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:33.744577 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1155/2330] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:13:33 2022] DELETE /identity/v3/projects/8a25e660b1ba4ba683f3e10c2e4a0c5a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:13:33.748611 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f18116-8425-4e4c-9fcc-93ecaad40d48 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:33.762306 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f18116-8425-4e4c-9fcc-93ecaad40d48 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:33.824313 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd2b12-5d94-426a-bdee-252d494a7061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:33.825359 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd2b12-5d94-426a-bdee-252d494a7061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:33.825679 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd2b12-5d94-426a-bdee-252d494a7061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:33.825948 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd2b12-5d94-426a-bdee-252d494a7061 admin admin] PATH_INFO: `/v3/users/b0d8ee70b50842578c638c15dcb49e79` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:33.827189 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd2b12-5d94-426a-bdee-252d494a7061 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0d8ee70b50842578c638c15dcb49e79)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:33.829428 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd2b12-5d94-426a-bdee-252d494a7061 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:33.851386 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:33.868843 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6e70e-dd5e-4880-97ac-b99d0c675930 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:33.869194 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6e70e-dd5e-4880-97ac-b99d0c675930 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:33.869422 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6e70e-dd5e-4880-97ac-b99d0c675930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:33.895406 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3fbd2b12-5d94-426a-bdee-252d494a7061 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0d8ee70b50842578c638c15dcb49e79'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:33.905116 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3fbd2b12-5d94-426a-bdee-252d494a7061 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0d8ee70b50842578c638c15dcb49e79'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:33.906059 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-0fd6e70e-dd5e-4880-97ac-b99d0c675930 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:13:33.906193 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3fbd2b12-5d94-426a-bdee-252d494a7061 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0d8ee70b50842578c638c15dcb49e79'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:33.907825 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0fd6e70e-dd5e-4880-97ac-b99d0c675930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:33.920135 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1156/2331] 10.222.0.43 () {58 vars in 1016 bytes} [Mon Jul 4 04:13:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:13:33.922389 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3fbd2b12-5d94-426a-bdee-252d494a7061 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0d8ee70b50842578c638c15dcb49e79'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:33.923208 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3fbd2b12-5d94-426a-bdee-252d494a7061 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0d8ee70b50842578c638c15dcb49e79'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:33.941837 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1176/2332] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:13:33 2022] DELETE /identity/v3/users/b0d8ee70b50842578c638c15dcb49e79 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:13:33.951577 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6e70e-dd5e-4880-97ac-b99d0c675930 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:33.953806 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0fd6e70e-dd5e-4880-97ac-b99d0c675930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:33.975613 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:34.092931 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6e70e-dd5e-4880-97ac-b99d0c675930 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:34.208614 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3447a0-f04f-4d76-9ead-f80199e84c3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:34.209364 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3447a0-f04f-4d76-9ead-f80199e84c3b service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:34.209655 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3447a0-f04f-4d76-9ead-f80199e84c3b service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:34.209991 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3447a0-f04f-4d76-9ead-f80199e84c3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:34.212357 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ba3447a0-f04f-4d76-9ead-f80199e84c3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:34.299893 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3447a0-f04f-4d76-9ead-f80199e84c3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:34.300328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3447a0-f04f-4d76-9ead-f80199e84c3b service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:34.317124 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1157/2333] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:13:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:13:34.321195 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd2b12-5d94-426a-bdee-252d494a7061 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:34.322629 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3fbd2b12-5d94-426a-bdee-252d494a7061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:34.342246 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd2b12-5d94-426a-bdee-252d494a7061 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:34.347594 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413c382-44ab-414f-ae26-35e67a627f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:34.350428 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413c382-44ab-414f-ae26-35e67a627f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:34.350428 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413c382-44ab-414f-ae26-35e67a627f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:34.350428 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413c382-44ab-414f-ae26-35e67a627f27 admin admin] PATH_INFO: `/v3/projects/81a76c539c6a400ba65d9ae4be858e2e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:34.351416 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413c382-44ab-414f-ae26-35e67a627f27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81a76c539c6a400ba65d9ae4be858e2e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:34.356098 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413c382-44ab-414f-ae26-35e67a627f27 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:34.441127 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3413c382-44ab-414f-ae26-35e67a627f27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81a76c539c6a400ba65d9ae4be858e2e', 'request_id': 'req-3413c382-44ab-414f-ae26-35e67a627f27'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:34.449099 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3413c382-44ab-414f-ae26-35e67a627f27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81a76c539c6a400ba65d9ae4be858e2e', 'request_id': 'req-3413c382-44ab-414f-ae26-35e67a627f27'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:34.456676 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3413c382-44ab-414f-ae26-35e67a627f27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81a76c539c6a400ba65d9ae4be858e2e', 'request_id': 'req-3413c382-44ab-414f-ae26-35e67a627f27'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:34.475348 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3413c382-44ab-414f-ae26-35e67a627f27 admin admin] The token cache is being invalidate because project 81a76c539c6a400ba65d9ae4be858e2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:13:34.475847 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3413c382-44ab-414f-ae26-35e67a627f27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:34.476728 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3413c382-44ab-414f-ae26-35e67a627f27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:34.479033 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1177/2334] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:13:34 2022] DELETE /identity/v3/projects/81a76c539c6a400ba65d9ae4be858e2e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:13:34.484362 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a81809-bee5-4d74-bb51-89b1cf14e298 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:34.484894 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a81809-bee5-4d74-bb51-89b1cf14e298 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:34.485388 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a81809-bee5-4d74-bb51-89b1cf14e298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:34.507719 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-74a81809-bee5-4d74-bb51-89b1cf14e298 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:13:34.509264 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-74a81809-bee5-4d74-bb51-89b1cf14e298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:34.559333 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:34.597471 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1158/2335] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:13:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:13:34.605647 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce10748-667a-4fd5-b57b-b34d216fbc8a None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:34.605940 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce10748-667a-4fd5-b57b-b34d216fbc8a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:34.607554 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce10748-667a-4fd5-b57b-b34d216fbc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:34.643345 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-4ce10748-667a-4fd5-b57b-b34d216fbc8a None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:13:34.644691 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4ce10748-667a-4fd5-b57b-b34d216fbc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:34.654279 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1178/2336] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:13:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:13:34.658056 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a81809-bee5-4d74-bb51-89b1cf14e298 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:34.676512 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a81809-bee5-4d74-bb51-89b1cf14e298 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:34.681926 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68a90a-53aa-4397-8fea-0da58b56b6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:34.682815 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68a90a-53aa-4397-8fea-0da58b56b6dc admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:34.683175 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68a90a-53aa-4397-8fea-0da58b56b6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:34.683569 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68a90a-53aa-4397-8fea-0da58b56b6dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:34.684419 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68a90a-53aa-4397-8fea-0da58b56b6dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:13:34.684846 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68a90a-53aa-4397-8fea-0da58b56b6dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:34.686660 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68a90a-53aa-4397-8fea-0da58b56b6dc admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:34.704157 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1159/2337] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:13:34.705010 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce10748-667a-4fd5-b57b-b34d216fbc8a None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:34.715247 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce10748-667a-4fd5-b57b-b34d216fbc8a None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:34.720009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41f4aa-d3a7-4fae-b0eb-168d47e1eefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:34.720677 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41f4aa-d3a7-4fae-b0eb-168d47e1eefd admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:34.720969 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41f4aa-d3a7-4fae-b0eb-168d47e1eefd admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:34.721250 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41f4aa-d3a7-4fae-b0eb-168d47e1eefd admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:34.721967 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41f4aa-d3a7-4fae-b0eb-168d47e1eefd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:34.723965 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41f4aa-d3a7-4fae-b0eb-168d47e1eefd admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:34.756559 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1179/2338] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:13:34 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 04:13:34.762634 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68a90a-53aa-4397-8fea-0da58b56b6dc admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:34.800035 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68a90a-53aa-4397-8fea-0da58b56b6dc admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:34.877775 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e5816-8085-480a-8935-24e451e17e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:34.879009 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e5816-8085-480a-8935-24e451e17e2f admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:34.879009 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e5816-8085-480a-8935-24e451e17e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:34.879245 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e5816-8085-480a-8935-24e451e17e2f admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:34.879984 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e5816-8085-480a-8935-24e451e17e2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:34.883057 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e5816-8085-480a-8935-24e451e17e2f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:34.912944 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1160/2339] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:13:34 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:13:34.917428 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41f4aa-d3a7-4fae-b0eb-168d47e1eefd admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:34.928968 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41f4aa-d3a7-4fae-b0eb-168d47e1eefd admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:34.934363 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b2b61-c20f-47d4-832b-36b6b8080bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:34.935412 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b2b61-c20f-47d4-832b-36b6b8080bec admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:34.935412 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b2b61-c20f-47d4-832b-36b6b8080bec admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:34.935643 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b2b61-c20f-47d4-832b-36b6b8080bec admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:34.936331 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b2b61-c20f-47d4-832b-36b6b8080bec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:34.938046 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b2b61-c20f-47d4-832b-36b6b8080bec admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:34.949626 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1180/2340] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:13:34.954343 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e5816-8085-480a-8935-24e451e17e2f admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:34.967093 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e5816-8085-480a-8935-24e451e17e2f admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:34.977156 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba4c23-a24e-4865-b4e6-ec87e9dbf4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:34.977902 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba4c23-a24e-4865-b4e6-ec87e9dbf4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:34.978249 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba4c23-a24e-4865-b4e6-ec87e9dbf4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:34.978516 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba4c23-a24e-4865-b4e6-ec87e9dbf4c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:34.979275 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba4c23-a24e-4865-b4e6-ec87e9dbf4c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:34.980956 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba4c23-a24e-4865-b4e6-ec87e9dbf4c7 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:35.002758 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1161/2341] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:13:35.004109 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b2b61-c20f-47d4-832b-36b6b8080bec admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:35.017613 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b2b61-c20f-47d4-832b-36b6b8080bec admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:35.023667 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b8b9b-080e-449a-ab98-6c3c0762d907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:35.024762 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b8b9b-080e-449a-ab98-6c3c0762d907 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:35.025052 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b8b9b-080e-449a-ab98-6c3c0762d907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:35.025370 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b8b9b-080e-449a-ab98-6c3c0762d907 admin admin] PATH_INFO: `/v3/projects/1d97aebbca814ebbbd27140de0037e58/users/b30595e482f24e5489f76b6977f40c4b/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:35.048715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b8b9b-080e-449a-ab98-6c3c0762d907 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d97aebbca814ebbbd27140de0037e58, user_id=b30595e482f24e5489f76b6977f40c4b, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:35.052511 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b8b9b-080e-449a-ab98-6c3c0762d907 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:35.074609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1181/2342] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:13:35 2022] PUT /identity/v3/projects/1d97aebbca814ebbbd27140de0037e58/users/b30595e482f24e5489f76b6977f40c4b/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:13:35.088548 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ffe0b8-2676-4570-bc22-536a3d3f06e2 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:35.089073 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ffe0b8-2676-4570-bc22-536a3d3f06e2 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:35.089875 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ffe0b8-2676-4570-bc22-536a3d3f06e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:35.139009 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-64ffe0b8-2676-4570-bc22-536a3d3f06e2 None None] MFA Rules not processed for user `b30595e482f24e5489f76b6977f40c4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:13:35.140526 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-64ffe0b8-2676-4570-bc22-536a3d3f06e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:35.236475 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1162/2343] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:13:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:13:35.248594 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b8b9b-080e-449a-ab98-6c3c0762d907 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:35.270382 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:DELETE=15,keystone:SELECT=81,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:35.325049 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b8b9b-080e-449a-ab98-6c3c0762d907 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:35.330093 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf262b22-f27a-48a2-9f9e-59173159a766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:35.330834 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf262b22-f27a-48a2-9f9e-59173159a766 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:35.331270 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf262b22-f27a-48a2-9f9e-59173159a766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:35.331438 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf262b22-f27a-48a2-9f9e-59173159a766 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:35.332328 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf262b22-f27a-48a2-9f9e-59173159a766 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:35.334307 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf262b22-f27a-48a2-9f9e-59173159a766 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:35.376278 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1182/2344] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:13:35 2022] POST /identity/v3/projects => generated 387 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:13:35.378320 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ffe0b8-2676-4570-bc22-536a3d3f06e2 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:35.391248 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ffe0b8-2676-4570-bc22-536a3d3f06e2 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:35.426282 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:35.452915 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80feb8f-db11-418b-8359-9056a89b9563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:35.453608 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80feb8f-db11-418b-8359-9056a89b9563 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:35.453898 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80feb8f-db11-418b-8359-9056a89b9563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:35.454198 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80feb8f-db11-418b-8359-9056a89b9563 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:35.454904 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80feb8f-db11-418b-8359-9056a89b9563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:35.456873 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80feb8f-db11-418b-8359-9056a89b9563 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:35.481939 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1163/2345] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:13:35 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:13:35.483513 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf262b22-f27a-48a2-9f9e-59173159a766 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:35.495036 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf262b22-f27a-48a2-9f9e-59173159a766 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:35.499924 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15dbe5-f306-4cff-9226-9098b74c4028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:35.500613 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15dbe5-f306-4cff-9226-9098b74c4028 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:35.500897 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15dbe5-f306-4cff-9226-9098b74c4028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:35.501174 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15dbe5-f306-4cff-9226-9098b74c4028 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:35.501918 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e15dbe5-f306-4cff-9226-9098b74c4028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:35.503735 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e15dbe5-f306-4cff-9226-9098b74c4028 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:35.518089 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1183/2346] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:13:35.522500 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80feb8f-db11-418b-8359-9056a89b9563 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:35.534096 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80feb8f-db11-418b-8359-9056a89b9563 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:35.539213 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0a85c-d30a-4c7a-a336-c5f50045fddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:35.540099 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0a85c-d30a-4c7a-a336-c5f50045fddb admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:35.540394 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0a85c-d30a-4c7a-a336-c5f50045fddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:35.540677 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0a85c-d30a-4c7a-a336-c5f50045fddb admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:35.541427 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0a85c-d30a-4c7a-a336-c5f50045fddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:35.543126 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0a85c-d30a-4c7a-a336-c5f50045fddb admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:35.554009 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1164/2347] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:13:35.558396 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15dbe5-f306-4cff-9226-9098b74c4028 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:35.569322 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15dbe5-f306-4cff-9226-9098b74c4028 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:35.574292 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daeee77-27cf-4686-9674-72303d7b330c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:35.575216 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daeee77-27cf-4686-9674-72303d7b330c admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:35.575515 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daeee77-27cf-4686-9674-72303d7b330c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:35.575909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daeee77-27cf-4686-9674-72303d7b330c admin admin] PATH_INFO: `/v3/projects/318ecd2a0dc448ab982c918ee2a8e201/users/9af3e95babc848959e56c0927f7a7336/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:35.593220 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daeee77-27cf-4686-9674-72303d7b330c admin admin] RBAC: Authorizing `identity:create_grant(project_id=318ecd2a0dc448ab982c918ee2a8e201, user_id=9af3e95babc848959e56c0927f7a7336, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:35.596008 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daeee77-27cf-4686-9674-72303d7b330c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:35.612275 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1184/2348] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:13:35 2022] PUT /identity/v3/projects/318ecd2a0dc448ab982c918ee2a8e201/users/9af3e95babc848959e56c0927f7a7336/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 04:13:35.624984 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0d929-e854-4686-acce-9a4202ef86ec None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:35.625375 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0d929-e854-4686-acce-9a4202ef86ec None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:35.625731 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0d929-e854-4686-acce-9a4202ef86ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:35.653711 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-ccf0d929-e854-4686-acce-9a4202ef86ec None None] MFA Rules not processed for user `9af3e95babc848959e56c0927f7a7336`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:13:35.654979 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ccf0d929-e854-4686-acce-9a4202ef86ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:35.722940 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1165/2349] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:13:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:13:35.727496 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daeee77-27cf-4686-9674-72303d7b330c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:35.790807 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daeee77-27cf-4686-9674-72303d7b330c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:35.796035 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ef31f-49ad-4ffd-ad03-ad5efa3d3335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:35.796485 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ef31f-49ad-4ffd-ad03-ad5efa3d3335 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:35.796773 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ef31f-49ad-4ffd-ad03-ad5efa3d3335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:35.797054 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ef31f-49ad-4ffd-ad03-ad5efa3d3335 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:35.797760 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ef31f-49ad-4ffd-ad03-ad5efa3d3335 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:35.799707 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ef31f-49ad-4ffd-ad03-ad5efa3d3335 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:35.826425 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1185/2350] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:13:35 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:13:35.830556 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0d929-e854-4686-acce-9a4202ef86ec None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:35.841545 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0d929-e854-4686-acce-9a4202ef86ec None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:35.901501 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19744b4-0a68-487c-b6ee-7583e97acf6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:35.902225 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19744b4-0a68-487c-b6ee-7583e97acf6d admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:35.902517 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19744b4-0a68-487c-b6ee-7583e97acf6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:35.902801 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19744b4-0a68-487c-b6ee-7583e97acf6d admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:35.903527 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19744b4-0a68-487c-b6ee-7583e97acf6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:35.905479 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19744b4-0a68-487c-b6ee-7583e97acf6d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:35.930813 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1166/2351] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:13:35 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:13:35.931799 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ef31f-49ad-4ffd-ad03-ad5efa3d3335 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:35.943389 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ef31f-49ad-4ffd-ad03-ad5efa3d3335 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:35.948881 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27642d1b-86d3-40ad-ad72-58288726cadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:35.949640 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27642d1b-86d3-40ad-ad72-58288726cadc admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:35.950000 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27642d1b-86d3-40ad-ad72-58288726cadc admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:35.950390 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27642d1b-86d3-40ad-ad72-58288726cadc admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:35.951252 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27642d1b-86d3-40ad-ad72-58288726cadc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:35.952975 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27642d1b-86d3-40ad-ad72-58288726cadc admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:35.965473 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1186/2352] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:13:35.969660 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19744b4-0a68-487c-b6ee-7583e97acf6d admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:35.982587 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19744b4-0a68-487c-b6ee-7583e97acf6d admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:35.988121 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aece692-651f-45d6-8a9d-3441b6c6bf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:35.989356 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aece692-651f-45d6-8a9d-3441b6c6bf6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:35.989646 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aece692-651f-45d6-8a9d-3441b6c6bf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:35.989928 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aece692-651f-45d6-8a9d-3441b6c6bf6c admin admin] PATH_INFO: `/v3/projects/41170c2e18f54b13bbd460dcb712e57e/users/4986848b580649e290261f67d4e59700/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:36.007365 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aece692-651f-45d6-8a9d-3441b6c6bf6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=41170c2e18f54b13bbd460dcb712e57e, user_id=4986848b580649e290261f67d4e59700, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:36.010124 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aece692-651f-45d6-8a9d-3441b6c6bf6c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:36.024472 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1167/2353] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:13:35 2022] PUT /identity/v3/projects/41170c2e18f54b13bbd460dcb712e57e/users/4986848b580649e290261f67d4e59700/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:13:36.028557 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27642d1b-86d3-40ad-ad72-58288726cadc admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:36.039062 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27642d1b-86d3-40ad-ad72-58288726cadc admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:36.079398 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:36.099271 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3839286-d8e5-427e-a5da-f04576ef2b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:36.099947 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3839286-d8e5-427e-a5da-f04576ef2b3b admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:36.100237 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3839286-d8e5-427e-a5da-f04576ef2b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:36.100521 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3839286-d8e5-427e-a5da-f04576ef2b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:36.101261 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3839286-d8e5-427e-a5da-f04576ef2b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:36.103091 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3839286-d8e5-427e-a5da-f04576ef2b3b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:36.112811 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1187/2354] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:13:36.117324 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aece692-651f-45d6-8a9d-3441b6c6bf6c admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:36.128296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aece692-651f-45d6-8a9d-3441b6c6bf6c admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:36.134109 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3afa1-52e3-4eb3-9a89-8a4c198e1fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:36.135151 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3afa1-52e3-4eb3-9a89-8a4c198e1fc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:36.135437 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3afa1-52e3-4eb3-9a89-8a4c198e1fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:36.135720 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3afa1-52e3-4eb3-9a89-8a4c198e1fc6 admin admin] PATH_INFO: `/v3/projects/41170c2e18f54b13bbd460dcb712e57e/users/4986848b580649e290261f67d4e59700/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:36.137815 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3afa1-52e3-4eb3-9a89-8a4c198e1fc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41170c2e18f54b13bbd460dcb712e57e, user_id=4986848b580649e290261f67d4e59700, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:36.140551 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3afa1-52e3-4eb3-9a89-8a4c198e1fc6 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:36.143876 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:36.153619 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1168/2355] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:13:36 2022] PUT /identity/v3/projects/41170c2e18f54b13bbd460dcb712e57e/users/4986848b580649e290261f67d4e59700/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:13:36.165079 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0eaea7-4135-4e70-9ad4-4ff10832cb6e None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:36.165404 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0eaea7-4135-4e70-9ad4-4ff10832cb6e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:36.165711 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0eaea7-4135-4e70-9ad4-4ff10832cb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:36.192833 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-dd0eaea7-4135-4e70-9ad4-4ff10832cb6e None None] MFA Rules not processed for user `4986848b580649e290261f67d4e59700`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:13:36.194056 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-dd0eaea7-4135-4e70-9ad4-4ff10832cb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:36.265305 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1188/2356] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:13:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:13:36.276592 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3afa1-52e3-4eb3-9a89-8a4c198e1fc6 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:36.278551 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3eb3afa1-52e3-4eb3-9a89-8a4c198e1fc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:36.337915 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3afa1-52e3-4eb3-9a89-8a4c198e1fc6 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:36.341967 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3008840-fd92-4c4f-8c99-273c9a4ec346 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:36.342698 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3008840-fd92-4c4f-8c99-273c9a4ec346 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:36.343005 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3008840-fd92-4c4f-8c99-273c9a4ec346 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:36.343283 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3008840-fd92-4c4f-8c99-273c9a4ec346 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:36.353521 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3008840-fd92-4c4f-8c99-273c9a4ec346 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:36.355034 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3008840-fd92-4c4f-8c99-273c9a4ec346 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:36.366233 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1169/2357] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:13:36 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:13:36.926999 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0eaea7-4135-4e70-9ad4-4ff10832cb6e None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:36.937113 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0eaea7-4135-4e70-9ad4-4ff10832cb6e None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:36.941159 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d8acd-849e-4575-9087-78737e874250 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:36.941800 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d8acd-849e-4575-9087-78737e874250 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:36.942085 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d8acd-849e-4575-9087-78737e874250 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:36.942394 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d8acd-849e-4575-9087-78737e874250 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:37.000705 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d8acd-849e-4575-9087-78737e874250 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:37.002196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d8acd-849e-4575-9087-78737e874250 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:37.011359 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1189/2358] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:13:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:13:38.997158 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a84bd-3a3f-4c4e-996e-acc814081fa0 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:38.997665 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a84bd-3a3f-4c4e-996e-acc814081fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:38.997753 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a84bd-3a3f-4c4e-996e-acc814081fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:39.017034 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-3f0a84bd-3a3f-4c4e-996e-acc814081fa0 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:13:39.018654 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3f0a84bd-3a3f-4c4e-996e-acc814081fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:39.079282 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1170/2359] 10.222.0.43 () {58 vars in 1016 bytes} [Mon Jul 4 04:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:13:39.123255 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d8acd-849e-4575-9087-78737e874250 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:39.124958 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-931d8acd-849e-4575-9087-78737e874250 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:39.187755 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:39.204465 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d8acd-849e-4575-9087-78737e874250 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:39.210479 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2aa413-427b-441b-83b7-94879359498e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:39.211074 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2aa413-427b-441b-83b7-94879359498e service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:39.211360 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2aa413-427b-441b-83b7-94879359498e service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:39.211668 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2aa413-427b-441b-83b7-94879359498e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:39.219856 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2aa413-427b-441b-83b7-94879359498e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:39.221465 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2aa413-427b-441b-83b7-94879359498e service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:39.230975 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1190/2360] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:13:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:13:41.044353 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a84bd-3a3f-4c4e-996e-acc814081fa0 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:41.055071 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a84bd-3a3f-4c4e-996e-acc814081fa0 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:41.059030 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2c66a-436a-4519-a54e-838da6e8654e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:41.059714 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2c66a-436a-4519-a54e-838da6e8654e service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:41.059998 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2c66a-436a-4519-a54e-838da6e8654e service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:41.060277 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2c66a-436a-4519-a54e-838da6e8654e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:41.118755 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e2c66a-436a-4519-a54e-838da6e8654e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:41.120234 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e2c66a-436a-4519-a54e-838da6e8654e service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:41.129492 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1171/2361] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:13:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:13:42.748655 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2aa413-427b-441b-83b7-94879359498e service nova] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:42.750106 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-8d2aa413-427b-441b-83b7-94879359498e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:42.818248 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2aa413-427b-441b-83b7-94879359498e service nova] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:42.822907 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143d17f-45c4-4844-8839-34815fd685e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:42.823860 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143d17f-45c4-4844-8839-34815fd685e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:42.824364 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143d17f-45c4-4844-8839-34815fd685e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:42.824882 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143d17f-45c4-4844-8839-34815fd685e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:42.827942 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7143d17f-45c4-4844-8839-34815fd685e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:42.892555 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7143d17f-45c4-4844-8839-34815fd685e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:42.894002 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7143d17f-45c4-4844-8839-34815fd685e1 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:42.903860 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1191/2362] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:13:42 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:13:43.231575 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2c66a-436a-4519-a54e-838da6e8654e service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:43.246026 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2c66a-436a-4519-a54e-838da6e8654e service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:43.250819 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1795e42-b5a9-44b5-b103-fcccf125e023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:43.251832 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1795e42-b5a9-44b5-b103-fcccf125e023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:43.252183 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1795e42-b5a9-44b5-b103-fcccf125e023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:43.252536 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1795e42-b5a9-44b5-b103-fcccf125e023 admin admin] PATH_INFO: `/v3/users/b30595e482f24e5489f76b6977f40c4b` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:43.253822 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1795e42-b5a9-44b5-b103-fcccf125e023 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b30595e482f24e5489f76b6977f40c4b)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:43.256023 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1795e42-b5a9-44b5-b103-fcccf125e023 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:43.301431 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:43.320992 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d1795e42-b5a9-44b5-b103-fcccf125e023 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b30595e482f24e5489f76b6977f40c4b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:43.322141 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d1795e42-b5a9-44b5-b103-fcccf125e023 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b30595e482f24e5489f76b6977f40c4b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:43.331739 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d1795e42-b5a9-44b5-b103-fcccf125e023 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b30595e482f24e5489f76b6977f40c4b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:43.347480 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d1795e42-b5a9-44b5-b103-fcccf125e023 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b30595e482f24e5489f76b6977f40c4b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:43.348223 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d1795e42-b5a9-44b5-b103-fcccf125e023 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b30595e482f24e5489f76b6977f40c4b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:43.361949 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1172/2363] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:13:43 2022] DELETE /identity/v3/users/b30595e482f24e5489f76b6977f40c4b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:13:43.371774 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fda35d-38b1-412b-b082-c3e9efa7eabc None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:43.372317 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fda35d-38b1-412b-b082-c3e9efa7eabc None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:43.372618 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fda35d-38b1-412b-b082-c3e9efa7eabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:43.395262 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-e9fda35d-38b1-412b-b082-c3e9efa7eabc None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:13:43.396500 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e9fda35d-38b1-412b-b082-c3e9efa7eabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:43.457993 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1192/2364] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:13:43.467736 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1795e42-b5a9-44b5-b103-fcccf125e023 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:43.469171 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d1795e42-b5a9-44b5-b103-fcccf125e023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:43.531669 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1795e42-b5a9-44b5-b103-fcccf125e023 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:43.535442 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e83a1a-a59a-4d81-8d55-1ad07c81a8c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:43.536104 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e83a1a-a59a-4d81-8d55-1ad07c81a8c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:43.536390 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e83a1a-a59a-4d81-8d55-1ad07c81a8c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:43.536670 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e83a1a-a59a-4d81-8d55-1ad07c81a8c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:43.548635 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e83a1a-a59a-4d81-8d55-1ad07c81a8c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:43.550334 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e83a1a-a59a-4d81-8d55-1ad07c81a8c6 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:43.561033 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1173/2365] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:13:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:13:44.012264 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fda35d-38b1-412b-b082-c3e9efa7eabc None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:44.013837 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e9fda35d-38b1-412b-b082-c3e9efa7eabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:44.026919 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fda35d-38b1-412b-b082-c3e9efa7eabc None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:44.046937 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6c56c-f262-4a08-85a4-2f999630e211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:44.048287 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6c56c-f262-4a08-85a4-2f999630e211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:44.048500 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6c56c-f262-4a08-85a4-2f999630e211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:44.048780 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6c56c-f262-4a08-85a4-2f999630e211 admin admin] PATH_INFO: `/v3/projects/1d97aebbca814ebbbd27140de0037e58` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:44.050925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f6c56c-f262-4a08-85a4-2f999630e211 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d97aebbca814ebbbd27140de0037e58)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:44.052996 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f6c56c-f262-4a08-85a4-2f999630e211 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:44.090551 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:44.104599 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-98f6c56c-f262-4a08-85a4-2f999630e211 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d97aebbca814ebbbd27140de0037e58', 'request_id': 'req-98f6c56c-f262-4a08-85a4-2f999630e211'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:44.110820 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-98f6c56c-f262-4a08-85a4-2f999630e211 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d97aebbca814ebbbd27140de0037e58', 'request_id': 'req-98f6c56c-f262-4a08-85a4-2f999630e211'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:44.116885 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-98f6c56c-f262-4a08-85a4-2f999630e211 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d97aebbca814ebbbd27140de0037e58', 'request_id': 'req-98f6c56c-f262-4a08-85a4-2f999630e211'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:44.130099 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-98f6c56c-f262-4a08-85a4-2f999630e211 admin admin] The token cache is being invalidate because project 1d97aebbca814ebbbd27140de0037e58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:13:44.130412 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-98f6c56c-f262-4a08-85a4-2f999630e211 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:44.131004 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-98f6c56c-f262-4a08-85a4-2f999630e211 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:44.132563 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1193/2366] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:13:44 2022] DELETE /identity/v3/projects/1d97aebbca814ebbbd27140de0037e58 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:13:44.136961 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e83a1a-a59a-4d81-8d55-1ad07c81a8c6 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:44.148836 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e83a1a-a59a-4d81-8d55-1ad07c81a8c6 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:44.211331 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbd43a-5ae6-4427-8403-61e729dee629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:44.212421 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbd43a-5ae6-4427-8403-61e729dee629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:44.212661 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbd43a-5ae6-4427-8403-61e729dee629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:44.212948 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbd43a-5ae6-4427-8403-61e729dee629 admin admin] PATH_INFO: `/v3/users/9af3e95babc848959e56c0927f7a7336` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:44.214502 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbd43a-5ae6-4427-8403-61e729dee629 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9af3e95babc848959e56c0927f7a7336)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:44.217565 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbd43a-5ae6-4427-8403-61e729dee629 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:44.276595 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a9bbd43a-5ae6-4427-8403-61e729dee629 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9af3e95babc848959e56c0927f7a7336'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:44.277668 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a9bbd43a-5ae6-4427-8403-61e729dee629 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9af3e95babc848959e56c0927f7a7336'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:44.286359 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a9bbd43a-5ae6-4427-8403-61e729dee629 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9af3e95babc848959e56c0927f7a7336'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:44.287594 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:44.301567 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a9bbd43a-5ae6-4427-8403-61e729dee629 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9af3e95babc848959e56c0927f7a7336'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:44.302338 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a9bbd43a-5ae6-4427-8403-61e729dee629 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9af3e95babc848959e56c0927f7a7336'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:44.315421 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1174/2367] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:13:44 2022] DELETE /identity/v3/users/9af3e95babc848959e56c0927f7a7336 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:13:44.708807 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6c56c-f262-4a08-85a4-2f999630e211 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:44.710894 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-98f6c56c-f262-4a08-85a4-2f999630e211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:44.748577 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6c56c-f262-4a08-85a4-2f999630e211 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:44.834108 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db15a5-9ba2-40c6-8aa1-d1020192d997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:44.835015 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db15a5-9ba2-40c6-8aa1-d1020192d997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:44.835298 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db15a5-9ba2-40c6-8aa1-d1020192d997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:44.835573 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db15a5-9ba2-40c6-8aa1-d1020192d997 admin admin] PATH_INFO: `/v3/projects/318ecd2a0dc448ab982c918ee2a8e201` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:44.836844 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db15a5-9ba2-40c6-8aa1-d1020192d997 admin admin] RBAC: Authorizing `identity:delete_project(project_id=318ecd2a0dc448ab982c918ee2a8e201)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:44.838818 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db15a5-9ba2-40c6-8aa1-d1020192d997 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:44.892936 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-58db15a5-9ba2-40c6-8aa1-d1020192d997 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '318ecd2a0dc448ab982c918ee2a8e201', 'request_id': 'req-58db15a5-9ba2-40c6-8aa1-d1020192d997'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:44.899424 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-58db15a5-9ba2-40c6-8aa1-d1020192d997 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '318ecd2a0dc448ab982c918ee2a8e201', 'request_id': 'req-58db15a5-9ba2-40c6-8aa1-d1020192d997'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:44.906549 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-58db15a5-9ba2-40c6-8aa1-d1020192d997 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '318ecd2a0dc448ab982c918ee2a8e201', 'request_id': 'req-58db15a5-9ba2-40c6-8aa1-d1020192d997'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:44.920076 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-58db15a5-9ba2-40c6-8aa1-d1020192d997 admin admin] The token cache is being invalidate because project 318ecd2a0dc448ab982c918ee2a8e201 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:13:44.920370 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-58db15a5-9ba2-40c6-8aa1-d1020192d997 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:44.921019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-58db15a5-9ba2-40c6-8aa1-d1020192d997 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:44.922633 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1194/2368] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:13:44 2022] DELETE /identity/v3/projects/318ecd2a0dc448ab982c918ee2a8e201 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:13:44.926796 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbd43a-5ae6-4427-8403-61e729dee629 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:44.928438 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a9bbd43a-5ae6-4427-8403-61e729dee629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:44.942477 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbd43a-5ae6-4427-8403-61e729dee629 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:45.020533 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095d140-badb-45a8-a485-dbc01cd058e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:45.021443 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095d140-badb-45a8-a485-dbc01cd058e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:45.021733 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095d140-badb-45a8-a485-dbc01cd058e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:45.022015 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095d140-badb-45a8-a485-dbc01cd058e7 admin admin] PATH_INFO: `/v3/users/4986848b580649e290261f67d4e59700` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:45.023371 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095d140-badb-45a8-a485-dbc01cd058e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4986848b580649e290261f67d4e59700)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:45.025592 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095d140-badb-45a8-a485-dbc01cd058e7 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:45.084760 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-b095d140-badb-45a8-a485-dbc01cd058e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4986848b580649e290261f67d4e59700'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:45.085359 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-b095d140-badb-45a8-a485-dbc01cd058e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4986848b580649e290261f67d4e59700'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:45.094781 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-b095d140-badb-45a8-a485-dbc01cd058e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4986848b580649e290261f67d4e59700'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:45.109387 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-b095d140-badb-45a8-a485-dbc01cd058e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4986848b580649e290261f67d4e59700'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:45.110270 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-b095d140-badb-45a8-a485-dbc01cd058e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4986848b580649e290261f67d4e59700'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:45.126219 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1175/2369] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:13:44 2022] DELETE /identity/v3/users/4986848b580649e290261f67d4e59700 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:13:45.499897 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db15a5-9ba2-40c6-8aa1-d1020192d997 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:45.501826 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-58db15a5-9ba2-40c6-8aa1-d1020192d997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:45.518485 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db15a5-9ba2-40c6-8aa1-d1020192d997 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:45.566477 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:45.582959 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579fd57b-6490-4c59-ba48-2b11464e5741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:45.583936 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579fd57b-6490-4c59-ba48-2b11464e5741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:45.584297 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579fd57b-6490-4c59-ba48-2b11464e5741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:45.584636 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579fd57b-6490-4c59-ba48-2b11464e5741 admin admin] PATH_INFO: `/v3/projects/41170c2e18f54b13bbd460dcb712e57e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:45.585945 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579fd57b-6490-4c59-ba48-2b11464e5741 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41170c2e18f54b13bbd460dcb712e57e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:45.587996 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579fd57b-6490-4c59-ba48-2b11464e5741 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:45.638349 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-579fd57b-6490-4c59-ba48-2b11464e5741 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41170c2e18f54b13bbd460dcb712e57e', 'request_id': 'req-579fd57b-6490-4c59-ba48-2b11464e5741'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:45.647616 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-579fd57b-6490-4c59-ba48-2b11464e5741 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41170c2e18f54b13bbd460dcb712e57e', 'request_id': 'req-579fd57b-6490-4c59-ba48-2b11464e5741'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:45.655344 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-579fd57b-6490-4c59-ba48-2b11464e5741 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41170c2e18f54b13bbd460dcb712e57e', 'request_id': 'req-579fd57b-6490-4c59-ba48-2b11464e5741'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:45.670925 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-579fd57b-6490-4c59-ba48-2b11464e5741 admin admin] The token cache is being invalidate because project 41170c2e18f54b13bbd460dcb712e57e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:13:45.671198 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-579fd57b-6490-4c59-ba48-2b11464e5741 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:45.672120 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-579fd57b-6490-4c59-ba48-2b11464e5741 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:45.673707 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1195/2370] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:13:45 2022] DELETE /identity/v3/projects/41170c2e18f54b13bbd460dcb712e57e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:13:45.680912 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7e6ad-a1f3-40de-be7a-19cbe0dc503d None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:45.681406 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7e6ad-a1f3-40de-be7a-19cbe0dc503d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:45.681515 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7e6ad-a1f3-40de-be7a-19cbe0dc503d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:45.716864 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e9e7e6ad-a1f3-40de-be7a-19cbe0dc503d None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:13:45.718172 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e9e7e6ad-a1f3-40de-be7a-19cbe0dc503d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:45.777716 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:45.798477 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1176/2371] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:13:45.807193 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8422ae9-02b6-4813-8b40-f8aba92b4df0 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:45.807553 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8422ae9-02b6-4813-8b40-f8aba92b4df0 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:45.807897 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8422ae9-02b6-4813-8b40-f8aba92b4df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:45.828579 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-d8422ae9-02b6-4813-8b40-f8aba92b4df0 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:13:45.829852 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d8422ae9-02b6-4813-8b40-f8aba92b4df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:45.842800 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1196/2372] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:13:45.847935 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7e6ad-a1f3-40de-be7a-19cbe0dc503d None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:45.857945 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7e6ad-a1f3-40de-be7a-19cbe0dc503d None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:45.862665 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc270107-e1e9-44f1-848f-e6ae93dd8a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:45.863677 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc270107-e1e9-44f1-848f-e6ae93dd8a11 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:45.863975 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc270107-e1e9-44f1-848f-e6ae93dd8a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:45.864256 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc270107-e1e9-44f1-848f-e6ae93dd8a11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:45.865005 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc270107-e1e9-44f1-848f-e6ae93dd8a11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:13:45.865321 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc270107-e1e9-44f1-848f-e6ae93dd8a11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:45.866997 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc270107-e1e9-44f1-848f-e6ae93dd8a11 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:45.879728 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1177/2373] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:13:45.883947 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8422ae9-02b6-4813-8b40-f8aba92b4df0 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:45.893924 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8422ae9-02b6-4813-8b40-f8aba92b4df0 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:45.900510 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c662c785-40f7-4423-abb1-6e67b92396a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:45.901319 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662c785-40f7-4423-abb1-6e67b92396a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:45.901707 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662c785-40f7-4423-abb1-6e67b92396a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:45.902083 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662c785-40f7-4423-abb1-6e67b92396a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:45.902912 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c662c785-40f7-4423-abb1-6e67b92396a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:45.904948 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c662c785-40f7-4423-abb1-6e67b92396a1 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:45.934627 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1197/2374] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:13:45 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 04:13:45.938784 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc270107-e1e9-44f1-848f-e6ae93dd8a11 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:45.950021 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc270107-e1e9-44f1-848f-e6ae93dd8a11 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:46.024754 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a2ee7-5162-44cf-bee3-568ad5f0ae74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:46.025455 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a2ee7-5162-44cf-bee3-568ad5f0ae74 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:46.026139 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a2ee7-5162-44cf-bee3-568ad5f0ae74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:46.026303 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a2ee7-5162-44cf-bee3-568ad5f0ae74 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:46.026932 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002a2ee7-5162-44cf-bee3-568ad5f0ae74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:46.029063 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002a2ee7-5162-44cf-bee3-568ad5f0ae74 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:46.056697 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1178/2375] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:13:45 2022] POST /identity/v3/users => generated 291 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 04:13:46.058400 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c662c785-40f7-4423-abb1-6e67b92396a1 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:46.069047 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c662c785-40f7-4423-abb1-6e67b92396a1 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:46.078836 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca9258-36ab-4f9b-b7ab-becce14236a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:46.079603 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca9258-36ab-4f9b-b7ab-becce14236a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:46.079962 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca9258-36ab-4f9b-b7ab-becce14236a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:46.080316 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca9258-36ab-4f9b-b7ab-becce14236a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:46.081141 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca9258-36ab-4f9b-b7ab-becce14236a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:46.082901 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca9258-36ab-4f9b-b7ab-becce14236a1 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:46.094719 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1198/2376] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:13:46.098681 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a2ee7-5162-44cf-bee3-568ad5f0ae74 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:46.111995 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a2ee7-5162-44cf-bee3-568ad5f0ae74 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:46.118878 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21caa5ef-ec0b-45fe-b2c8-40acd80ba99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:46.119598 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21caa5ef-ec0b-45fe-b2c8-40acd80ba99e admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:46.119886 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21caa5ef-ec0b-45fe-b2c8-40acd80ba99e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:46.120167 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21caa5ef-ec0b-45fe-b2c8-40acd80ba99e admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:46.120913 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21caa5ef-ec0b-45fe-b2c8-40acd80ba99e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:46.122594 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21caa5ef-ec0b-45fe-b2c8-40acd80ba99e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:46.136409 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1179/2377] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 04:13:46.140687 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca9258-36ab-4f9b-b7ab-becce14236a1 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:46.153969 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca9258-36ab-4f9b-b7ab-becce14236a1 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:46.160111 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373420c3-fc7b-49aa-82e1-05586218e549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:46.161018 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373420c3-fc7b-49aa-82e1-05586218e549 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:46.161310 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373420c3-fc7b-49aa-82e1-05586218e549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:46.161727 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373420c3-fc7b-49aa-82e1-05586218e549 admin admin] PATH_INFO: `/v3/projects/3bf8176f950a48a18f5ecd5a4d20723e/users/4027eb384c08493fabaea9d1e079aee5/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:46.179200 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373420c3-fc7b-49aa-82e1-05586218e549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bf8176f950a48a18f5ecd5a4d20723e, user_id=4027eb384c08493fabaea9d1e079aee5, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:46.182422 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373420c3-fc7b-49aa-82e1-05586218e549 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:46.199002 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1199/2378] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:13:46 2022] PUT /identity/v3/projects/3bf8176f950a48a18f5ecd5a4d20723e/users/4027eb384c08493fabaea9d1e079aee5/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:13:46.210179 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafea99-7913-4f8c-9a6c-7fc4deec6da6 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:46.210480 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafea99-7913-4f8c-9a6c-7fc4deec6da6 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:46.210766 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafea99-7913-4f8c-9a6c-7fc4deec6da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:46.252313 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-0dafea99-7913-4f8c-9a6c-7fc4deec6da6 None None] MFA Rules not processed for user `4027eb384c08493fabaea9d1e079aee5`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:13:46.253571 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0dafea99-7913-4f8c-9a6c-7fc4deec6da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:46.318119 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1180/2379] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:13:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:13:46.323684 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373420c3-fc7b-49aa-82e1-05586218e549 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:46.389024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51420743-8c22-4f0a-a8d7-5140d5c248bc None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:46.389418 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51420743-8c22-4f0a-a8d7-5140d5c248bc None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:46.389836 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51420743-8c22-4f0a-a8d7-5140d5c248bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:46.390286 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373420c3-fc7b-49aa-82e1-05586218e549 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:46.395068 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a16d6ae-e5c1-4ee5-88ee-a2d76dba8395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:46.395727 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16d6ae-e5c1-4ee5-88ee-a2d76dba8395 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:46.396014 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16d6ae-e5c1-4ee5-88ee-a2d76dba8395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:46.396287 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16d6ae-e5c1-4ee5-88ee-a2d76dba8395 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:46.396979 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a16d6ae-e5c1-4ee5-88ee-a2d76dba8395 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:46.399009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a16d6ae-e5c1-4ee5-88ee-a2d76dba8395 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:46.408965 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-51420743-8c22-4f0a-a8d7-5140d5c248bc None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:13:46.410274 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-51420743-8c22-4f0a-a8d7-5140d5c248bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:46.419440 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:46.419617 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1181/2380] 10.222.0.43 () {58 vars in 1016 bytes} [Mon Jul 4 04:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:13:46.430018 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1200/2381] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:13:46 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:13:46.431082 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51420743-8c22-4f0a-a8d7-5140d5c248bc None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:46.441174 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51420743-8c22-4f0a-a8d7-5140d5c248bc None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:46.451508 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a16d6ae-e5c1-4ee5-88ee-a2d76dba8395 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:46.453580 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7a16d6ae-e5c1-4ee5-88ee-a2d76dba8395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:46.481574 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:46.501605 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e46dd-bd09-4578-8db4-f46c1ff90280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:46.502340 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e46dd-bd09-4578-8db4-f46c1ff90280 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:46.502619 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e46dd-bd09-4578-8db4-f46c1ff90280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:46.502897 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e46dd-bd09-4578-8db4-f46c1ff90280 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:46.503594 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e46dd-bd09-4578-8db4-f46c1ff90280 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:46.505533 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e46dd-bd09-4578-8db4-f46c1ff90280 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:46.526687 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1182/2382] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:13:46 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:13:46.530699 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e46dd-bd09-4578-8db4-f46c1ff90280 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:46.540493 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e46dd-bd09-4578-8db4-f46c1ff90280 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:46.545340 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a80f8-3e53-48be-a577-67bf69bfe620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:46.546003 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a80f8-3e53-48be-a577-67bf69bfe620 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:46.546452 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a80f8-3e53-48be-a577-67bf69bfe620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:46.546740 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a80f8-3e53-48be-a577-67bf69bfe620 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:46.547476 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a80f8-3e53-48be-a577-67bf69bfe620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:46.549196 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a80f8-3e53-48be-a577-67bf69bfe620 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:46.562601 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1183/2383] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 04:13:46.566526 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a80f8-3e53-48be-a577-67bf69bfe620 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:46.568774 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a16d6ae-e5c1-4ee5-88ee-a2d76dba8395 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:46.576290 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4458f58-2d6d-40a3-8368-989186de01b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:46.576957 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4458f58-2d6d-40a3-8368-989186de01b3 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:46.577248 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4458f58-2d6d-40a3-8368-989186de01b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:46.577534 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4458f58-2d6d-40a3-8368-989186de01b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:46.578010 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a80f8-3e53-48be-a577-67bf69bfe620 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:46.583413 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeede53-29f9-4869-b831-96f2a83e2b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:46.584292 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeede53-29f9-4869-b831-96f2a83e2b5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:46.584586 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeede53-29f9-4869-b831-96f2a83e2b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:46.584868 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeede53-29f9-4869-b831-96f2a83e2b5c admin admin] PATH_INFO: `/v3/projects/c2691a0d4ef4471a89fe87b5302ee781/users/5d809959c4f44106acfdd2f2f64978ae/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:46.586287 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4458f58-2d6d-40a3-8368-989186de01b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:46.587989 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4458f58-2d6d-40a3-8368-989186de01b3 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:46.597561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1201/2384] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:13:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:13:46.600299 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeede53-29f9-4869-b831-96f2a83e2b5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2691a0d4ef4471a89fe87b5302ee781, user_id=5d809959c4f44106acfdd2f2f64978ae, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:46.603159 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeede53-29f9-4869-b831-96f2a83e2b5c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:46.617816 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1184/2385] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:13:46 2022] PUT /identity/v3/projects/c2691a0d4ef4471a89fe87b5302ee781/users/5d809959c4f44106acfdd2f2f64978ae/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:13:46.622113 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4458f58-2d6d-40a3-8368-989186de01b3 service nova] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:46.635063 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4458f58-2d6d-40a3-8368-989186de01b3 service nova] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:46.692872 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32718ade-a4dd-4c2a-b64c-4a98a66e96c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:46.693542 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32718ade-a4dd-4c2a-b64c-4a98a66e96c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:46.693827 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32718ade-a4dd-4c2a-b64c-4a98a66e96c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:46.694108 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32718ade-a4dd-4c2a-b64c-4a98a66e96c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:46.694876 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32718ade-a4dd-4c2a-b64c-4a98a66e96c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:46.696583 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32718ade-a4dd-4c2a-b64c-4a98a66e96c3 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:46.706408 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1202/2386] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:13:46.710623 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeede53-29f9-4869-b831-96f2a83e2b5c admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:46.721225 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeede53-29f9-4869-b831-96f2a83e2b5c admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:46.726281 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7ea07-1693-4f20-94cc-4f484f2b11e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:46.727273 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7ea07-1693-4f20-94cc-4f484f2b11e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:46.727558 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7ea07-1693-4f20-94cc-4f484f2b11e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:46.727842 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7ea07-1693-4f20-94cc-4f484f2b11e4 admin admin] PATH_INFO: `/v3/projects/c2691a0d4ef4471a89fe87b5302ee781/users/5d809959c4f44106acfdd2f2f64978ae/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:46.729998 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d7ea07-1693-4f20-94cc-4f484f2b11e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2691a0d4ef4471a89fe87b5302ee781, user_id=5d809959c4f44106acfdd2f2f64978ae, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:46.732716 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d7ea07-1693-4f20-94cc-4f484f2b11e4 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:46.747470 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1185/2387] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:13:46 2022] PUT /identity/v3/projects/c2691a0d4ef4471a89fe87b5302ee781/users/5d809959c4f44106acfdd2f2f64978ae/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:13:46.759097 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825677b1-1be1-4c5d-8cf9-cc44f06c81d1 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:46.759388 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825677b1-1be1-4c5d-8cf9-cc44f06c81d1 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:46.759670 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825677b1-1be1-4c5d-8cf9-cc44f06c81d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:46.791095 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-825677b1-1be1-4c5d-8cf9-cc44f06c81d1 None None] MFA Rules not processed for user `5d809959c4f44106acfdd2f2f64978ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:13:46.792468 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-825677b1-1be1-4c5d-8cf9-cc44f06c81d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:46.839572 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:46.869861 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1203/2388] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:13:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:13:46.882552 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7ea07-1693-4f20-94cc-4f484f2b11e4 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:46.884852 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b5d7ea07-1693-4f20-94cc-4f484f2b11e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:46.945493 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7ea07-1693-4f20-94cc-4f484f2b11e4 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:46.949513 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488cd13-c939-491c-96e5-04135290babf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:46.950206 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488cd13-c939-491c-96e5-04135290babf service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:46.950498 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488cd13-c939-491c-96e5-04135290babf service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:46.950781 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488cd13-c939-491c-96e5-04135290babf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:46.960705 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6488cd13-c939-491c-96e5-04135290babf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:46.962292 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6488cd13-c939-491c-96e5-04135290babf service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:46.973228 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1186/2389] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:13:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:13:47.078171 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825677b1-1be1-4c5d-8cf9-cc44f06c81d1 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:47.088209 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825677b1-1be1-4c5d-8cf9-cc44f06c81d1 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:47.091798 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443381a-db6a-4613-858e-9c7ebeda6ca3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:47.092458 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443381a-db6a-4613-858e-9c7ebeda6ca3 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:47.092748 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443381a-db6a-4613-858e-9c7ebeda6ca3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:47.093029 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443381a-db6a-4613-858e-9c7ebeda6ca3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:47.152561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8443381a-db6a-4613-858e-9c7ebeda6ca3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:47.154083 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8443381a-db6a-4613-858e-9c7ebeda6ca3 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:47.163682 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1204/2390] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:13:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:13:49.740971 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488cd13-c939-491c-96e5-04135290babf service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:49.825694 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488cd13-c939-491c-96e5-04135290babf service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:49.831114 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c08cbf6-8673-4948-b699-418b81df7ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:49.832127 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08cbf6-8673-4948-b699-418b81df7ade admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:49.832476 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08cbf6-8673-4948-b699-418b81df7ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:49.832844 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08cbf6-8673-4948-b699-418b81df7ade admin admin] PATH_INFO: `/v3/users/4027eb384c08493fabaea9d1e079aee5` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:49.834096 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c08cbf6-8673-4948-b699-418b81df7ade admin admin] RBAC: Authorizing `identity:delete_user(user_id=4027eb384c08493fabaea9d1e079aee5)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:49.836239 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c08cbf6-8673-4948-b699-418b81df7ade admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:49.868385 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:49.894509 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-6c08cbf6-8673-4948-b699-418b81df7ade admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4027eb384c08493fabaea9d1e079aee5'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:49.895890 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-6c08cbf6-8673-4948-b699-418b81df7ade admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4027eb384c08493fabaea9d1e079aee5'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:49.905043 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-6c08cbf6-8673-4948-b699-418b81df7ade admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4027eb384c08493fabaea9d1e079aee5'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:49.921352 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-6c08cbf6-8673-4948-b699-418b81df7ade admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4027eb384c08493fabaea9d1e079aee5'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:49.922673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-6c08cbf6-8673-4948-b699-418b81df7ade admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4027eb384c08493fabaea9d1e079aee5'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:49.942118 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1187/2391] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:13:49 2022] DELETE /identity/v3/users/4027eb384c08493fabaea9d1e079aee5 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:13:49.947106 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e5896-de4e-4997-b898-371c8cc60fd3 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:49.948221 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e5896-de4e-4997-b898-371c8cc60fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:49.948691 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e5896-de4e-4997-b898-371c8cc60fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:49.972407 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-897e5896-de4e-4997-b898-371c8cc60fd3 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:13:49.973659 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-897e5896-de4e-4997-b898-371c8cc60fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:50.040755 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1205/2392] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:13:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:13:50.050986 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c08cbf6-8673-4948-b699-418b81df7ade admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:50.052436 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6c08cbf6-8673-4948-b699-418b81df7ade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:50.122238 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c08cbf6-8673-4948-b699-418b81df7ade admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:50.126193 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca94d1-cd65-45d1-a41f-c8d423767e74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:50.126877 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca94d1-cd65-45d1-a41f-c8d423767e74 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:50.127166 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca94d1-cd65-45d1-a41f-c8d423767e74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:50.128735 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca94d1-cd65-45d1-a41f-c8d423767e74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:50.141519 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca94d1-cd65-45d1-a41f-c8d423767e74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:50.143026 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca94d1-cd65-45d1-a41f-c8d423767e74 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:50.153702 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1188/2393] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:13:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:13:50.452349 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e5896-de4e-4997-b898-371c8cc60fd3 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:50.454012 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-897e5896-de4e-4997-b898-371c8cc60fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:50.486409 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e5896-de4e-4997-b898-371c8cc60fd3 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:50.492141 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb9999-272b-405f-8ea3-e75761b4486c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:50.493082 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb9999-272b-405f-8ea3-e75761b4486c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:50.493418 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb9999-272b-405f-8ea3-e75761b4486c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:50.493689 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb9999-272b-405f-8ea3-e75761b4486c admin admin] PATH_INFO: `/v3/projects/3bf8176f950a48a18f5ecd5a4d20723e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:50.494960 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb9999-272b-405f-8ea3-e75761b4486c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bf8176f950a48a18f5ecd5a4d20723e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:50.497088 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb9999-272b-405f-8ea3-e75761b4486c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:50.503879 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc2d78-a0ab-4abc-b2ab-b22a9da113ef None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:50.504270 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc2d78-a0ab-4abc-b2ab-b22a9da113ef None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:50.504595 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc2d78-a0ab-4abc-b2ab-b22a9da113ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:50.524815 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-09cc2d78-a0ab-4abc-b2ab-b22a9da113ef None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:13:50.526364 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-09cc2d78-a0ab-4abc-b2ab-b22a9da113ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:50.535145 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1189/2394] 10.222.0.43 () {58 vars in 1016 bytes} [Mon Jul 4 04:13:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:13:50.553102 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-86cb9999-272b-405f-8ea3-e75761b4486c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bf8176f950a48a18f5ecd5a4d20723e', 'request_id': 'req-86cb9999-272b-405f-8ea3-e75761b4486c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:50.561077 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-86cb9999-272b-405f-8ea3-e75761b4486c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bf8176f950a48a18f5ecd5a4d20723e', 'request_id': 'req-86cb9999-272b-405f-8ea3-e75761b4486c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:50.561198 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc2d78-a0ab-4abc-b2ab-b22a9da113ef None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:50.562635 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-09cc2d78-a0ab-4abc-b2ab-b22a9da113ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:50.567269 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-86cb9999-272b-405f-8ea3-e75761b4486c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bf8176f950a48a18f5ecd5a4d20723e', 'request_id': 'req-86cb9999-272b-405f-8ea3-e75761b4486c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:50.582979 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-86cb9999-272b-405f-8ea3-e75761b4486c admin admin] The token cache is being invalidate because project 3bf8176f950a48a18f5ecd5a4d20723e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:13:50.583403 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-86cb9999-272b-405f-8ea3-e75761b4486c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:50.584126 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-86cb9999-272b-405f-8ea3-e75761b4486c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:50.586262 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1206/2395] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:13:50 2022] DELETE /identity/v3/projects/3bf8176f950a48a18f5ecd5a4d20723e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:13:50.589950 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb9999-272b-405f-8ea3-e75761b4486c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:50.593430 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-86cb9999-272b-405f-8ea3-e75761b4486c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:50.599009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:50.649808 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc2d78-a0ab-4abc-b2ab-b22a9da113ef None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:50.671338 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb9999-272b-405f-8ea3-e75761b4486c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:50.675963 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893791a6-792a-496b-9778-c959981c1bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:50.676861 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893791a6-792a-496b-9778-c959981c1bd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:50.677149 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893791a6-792a-496b-9778-c959981c1bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:50.677573 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893791a6-792a-496b-9778-c959981c1bd3 admin admin] PATH_INFO: `/v3/users/5d809959c4f44106acfdd2f2f64978ae` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:50.678830 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893791a6-792a-496b-9778-c959981c1bd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d809959c4f44106acfdd2f2f64978ae)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:50.680796 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893791a6-792a-496b-9778-c959981c1bd3 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:50.689714 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:50.725432 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132623b5-8b2b-4c0b-b9b2-d24a23dc36dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:50.726100 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132623b5-8b2b-4c0b-b9b2-d24a23dc36dc service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:50.726421 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132623b5-8b2b-4c0b-b9b2-d24a23dc36dc service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:50.726699 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132623b5-8b2b-4c0b-b9b2-d24a23dc36dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:50.728555 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-132623b5-8b2b-4c0b-b9b2-d24a23dc36dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:50.740783 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132623b5-8b2b-4c0b-b9b2-d24a23dc36dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:50.741143 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-893791a6-792a-496b-9778-c959981c1bd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d809959c4f44106acfdd2f2f64978ae'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:50.742692 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132623b5-8b2b-4c0b-b9b2-d24a23dc36dc service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:50.751707 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-893791a6-792a-496b-9778-c959981c1bd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d809959c4f44106acfdd2f2f64978ae'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:50.752919 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-893791a6-792a-496b-9778-c959981c1bd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d809959c4f44106acfdd2f2f64978ae'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:50.753433 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1190/2396] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:13:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:13:50.767652 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-893791a6-792a-496b-9778-c959981c1bd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d809959c4f44106acfdd2f2f64978ae'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:50.768406 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-893791a6-792a-496b-9778-c959981c1bd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d809959c4f44106acfdd2f2f64978ae'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:50.782052 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1207/2397] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:13:50 2022] DELETE /identity/v3/users/5d809959c4f44106acfdd2f2f64978ae => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 04:13:51.090216 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132623b5-8b2b-4c0b-b9b2-d24a23dc36dc service nova] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:51.102476 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132623b5-8b2b-4c0b-b9b2-d24a23dc36dc service nova] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:51.163738 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee10890-df94-4424-855c-a3db7da106a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:51.164614 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee10890-df94-4424-855c-a3db7da106a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:51.164903 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee10890-df94-4424-855c-a3db7da106a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:51.165183 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee10890-df94-4424-855c-a3db7da106a5 admin admin] PATH_INFO: `/v3/projects/c2691a0d4ef4471a89fe87b5302ee781` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:51.166471 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee10890-df94-4424-855c-a3db7da106a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2691a0d4ef4471a89fe87b5302ee781)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:51.168413 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee10890-df94-4424-855c-a3db7da106a5 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:51.228383 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-dee10890-df94-4424-855c-a3db7da106a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2691a0d4ef4471a89fe87b5302ee781', 'request_id': 'req-dee10890-df94-4424-855c-a3db7da106a5'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:51.233958 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-dee10890-df94-4424-855c-a3db7da106a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2691a0d4ef4471a89fe87b5302ee781', 'request_id': 'req-dee10890-df94-4424-855c-a3db7da106a5'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:51.240728 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-dee10890-df94-4424-855c-a3db7da106a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2691a0d4ef4471a89fe87b5302ee781', 'request_id': 'req-dee10890-df94-4424-855c-a3db7da106a5'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:51.255377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-dee10890-df94-4424-855c-a3db7da106a5 admin admin] The token cache is being invalidate because project c2691a0d4ef4471a89fe87b5302ee781 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:13:51.255666 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-dee10890-df94-4424-855c-a3db7da106a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:51.256372 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-dee10890-df94-4424-855c-a3db7da106a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:51.258020 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1191/2398] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:13:51 2022] DELETE /identity/v3/projects/c2691a0d4ef4471a89fe87b5302ee781 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:13:51.263469 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f9f36-bb25-4e93-8250-3c733ed7f0d9 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:51.263962 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f9f36-bb25-4e93-8250-3c733ed7f0d9 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:51.264060 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f9f36-bb25-4e93-8250-3c733ed7f0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:51.282077 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-5f0f9f36-bb25-4e93-8250-3c733ed7f0d9 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:13:51.283311 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-5f0f9f36-bb25-4e93-8250-3c733ed7f0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:51.343033 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1208/2399] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:13:51.351149 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47e10f-826c-4bb5-9996-42f640404b73 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:51.351377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47e10f-826c-4bb5-9996-42f640404b73 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:51.351658 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47e10f-826c-4bb5-9996-42f640404b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:51.371596 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-1b47e10f-826c-4bb5-9996-42f640404b73 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:13:51.372843 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1b47e10f-826c-4bb5-9996-42f640404b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:51.382537 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1192/2400] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:13:51.386833 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f9f36-bb25-4e93-8250-3c733ed7f0d9 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:51.397139 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f9f36-bb25-4e93-8250-3c733ed7f0d9 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:51.403079 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a60b2-f2a1-4ef7-8c44-aef96816fdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:51.403720 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a60b2-f2a1-4ef7-8c44-aef96816fdd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:51.404007 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a60b2-f2a1-4ef7-8c44-aef96816fdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:51.404319 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a60b2-f2a1-4ef7-8c44-aef96816fdd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:51.405058 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a60b2-f2a1-4ef7-8c44-aef96816fdd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:13:51.405370 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a60b2-f2a1-4ef7-8c44-aef96816fdd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:51.407066 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a60b2-f2a1-4ef7-8c44-aef96816fdd5 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:51.419680 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1209/2401] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:13:51.423946 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47e10f-826c-4bb5-9996-42f640404b73 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:51.433749 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47e10f-826c-4bb5-9996-42f640404b73 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:51.439434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90438f4a-1e2d-4d02-816b-08809fcc9559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:51.440085 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90438f4a-1e2d-4d02-816b-08809fcc9559 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:51.440364 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90438f4a-1e2d-4d02-816b-08809fcc9559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:51.440639 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90438f4a-1e2d-4d02-816b-08809fcc9559 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:51.441331 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90438f4a-1e2d-4d02-816b-08809fcc9559 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:51.443311 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90438f4a-1e2d-4d02-816b-08809fcc9559 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:51.471525 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1193/2402] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:13:51 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:13:51.475660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a60b2-f2a1-4ef7-8c44-aef96816fdd5 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:51.486448 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a60b2-f2a1-4ef7-8c44-aef96816fdd5 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:51.492043 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:51.548275 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8b757-4963-4b41-9c69-94b5e31d7302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:51.548945 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8b757-4963-4b41-9c69-94b5e31d7302 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:51.549231 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8b757-4963-4b41-9c69-94b5e31d7302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:51.549512 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8b757-4963-4b41-9c69-94b5e31d7302 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:51.550207 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f8b757-4963-4b41-9c69-94b5e31d7302 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:51.552218 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f8b757-4963-4b41-9c69-94b5e31d7302 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:51.574174 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1210/2403] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:13:51 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:13:51.579938 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90438f4a-1e2d-4d02-816b-08809fcc9559 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:51.590369 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90438f4a-1e2d-4d02-816b-08809fcc9559 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:51.596185 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546abf17-641a-4e6b-8828-b1b746f67750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:51.596876 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546abf17-641a-4e6b-8828-b1b746f67750 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:51.597160 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546abf17-641a-4e6b-8828-b1b746f67750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:51.597439 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546abf17-641a-4e6b-8828-b1b746f67750 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:51.598197 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546abf17-641a-4e6b-8828-b1b746f67750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:51.599836 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546abf17-641a-4e6b-8828-b1b746f67750 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:51.610966 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1194/2404] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:13:51.615361 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8b757-4963-4b41-9c69-94b5e31d7302 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:51.626667 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8b757-4963-4b41-9c69-94b5e31d7302 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:51.632330 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb4883-e172-40fb-a4a1-e943c8e9ec36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:51.633023 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb4883-e172-40fb-a4a1-e943c8e9ec36 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:51.633306 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb4883-e172-40fb-a4a1-e943c8e9ec36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:51.633594 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb4883-e172-40fb-a4a1-e943c8e9ec36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:51.634384 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb4883-e172-40fb-a4a1-e943c8e9ec36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:51.635962 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb4883-e172-40fb-a4a1-e943c8e9ec36 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:51.646275 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1211/2405] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:13:51.650565 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546abf17-641a-4e6b-8828-b1b746f67750 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:51.661247 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546abf17-641a-4e6b-8828-b1b746f67750 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:51.666786 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c2661-0cd9-4827-ac65-9873e022aa1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:51.667673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c2661-0cd9-4827-ac65-9873e022aa1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:51.667961 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c2661-0cd9-4827-ac65-9873e022aa1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:51.668238 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c2661-0cd9-4827-ac65-9873e022aa1f admin admin] PATH_INFO: `/v3/projects/a19725901d0e457bb18fef0f8ed81480/users/48a38b3f47d74097af8daccc1bc10efc/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:51.679656 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:51.684797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c2661-0cd9-4827-ac65-9873e022aa1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a19725901d0e457bb18fef0f8ed81480, user_id=48a38b3f47d74097af8daccc1bc10efc, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:51.687882 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c2661-0cd9-4827-ac65-9873e022aa1f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:51.703104 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1195/2406] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:13:51 2022] PUT /identity/v3/projects/a19725901d0e457bb18fef0f8ed81480/users/48a38b3f47d74097af8daccc1bc10efc/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 04:13:51.714810 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028dfcc-1453-4cb2-9346-77934f274827 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:51.714810 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028dfcc-1453-4cb2-9346-77934f274827 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:51.715097 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028dfcc-1453-4cb2-9346-77934f274827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:51.742216 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-8028dfcc-1453-4cb2-9346-77934f274827 None None] MFA Rules not processed for user `48a38b3f47d74097af8daccc1bc10efc`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:13:51.743438 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-8028dfcc-1453-4cb2-9346-77934f274827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:51.810943 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1212/2407] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:13:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:13:51.822090 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c2661-0cd9-4827-ac65-9873e022aa1f admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:51.824159 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ba7c2661-0cd9-4827-ac65-9873e022aa1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:51.904127 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c2661-0cd9-4827-ac65-9873e022aa1f admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:51.908245 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f9a04-69aa-4665-b222-8909ad67e9b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:51.908900 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f9a04-69aa-4665-b222-8909ad67e9b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:51.909187 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f9a04-69aa-4665-b222-8909ad67e9b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:51.909487 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f9a04-69aa-4665-b222-8909ad67e9b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:51.918574 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27f9a04-69aa-4665-b222-8909ad67e9b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:51.920036 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27f9a04-69aa-4665-b222-8909ad67e9b7 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:51.929083 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1196/2408] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:13:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:13:55.016844 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028dfcc-1453-4cb2-9346-77934f274827 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:55.088225 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028dfcc-1453-4cb2-9346-77934f274827 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:55.092960 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f04e19-f714-47dd-903a-276939d33efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:55.093867 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f04e19-f714-47dd-903a-276939d33efb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:55.094144 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f04e19-f714-47dd-903a-276939d33efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:55.094465 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f04e19-f714-47dd-903a-276939d33efb admin admin] PATH_INFO: `/v3/users/48a38b3f47d74097af8daccc1bc10efc` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:55.095830 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f04e19-f714-47dd-903a-276939d33efb admin admin] RBAC: Authorizing `identity:delete_user(user_id=48a38b3f47d74097af8daccc1bc10efc)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:55.097950 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f04e19-f714-47dd-903a-276939d33efb admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:55.122908 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:55.151515 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-37f04e19-f714-47dd-903a-276939d33efb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48a38b3f47d74097af8daccc1bc10efc'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:55.160736 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-37f04e19-f714-47dd-903a-276939d33efb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48a38b3f47d74097af8daccc1bc10efc'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:55.161535 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-37f04e19-f714-47dd-903a-276939d33efb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48a38b3f47d74097af8daccc1bc10efc'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:55.174470 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-37f04e19-f714-47dd-903a-276939d33efb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48a38b3f47d74097af8daccc1bc10efc'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:55.175220 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-37f04e19-f714-47dd-903a-276939d33efb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48a38b3f47d74097af8daccc1bc10efc'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:55.187909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1213/2409] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:13:55 2022] DELETE /identity/v3/users/48a38b3f47d74097af8daccc1bc10efc => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:13:55.192867 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1256e71-420b-42f6-992a-3b7d1c15382d None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:55.193352 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1256e71-420b-42f6-992a-3b7d1c15382d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:55.193448 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1256e71-420b-42f6-992a-3b7d1c15382d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:55.212555 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-b1256e71-420b-42f6-992a-3b7d1c15382d None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:13:55.213792 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b1256e71-420b-42f6-992a-3b7d1c15382d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:55.272576 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1197/2410] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:13:55.282522 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f04e19-f714-47dd-903a-276939d33efb admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:55.284206 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-37f04e19-f714-47dd-903a-276939d33efb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:55.342951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f04e19-f714-47dd-903a-276939d33efb admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:55.347272 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e9780-f694-4d8e-9f98-a338c58592fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:55.347918 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e9780-f694-4d8e-9f98-a338c58592fb service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:55.348199 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e9780-f694-4d8e-9f98-a338c58592fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:55.348476 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e9780-f694-4d8e-9f98-a338c58592fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:55.358124 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e9780-f694-4d8e-9f98-a338c58592fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:55.359594 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e9780-f694-4d8e-9f98-a338c58592fb service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:55.369655 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1214/2411] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:13:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:13:55.644755 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1256e71-420b-42f6-992a-3b7d1c15382d None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:55.646650 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b1256e71-420b-42f6-992a-3b7d1c15382d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:55.671672 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1256e71-420b-42f6-992a-3b7d1c15382d None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:55.682713 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850dccd-821e-4d85-a9a0-3e3a0f26b171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:55.683713 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850dccd-821e-4d85-a9a0-3e3a0f26b171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:55.684006 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850dccd-821e-4d85-a9a0-3e3a0f26b171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:55.684319 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850dccd-821e-4d85-a9a0-3e3a0f26b171 admin admin] PATH_INFO: `/v3/projects/a19725901d0e457bb18fef0f8ed81480` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:55.685631 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850dccd-821e-4d85-a9a0-3e3a0f26b171 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a19725901d0e457bb18fef0f8ed81480)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:55.687618 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850dccd-821e-4d85-a9a0-3e3a0f26b171 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:55.738460 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2850dccd-821e-4d85-a9a0-3e3a0f26b171 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a19725901d0e457bb18fef0f8ed81480', 'request_id': 'req-2850dccd-821e-4d85-a9a0-3e3a0f26b171'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:55.744011 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2850dccd-821e-4d85-a9a0-3e3a0f26b171 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a19725901d0e457bb18fef0f8ed81480', 'request_id': 'req-2850dccd-821e-4d85-a9a0-3e3a0f26b171'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:55.750230 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2850dccd-821e-4d85-a9a0-3e3a0f26b171 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a19725901d0e457bb18fef0f8ed81480', 'request_id': 'req-2850dccd-821e-4d85-a9a0-3e3a0f26b171'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:55.753924 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:13:55.754293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b3521-244f-4242-916d-9abd65a67ba8 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:55.754808 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b3521-244f-4242-916d-9abd65a67ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:55.755129 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b3521-244f-4242-916d-9abd65a67ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:55.767530 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2850dccd-821e-4d85-a9a0-3e3a0f26b171 admin admin] The token cache is being invalidate because project a19725901d0e457bb18fef0f8ed81480 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:13:55.768059 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2850dccd-821e-4d85-a9a0-3e3a0f26b171 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:55.768886 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2850dccd-821e-4d85-a9a0-3e3a0f26b171 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:13:55.770916 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1198/2412] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:13:55 2022] DELETE /identity/v3/projects/a19725901d0e457bb18fef0f8ed81480 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:13:55.778812 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-b55b3521-244f-4242-916d-9abd65a67ba8 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:13:55.780001 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b55b3521-244f-4242-916d-9abd65a67ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:55.848164 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1215/2413] 10.222.0.43 () {58 vars in 1016 bytes} [Mon Jul 4 04:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:13:55.872169 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850dccd-821e-4d85-a9a0-3e3a0f26b171 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:13:55.873738 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-2850dccd-821e-4d85-a9a0-3e3a0f26b171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:55.956534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850dccd-821e-4d85-a9a0-3e3a0f26b171 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:13:55.963149 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00087aef-0905-497b-af4b-264bb4c9495d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:13:55.963938 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00087aef-0905-497b-af4b-264bb4c9495d service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:55.964283 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00087aef-0905-497b-af4b-264bb4c9495d service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:55.964631 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00087aef-0905-497b-af4b-264bb4c9495d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:55.978995 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00087aef-0905-497b-af4b-264bb4c9495d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:13:55.980636 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00087aef-0905-497b-af4b-264bb4c9495d service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:13:55.991507 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1199/2414] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:13:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:13:59.951841 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dedd20-58c5-4fe1-88d1-bd0bc1d8db2d None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:13:59.952389 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dedd20-58c5-4fe1-88d1-bd0bc1d8db2d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:13:59.952389 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dedd20-58c5-4fe1-88d1-bd0bc1d8db2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:13:59.973086 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-63dedd20-58c5-4fe1-88d1-bd0bc1d8db2d None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:13:59.974343 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-63dedd20-58c5-4fe1-88d1-bd0bc1d8db2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:13:59.986963 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1216/2415] 10.222.0.43 () {58 vars in 1016 bytes} [Mon Jul 4 04:13:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:14:00.010474 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00087aef-0905-497b-af4b-264bb4c9495d service nova] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:14:00.012106 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-00087aef-0905-497b-af4b-264bb4c9495d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:14:00.027847 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00087aef-0905-497b-af4b-264bb4c9495d service nova] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:14:00.034995 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe0890-35c6-48fc-9866-b6ae02aacc7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:14:00.035635 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe0890-35c6-48fc-9866-b6ae02aacc7d service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:14:00.035918 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe0890-35c6-48fc-9866-b6ae02aacc7d service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:14:00.036218 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe0890-35c6-48fc-9866-b6ae02aacc7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:14:00.045366 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe0890-35c6-48fc-9866-b6ae02aacc7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:14:00.047073 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe0890-35c6-48fc-9866-b6ae02aacc7d service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:14:00.057658 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1200/2416] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:14:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:14:09.966872 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:DELETE=8,keystone:SELECT=76,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:14:10.053047 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=42 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:14:11.943665 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dedd20-58c5-4fe1-88d1-bd0bc1d8db2d None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:14:11.945978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-63dedd20-58c5-4fe1-88d1-bd0bc1d8db2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:14:12.071762 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dedd20-58c5-4fe1-88d1-bd0bc1d8db2d None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:14:12.077054 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41064d6-7c24-4b61-9c66-b948da796a64 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a18591461343c3a0a1b0e317734ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:14:12.077711 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41064d6-7c24-4b61-9c66-b948da796a64 service placement] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:14:12.078001 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41064d6-7c24-4b61-9c66-b948da796a64 service placement] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:14:12.078313 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41064d6-7c24-4b61-9c66-b948da796a64 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:14:12.080153 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b41064d6-7c24-4b61-9c66-b948da796a64 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:14:12.092102 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41064d6-7c24-4b61-9c66-b948da796a64 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:14:12.093710 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41064d6-7c24-4b61-9c66-b948da796a64 service placement] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:14:12.104180 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1217/2417] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:14:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:14:17.451172 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696a9a2-22f5-4450-a486-34d962b3a96f None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:14:17.451757 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696a9a2-22f5-4450-a486-34d962b3a96f None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:14:17.451757 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696a9a2-22f5-4450-a486-34d962b3a96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:14:17.471634 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c696a9a2-22f5-4450-a486-34d962b3a96f None None] MFA Rules not processed for user `a0789bda75d4414985767d3f1113adb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:14:17.472834 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c696a9a2-22f5-4450-a486-34d962b3a96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:14:17.533578 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1201/2418] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:14:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:14:19.189191 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c648c-f9d6-4da1-968a-e666b9a5dab2 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:14:19.189750 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c648c-f9d6-4da1-968a-e666b9a5dab2 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:14:19.189750 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c648c-f9d6-4da1-968a-e666b9a5dab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:14:19.208374 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-fc1c648c-f9d6-4da1-968a-e666b9a5dab2 None None] MFA Rules not processed for user `c8ada8b86e2f4ad18c8af021def1a30e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:14:19.209617 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-fc1c648c-f9d6-4da1-968a-e666b9a5dab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:14:19.269560 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1218/2419] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:14:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:14:27.526091 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=25 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:14:29.262805 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=66 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:14:38.859719 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a59b71-41fa-4e0b-baed-d614997fa118 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:14:38.860295 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a59b71-41fa-4e0b-baed-d614997fa118 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:14:38.860295 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a59b71-41fa-4e0b-baed-d614997fa118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:14:38.884242 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-82a59b71-41fa-4e0b-baed-d614997fa118 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:14:38.885583 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-82a59b71-41fa-4e0b-baed-d614997fa118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:14:38.900989 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1202/2420] 10.222.0.43 () {58 vars in 1016 bytes} [Mon Jul 4 04:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:14:38.933703 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c648c-f9d6-4da1-968a-e666b9a5dab2 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:14:38.947258 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c648c-f9d6-4da1-968a-e666b9a5dab2 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:14:38.953381 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af8f25-a302-4080-ace9-104e56997d0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:14:38.954041 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af8f25-a302-4080-ace9-104e56997d0c service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:14:38.954368 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af8f25-a302-4080-ace9-104e56997d0c service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:14:38.954652 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af8f25-a302-4080-ace9-104e56997d0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:14:38.972328 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af8f25-a302-4080-ace9-104e56997d0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:14:38.974438 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af8f25-a302-4080-ace9-104e56997d0c service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:14:38.984643 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1219/2421] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:14:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:14:43.184727 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2164a1b-22b1-44a2-b0b7-d40e70175b0c None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:14:43.185285 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2164a1b-22b1-44a2-b0b7-d40e70175b0c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:14:43.185285 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2164a1b-22b1-44a2-b0b7-d40e70175b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:14:43.204693 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-a2164a1b-22b1-44a2-b0b7-d40e70175b0c None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:14:43.205887 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a2164a1b-22b1-44a2-b0b7-d40e70175b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:14:43.215068 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1203/2422] 10.222.0.43 () {58 vars in 1016 bytes} [Mon Jul 4 04:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:14:43.237799 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af8f25-a302-4080-ace9-104e56997d0c service nova] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:14:43.250137 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af8f25-a302-4080-ace9-104e56997d0c service nova] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:14:43.256575 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d569693-b497-4dac-9ecc-729304761017 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:14:43.257220 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d569693-b497-4dac-9ecc-729304761017 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:14:43.257503 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d569693-b497-4dac-9ecc-729304761017 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:14:43.257800 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d569693-b497-4dac-9ecc-729304761017 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:14:43.268221 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d569693-b497-4dac-9ecc-729304761017 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:14:43.269859 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d569693-b497-4dac-9ecc-729304761017 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:14:43.279745 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1220/2423] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:14:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:14:48.367733 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de6605-fb78-478e-8d61-c88addbeaa60 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:14:48.368688 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de6605-fb78-478e-8d61-c88addbeaa60 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:14:48.368971 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de6605-fb78-478e-8d61-c88addbeaa60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:14:48.395676 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-81de6605-fb78-478e-8d61-c88addbeaa60 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:14:48.397453 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-81de6605-fb78-478e-8d61-c88addbeaa60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:14:48.406497 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1204/2424] 10.222.0.43 () {58 vars in 1016 bytes} [Mon Jul 4 04:14:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:14:48.427934 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d569693-b497-4dac-9ecc-729304761017 service nova] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:14:48.439794 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d569693-b497-4dac-9ecc-729304761017 service nova] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:14:48.447122 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20961a-4c61-41b9-9981-a6f1bf2e7c07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:14:48.447730 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20961a-4c61-41b9-9981-a6f1bf2e7c07 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:14:48.448014 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20961a-4c61-41b9-9981-a6f1bf2e7c07 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:14:48.448289 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20961a-4c61-41b9-9981-a6f1bf2e7c07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:14:48.456716 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20961a-4c61-41b9-9981-a6f1bf2e7c07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:14:48.458333 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20961a-4c61-41b9-9981-a6f1bf2e7c07 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:14:48.467997 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1221/2425] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:14:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:14:50.134365 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ef1f4-6dfa-4c51-957d-2a843b7397f4 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:14:50.134833 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ef1f4-6dfa-4c51-957d-2a843b7397f4 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:14:50.134925 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ef1f4-6dfa-4c51-957d-2a843b7397f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:14:50.196085 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-744ef1f4-6dfa-4c51-957d-2a843b7397f4 None None] MFA Rules not processed for user `03e7f908f0a7499792e59e31d497edb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:14:50.197848 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-744ef1f4-6dfa-4c51-957d-2a843b7397f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:14:50.267227 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1205/2426] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Jul 4 04:14:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:14:50.311250 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20961a-4c61-41b9-9981-a6f1bf2e7c07 service nova] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:14:50.312852 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-de20961a-4c61-41b9-9981-a6f1bf2e7c07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:14:50.408803 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20961a-4c61-41b9-9981-a6f1bf2e7c07 service nova] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:14:50.414489 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1acea-b894-462a-a316-6d4d03d49f0d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f93fdc98ff425791da3e2194b3a671', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:14:50.415137 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1acea-b894-462a-a316-6d4d03d49f0d service swift] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:14:50.415429 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1acea-b894-462a-a316-6d4d03d49f0d service swift] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:14:50.415717 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1acea-b894-462a-a316-6d4d03d49f0d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:14:50.424371 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd1acea-b894-462a-a316-6d4d03d49f0d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:14:50.426073 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd1acea-b894-462a-a316-6d4d03d49f0d service swift] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:14:50.434484 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1222/2427] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Jul 4 04:14:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 04:14:52.561056 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c7199-8b49-4a82-b2a1-5089babcf882 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:14:52.561655 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c7199-8b49-4a82-b2a1-5089babcf882 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:14:52.561655 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c7199-8b49-4a82-b2a1-5089babcf882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:14:52.580081 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-b89c7199-8b49-4a82-b2a1-5089babcf882 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:14:52.581327 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b89c7199-8b49-4a82-b2a1-5089babcf882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:14:52.589794 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1206/2428] 10.222.0.43 () {58 vars in 1016 bytes} [Mon Jul 4 04:14:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:14:52.613582 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1acea-b894-462a-a316-6d4d03d49f0d service swift] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:14:52.625759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1acea-b894-462a-a316-6d4d03d49f0d service swift] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:14:52.632664 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b6d7d-b70c-40bf-acbe-cc5cdff09e14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:14:52.633551 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b6d7d-b70c-40bf-acbe-cc5cdff09e14 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:14:52.633838 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b6d7d-b70c-40bf-acbe-cc5cdff09e14 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:14:52.634111 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b6d7d-b70c-40bf-acbe-cc5cdff09e14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:14:52.644136 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b6d7d-b70c-40bf-acbe-cc5cdff09e14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:14:52.645741 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b6d7d-b70c-40bf-acbe-cc5cdff09e14 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:14:52.655958 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1223/2429] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:14:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:14:57.794987 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7d2a0-0f08-4d29-b734-59eab02a0cd9 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:14:57.795634 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7d2a0-0f08-4d29-b734-59eab02a0cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:14:57.795634 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7d2a0-0f08-4d29-b734-59eab02a0cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:14:57.819996 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-6ed7d2a0-0f08-4d29-b734-59eab02a0cd9 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:14:57.821267 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6ed7d2a0-0f08-4d29-b734-59eab02a0cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:14:57.834263 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1207/2430] 10.222.0.43 () {58 vars in 1016 bytes} [Mon Jul 4 04:14:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:14:57.855988 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b6d7d-b70c-40bf-acbe-cc5cdff09e14 service nova] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:14:57.868109 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b6d7d-b70c-40bf-acbe-cc5cdff09e14 service nova] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:14:57.873590 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ab157-143d-431a-9c96-5ceb4acd5647 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:14:57.874273 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ab157-143d-431a-9c96-5ceb4acd5647 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:14:57.874565 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ab157-143d-431a-9c96-5ceb4acd5647 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:14:57.874845 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ab157-143d-431a-9c96-5ceb4acd5647 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:14:57.884376 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ab157-143d-431a-9c96-5ceb4acd5647 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:14:57.886082 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ab157-143d-431a-9c96-5ceb4acd5647 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:14:57.897241 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1224/2431] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:14:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:15:07.810014 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=59 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:15:07.892520 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=71 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:15:13.911503 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44f9d0-1e08-4204-928a-a6388905cc27 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:15:13.912450 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44f9d0-1e08-4204-928a-a6388905cc27 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:15:13.912940 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44f9d0-1e08-4204-928a-a6388905cc27 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:15:13.914800 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1208/2432] 10.222.0.49 () {54 vars in 921 bytes} [Mon Jul 4 04:15:13 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:15:13.924449 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d572dc7-8c10-4ead-886a-987a0be14a51 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:15:13.925001 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d572dc7-8c10-4ead-886a-987a0be14a51 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:15:13.925001 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d572dc7-8c10-4ead-886a-987a0be14a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:15:13.974028 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-5d572dc7-8c10-4ead-886a-987a0be14a51 None None] MFA Rules not processed for user `8334e75253f843a980b01c6f0cda6015`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:15:13.975573 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-5d572dc7-8c10-4ead-886a-987a0be14a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:15:13.988857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1225/2433] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Jul 4 04:15:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:15:14.002718 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44f9d0-1e08-4204-928a-a6388905cc27 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:15:14.004755 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-fa44f9d0-1e08-4204-928a-a6388905cc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:15:14.103599 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44f9d0-1e08-4204-928a-a6388905cc27 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:15:14.107359 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d1fdf-68bc-44ff-8d45-f21dbeba7f68 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e29ce1e3d64431bc7aa80d55787ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:15:14.108019 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d1fdf-68bc-44ff-8d45-f21dbeba7f68 service glance] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:15:14.108309 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d1fdf-68bc-44ff-8d45-f21dbeba7f68 service glance] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:15:14.108589 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d1fdf-68bc-44ff-8d45-f21dbeba7f68 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:15:14.119080 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d1fdf-68bc-44ff-8d45-f21dbeba7f68 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:15:14.120545 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d1fdf-68bc-44ff-8d45-f21dbeba7f68 service glance] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:15:14.131253 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1209/2434] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:15:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:15:14.212735 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2733f-d9a5-4633-bea6-b40821800295 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:15:14.213162 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2733f-d9a5-4633-bea6-b40821800295 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:15:14.213548 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2733f-d9a5-4633-bea6-b40821800295 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:15:14.215751 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1226/2435] 10.222.0.49 () {54 vars in 921 bytes} [Mon Jul 4 04:15:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:15:14.222206 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad757684-c0dd-448e-99e0-42cfeb529a60 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:15:14.222621 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad757684-c0dd-448e-99e0-42cfeb529a60 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:15:14.223032 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad757684-c0dd-448e-99e0-42cfeb529a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:15:14.250914 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-ad757684-c0dd-448e-99e0-42cfeb529a60 None None] MFA Rules not processed for user `b36a8402144c458fa98f80d7e3516127`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:15:14.252167 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ad757684-c0dd-448e-99e0-42cfeb529a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:15:14.311799 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1210/2436] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Jul 4 04:15:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:15:14.331809 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2733f-d9a5-4633-bea6-b40821800295 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:15:14.334749 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f4c2733f-d9a5-4633-bea6-b40821800295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:15:14.352564 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2733f-d9a5-4633-bea6-b40821800295 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:15:14.356669 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea626e5f-be7b-43d7-84ce-c0662bf4b5d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:15:14.357316 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea626e5f-be7b-43d7-84ce-c0662bf4b5d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:15:14.357623 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea626e5f-be7b-43d7-84ce-c0662bf4b5d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:15:14.357914 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea626e5f-be7b-43d7-84ce-c0662bf4b5d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:15:14.365842 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea626e5f-be7b-43d7-84ce-c0662bf4b5d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:15:14.367332 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea626e5f-be7b-43d7-84ce-c0662bf4b5d6 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:15:14.375347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1227/2437] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:15:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:15:14.461391 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f29fa4-80b1-4b49-9002-861c3dcd39f9 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:15:14.461682 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f29fa4-80b1-4b49-9002-861c3dcd39f9 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:15:14.461956 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f29fa4-80b1-4b49-9002-861c3dcd39f9 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:15:14.463405 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1211/2438] 10.222.0.49 () {54 vars in 921 bytes} [Mon Jul 4 04:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:15:14.468934 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c2700-923c-4acd-8733-a6be79a57972 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:15:14.469238 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c2700-923c-4acd-8733-a6be79a57972 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:15:14.469508 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c2700-923c-4acd-8733-a6be79a57972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:15:14.490348 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-df1c2700-923c-4acd-8733-a6be79a57972 None None] MFA Rules not processed for user `8334e75253f843a980b01c6f0cda6015`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:15:14.492095 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-df1c2700-923c-4acd-8733-a6be79a57972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:15:14.504725 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1228/2439] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Jul 4 04:15:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:15:14.517445 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f29fa4-80b1-4b49-9002-861c3dcd39f9 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:15:14.530625 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f29fa4-80b1-4b49-9002-861c3dcd39f9 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:15:14.534774 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fcb52-5b5f-447b-855f-157fe3ff5ee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:15:14.535449 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fcb52-5b5f-447b-855f-157fe3ff5ee2 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:15:14.535740 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fcb52-5b5f-447b-855f-157fe3ff5ee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:15:14.536012 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fcb52-5b5f-447b-855f-157fe3ff5ee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:15:14.546936 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931fcb52-5b5f-447b-855f-157fe3ff5ee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:15:14.548397 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931fcb52-5b5f-447b-855f-157fe3ff5ee2 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:15:14.559405 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1212/2440] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:15:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:15:17.085191 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba48063-a7bb-4958-b98c-bdb83d724d91 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:15:17.085758 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba48063-a7bb-4958-b98c-bdb83d724d91 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:15:17.085758 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba48063-a7bb-4958-b98c-bdb83d724d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:15:17.104665 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-7ba48063-a7bb-4958-b98c-bdb83d724d91 None None] MFA Rules not processed for user `03e7f908f0a7499792e59e31d497edb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:15:17.106225 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7ba48063-a7bb-4958-b98c-bdb83d724d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:15:17.114197 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1229/2441] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Jul 4 04:15:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:15:17.128238 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fcb52-5b5f-447b-855f-157fe3ff5ee2 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:15:17.142908 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fcb52-5b5f-447b-855f-157fe3ff5ee2 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:15:17.148716 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71020f63-537d-4004-a86c-fe00cfea2613 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f93fdc98ff425791da3e2194b3a671', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:15:17.149364 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71020f63-537d-4004-a86c-fe00cfea2613 service swift] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:15:17.149650 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71020f63-537d-4004-a86c-fe00cfea2613 service swift] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:15:17.149925 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71020f63-537d-4004-a86c-fe00cfea2613 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:15:17.158837 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71020f63-537d-4004-a86c-fe00cfea2613 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:15:17.160434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71020f63-537d-4004-a86c-fe00cfea2613 service swift] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:15:17.168608 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1213/2442] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Jul 4 04:15:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 04:15:27.099101 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=21 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:15:27.165217 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=70 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:15:34.835670 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba48063-a7bb-4958-b98c-bdb83d724d91 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:15:34.837826 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7ba48063-a7bb-4958-b98c-bdb83d724d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:15:34.853548 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba48063-a7bb-4958-b98c-bdb83d724d91 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:15:34.858201 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89b008-6780-4e15-8c31-0d7f82d0d33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:15:34.859588 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89b008-6780-4e15-8c31-0d7f82d0d33f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:15:34.860012 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89b008-6780-4e15-8c31-0d7f82d0d33f admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:15:34.860448 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89b008-6780-4e15-8c31-0d7f82d0d33f admin admin] PATH_INFO: `/v3/users/a0789bda75d4414985767d3f1113adb6` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:15:34.874564 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee89b008-6780-4e15-8c31-0d7f82d0d33f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0789bda75d4414985767d3f1113adb6)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:15:34.876978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee89b008-6780-4e15-8c31-0d7f82d0d33f admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:15:34.929079 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ee89b008-6780-4e15-8c31-0d7f82d0d33f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0789bda75d4414985767d3f1113adb6'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:15:34.936547 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ee89b008-6780-4e15-8c31-0d7f82d0d33f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0789bda75d4414985767d3f1113adb6'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:15:34.937176 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ee89b008-6780-4e15-8c31-0d7f82d0d33f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0789bda75d4414985767d3f1113adb6'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:15:34.949390 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ee89b008-6780-4e15-8c31-0d7f82d0d33f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0789bda75d4414985767d3f1113adb6'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:15:34.950237 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ee89b008-6780-4e15-8c31-0d7f82d0d33f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0789bda75d4414985767d3f1113adb6'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:15:34.965177 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1230/2443] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:15:34 2022] DELETE /identity/v3/users/a0789bda75d4414985767d3f1113adb6 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:15:35.157692 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71020f63-537d-4004-a86c-fe00cfea2613 service swift] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:15:35.168934 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71020f63-537d-4004-a86c-fe00cfea2613 service swift] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:15:35.228968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a607d-edb8-445b-82e9-ffaa41bef7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:15:35.229852 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a607d-edb8-445b-82e9-ffaa41bef7de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:15:35.230142 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a607d-edb8-445b-82e9-ffaa41bef7de admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:15:35.230459 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a607d-edb8-445b-82e9-ffaa41bef7de admin admin] PATH_INFO: `/v3/projects/a9ed2084729d4ea0863298fcbf27155b` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:15:35.231676 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600a607d-edb8-445b-82e9-ffaa41bef7de admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9ed2084729d4ea0863298fcbf27155b)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:15:35.233627 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600a607d-edb8-445b-82e9-ffaa41bef7de admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:15:35.282785 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-600a607d-edb8-445b-82e9-ffaa41bef7de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9ed2084729d4ea0863298fcbf27155b', 'request_id': 'req-600a607d-edb8-445b-82e9-ffaa41bef7de'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:15:35.292334 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-600a607d-edb8-445b-82e9-ffaa41bef7de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9ed2084729d4ea0863298fcbf27155b', 'request_id': 'req-600a607d-edb8-445b-82e9-ffaa41bef7de'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:15:35.301598 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-600a607d-edb8-445b-82e9-ffaa41bef7de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9ed2084729d4ea0863298fcbf27155b', 'request_id': 'req-600a607d-edb8-445b-82e9-ffaa41bef7de'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:15:35.316795 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-600a607d-edb8-445b-82e9-ffaa41bef7de admin admin] The token cache is being invalidate because project a9ed2084729d4ea0863298fcbf27155b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:15:35.317088 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-600a607d-edb8-445b-82e9-ffaa41bef7de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:15:35.317834 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-600a607d-edb8-445b-82e9-ffaa41bef7de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:15:35.320142 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1214/2444] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:15:35 2022] DELETE /identity/v3/projects/a9ed2084729d4ea0863298fcbf27155b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:15:43.211370 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ea2df-260e-4cf3-8f17-98b9f0c47910 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:15:43.211836 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ea2df-260e-4cf3-8f17-98b9f0c47910 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:15:43.211948 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ea2df-260e-4cf3-8f17-98b9f0c47910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:15:43.230767 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-981ea2df-260e-4cf3-8f17-98b9f0c47910 None None] MFA Rules not processed for user `03e7f908f0a7499792e59e31d497edb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:15:43.231914 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-981ea2df-260e-4cf3-8f17-98b9f0c47910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:15:43.292520 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1231/2445] 10.222.0.49 () {58 vars in 967 bytes} [Mon Jul 4 04:15:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:15:43.305541 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a607d-edb8-445b-82e9-ffaa41bef7de admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:15:43.307079 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-600a607d-edb8-445b-82e9-ffaa41bef7de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:15:43.376107 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a607d-edb8-445b-82e9-ffaa41bef7de admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:15:43.381285 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f934dd-e1f4-48be-8176-7b2b5e46e932 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f93fdc98ff425791da3e2194b3a671', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:15:43.381928 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f934dd-e1f4-48be-8176-7b2b5e46e932 service swift] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:15:43.382242 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f934dd-e1f4-48be-8176-7b2b5e46e932 service swift] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:15:43.382515 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f934dd-e1f4-48be-8176-7b2b5e46e932 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:15:43.390848 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f934dd-e1f4-48be-8176-7b2b5e46e932 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:15:43.392446 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f934dd-e1f4-48be-8176-7b2b5e46e932 service swift] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:15:43.400323 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1215/2446] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Jul 4 04:15:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 04:15:53.284523 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:15:53.397342 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:15:54.611168 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b0fc5-25f1-4174-a89f-0f36b239ae46 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:15:54.611718 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b0fc5-25f1-4174-a89f-0f36b239ae46 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:15:54.611718 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b0fc5-25f1-4174-a89f-0f36b239ae46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:15:54.629876 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-c35b0fc5-25f1-4174-a89f-0f36b239ae46 None None] MFA Rules not processed for user `2648301ff6d24e14a2b0b8e34f742c9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:15:54.631123 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c35b0fc5-25f1-4174-a89f-0f36b239ae46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:15:54.694401 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1232/2447] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:15:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:16:04.687532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=25 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:16:09.000561 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f934dd-e1f4-48be-8176-7b2b5e46e932 service swift] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:16:09.002246 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-96f934dd-e1f4-48be-8176-7b2b5e46e932 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:16:09.064918 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f934dd-e1f4-48be-8176-7b2b5e46e932 service swift] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:16:09.069032 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a348d-c0e0-41b9-8329-3a15da88fa27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:16:09.069678 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a348d-c0e0-41b9-8329-3a15da88fa27 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:16:09.069967 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a348d-c0e0-41b9-8329-3a15da88fa27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:16:09.070273 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a348d-c0e0-41b9-8329-3a15da88fa27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:16:09.072179 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-724a348d-c0e0-41b9-8329-3a15da88fa27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:16:09.147201 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724a348d-c0e0-41b9-8329-3a15da88fa27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:16:09.148663 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724a348d-c0e0-41b9-8329-3a15da88fa27 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:16:09.159834 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1216/2448] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:16:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:16:10.586026 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b0fc5-25f1-4174-a89f-0f36b239ae46 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:16:10.587715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c35b0fc5-25f1-4174-a89f-0f36b239ae46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:16:10.651245 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b0fc5-25f1-4174-a89f-0f36b239ae46 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:16:10.660553 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62621d-397e-43c1-8433-48c822a9cd05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:16:10.661228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62621d-397e-43c1-8433-48c822a9cd05 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:16:10.661510 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62621d-397e-43c1-8433-48c822a9cd05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:16:10.661792 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62621d-397e-43c1-8433-48c822a9cd05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:16:10.663829 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-be62621d-397e-43c1-8433-48c822a9cd05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:16:10.679734 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62621d-397e-43c1-8433-48c822a9cd05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:16:10.681205 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62621d-397e-43c1-8433-48c822a9cd05 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:16:10.692638 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1233/2449] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:16:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:16:19.154790 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=54 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:16:20.687584 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=26 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:16:20.934847 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a348d-c0e0-41b9-8329-3a15da88fa27 service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:16:20.936213 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-724a348d-c0e0-41b9-8329-3a15da88fa27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:16:20.951009 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a348d-c0e0-41b9-8329-3a15da88fa27 service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:16:20.956694 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f9d1b-b291-46e8-ae84-dd0d821b9690 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:16:20.957344 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f9d1b-b291-46e8-ae84-dd0d821b9690 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:16:20.957645 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f9d1b-b291-46e8-ae84-dd0d821b9690 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:16:20.957928 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f9d1b-b291-46e8-ae84-dd0d821b9690 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:16:20.959752 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-616f9d1b-b291-46e8-ae84-dd0d821b9690 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:16:21.020529 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f9d1b-b291-46e8-ae84-dd0d821b9690 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:16:21.022193 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f9d1b-b291-46e8-ae84-dd0d821b9690 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:16:21.031629 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1217/2450] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:16:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:16:22.578795 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f0c40-9f97-4fee-8762-d966f4d11420 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:16:22.579331 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f0c40-9f97-4fee-8762-d966f4d11420 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:16:22.579437 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f0c40-9f97-4fee-8762-d966f4d11420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:16:22.597427 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-463f0c40-9f97-4fee-8762-d966f4d11420 None None] MFA Rules not processed for user `c8ada8b86e2f4ad18c8af021def1a30e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:16:22.598688 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-463f0c40-9f97-4fee-8762-d966f4d11420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:16:22.606503 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1234/2451] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:16:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:16:31.027414 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=28 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:16:32.592115 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:16:46.916255 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f9d1b-b291-46e8-ae84-dd0d821b9690 service nova] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:16:46.917985 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-616f9d1b-b291-46e8-ae84-dd0d821b9690 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:16:46.933306 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f9d1b-b291-46e8-ae84-dd0d821b9690 service nova] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:16:46.937445 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc724100-b0f3-4798-a2b4-16506ce6ed4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:16:46.938144 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc724100-b0f3-4798-a2b4-16506ce6ed4a service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:16:46.938446 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc724100-b0f3-4798-a2b4-16506ce6ed4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:16:46.938741 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc724100-b0f3-4798-a2b4-16506ce6ed4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:16:46.940917 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-bc724100-b0f3-4798-a2b4-16506ce6ed4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:16:46.951454 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc724100-b0f3-4798-a2b4-16506ce6ed4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:16:46.953006 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc724100-b0f3-4798-a2b4-16506ce6ed4a service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:16:46.962086 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1218/2452] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:16:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:16:50.276407 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f0c40-9f97-4fee-8762-d966f4d11420 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:16:50.277814 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-463f0c40-9f97-4fee-8762-d966f4d11420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:16:50.350261 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f0c40-9f97-4fee-8762-d966f4d11420 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:16:50.357102 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a446c2-ef97-4980-ad22-a7ed2f1cd017 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a18591461343c3a0a1b0e317734ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:16:50.357756 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a446c2-ef97-4980-ad22-a7ed2f1cd017 service placement] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:16:50.358037 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a446c2-ef97-4980-ad22-a7ed2f1cd017 service placement] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:16:50.358343 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a446c2-ef97-4980-ad22-a7ed2f1cd017 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:16:50.360330 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a3a446c2-ef97-4980-ad22-a7ed2f1cd017 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:16:50.371667 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a446c2-ef97-4980-ad22-a7ed2f1cd017 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:16:50.373271 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a446c2-ef97-4980-ad22-a7ed2f1cd017 service placement] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:16:50.383388 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1235/2453] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:16:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:16:52.016927 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc724100-b0f3-4798-a2b4-16506ce6ed4a service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:16:52.018824 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-bc724100-b0f3-4798-a2b4-16506ce6ed4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:16:52.036370 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc724100-b0f3-4798-a2b4-16506ce6ed4a service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:16:52.042389 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d4df9-dae6-4893-9617-72251bbc81a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:16:52.043066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d4df9-dae6-4893-9617-72251bbc81a3 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:16:52.043373 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d4df9-dae6-4893-9617-72251bbc81a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:16:52.043666 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d4df9-dae6-4893-9617-72251bbc81a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:16:52.045729 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-836d4df9-dae6-4893-9617-72251bbc81a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:16:52.107381 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d4df9-dae6-4893-9617-72251bbc81a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:16:52.109008 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d4df9-dae6-4893-9617-72251bbc81a3 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:16:52.118835 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1219/2454] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:16:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:16:58.382483 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a446c2-ef97-4980-ad22-a7ed2f1cd017 service placement] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:16:58.395669 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a446c2-ef97-4980-ad22-a7ed2f1cd017 service placement] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:16:58.402930 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48fb5fc-01fd-4798-9ccc-f67a23e510c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:16:58.403662 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fb5fc-01fd-4798-9ccc-f67a23e510c8 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:16:58.404040 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fb5fc-01fd-4798-9ccc-f67a23e510c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:16:58.404402 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fb5fc-01fd-4798-9ccc-f67a23e510c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:16:58.406415 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d48fb5fc-01fd-4798-9ccc-f67a23e510c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:16:58.419544 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48fb5fc-01fd-4798-9ccc-f67a23e510c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:16:58.421163 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48fb5fc-01fd-4798-9ccc-f67a23e510c8 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:16:58.433258 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1236/2455] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:16:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:17:01.540372 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d4df9-dae6-4893-9617-72251bbc81a3 service nova] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:01.555838 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d4df9-dae6-4893-9617-72251bbc81a3 service nova] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:01.562122 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afc8df-40d5-49cc-a396-da5e33a8386d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:01.562841 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afc8df-40d5-49cc-a396-da5e33a8386d service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:01.563315 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afc8df-40d5-49cc-a396-da5e33a8386d service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:01.563765 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afc8df-40d5-49cc-a396-da5e33a8386d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:01.566065 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a4afc8df-40d5-49cc-a396-da5e33a8386d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:01.584429 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4afc8df-40d5-49cc-a396-da5e33a8386d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:01.586121 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4afc8df-40d5-49cc-a396-da5e33a8386d service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:01.599353 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1220/2456] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:17:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:17:02.491395 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48fb5fc-01fd-4798-9ccc-f67a23e510c8 service nova] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:02.501547 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48fb5fc-01fd-4798-9ccc-f67a23e510c8 service nova] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:02.506430 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bbf7a5-78bb-4f43-aa37-901993b33654 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:02.507156 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbf7a5-78bb-4f43-aa37-901993b33654 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:02.507420 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbf7a5-78bb-4f43-aa37-901993b33654 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:02.507701 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbf7a5-78bb-4f43-aa37-901993b33654 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:02.509882 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-44bbf7a5-78bb-4f43-aa37-901993b33654 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:02.521856 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bbf7a5-78bb-4f43-aa37-901993b33654 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:02.523404 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bbf7a5-78bb-4f43-aa37-901993b33654 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:02.532815 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1237/2457] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:17:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:17:04.635927 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c446c0-532d-4d3b-8132-efd782bc6f89 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:04.636448 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c446c0-532d-4d3b-8132-efd782bc6f89 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:04.636448 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c446c0-532d-4d3b-8132-efd782bc6f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:04.654849 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-49c446c0-532d-4d3b-8132-efd782bc6f89 None None] MFA Rules not processed for user `0be198ad83014acfab897498c2d68d7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:17:04.656063 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-49c446c0-532d-4d3b-8132-efd782bc6f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:04.663680 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1221/2458] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:17:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:17:04.978769 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bbf7a5-78bb-4f43-aa37-901993b33654 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:04.989004 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bbf7a5-78bb-4f43-aa37-901993b33654 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:04.993543 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873dfcc-1a93-4461-9a42-9ce77bc776a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:04.994197 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873dfcc-1a93-4461-9a42-9ce77bc776a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:04.994491 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873dfcc-1a93-4461-9a42-9ce77bc776a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:04.994784 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873dfcc-1a93-4461-9a42-9ce77bc776a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:04.996942 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f873dfcc-1a93-4461-9a42-9ce77bc776a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:05.007761 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873dfcc-1a93-4461-9a42-9ce77bc776a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:05.009203 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873dfcc-1a93-4461-9a42-9ce77bc776a4 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:05.017604 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1238/2459] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:17:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:17:09.732419 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c446c0-532d-4d3b-8132-efd782bc6f89 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:09.760229 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c446c0-532d-4d3b-8132-efd782bc6f89 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:09.768031 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5d80c-c203-41ae-9f87-9850fbc58bec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:09.769180 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5d80c-c203-41ae-9f87-9850fbc58bec service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:09.769673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5d80c-c203-41ae-9f87-9850fbc58bec service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:09.770179 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5d80c-c203-41ae-9f87-9850fbc58bec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:09.772402 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-67b5d80c-c203-41ae-9f87-9850fbc58bec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:09.791202 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5d80c-c203-41ae-9f87-9850fbc58bec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:09.793147 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5d80c-c203-41ae-9f87-9850fbc58bec service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:09.809935 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1222/2460] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:17:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:17:15.013636 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=50 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:19.802359 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=49 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:22.611096 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873dfcc-1a93-4461-9a42-9ce77bc776a4 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:22.620245 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873dfcc-1a93-4461-9a42-9ce77bc776a4 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:22.623976 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb980afe-3cd0-4aa1-bad3-6699ff18b4cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:22.624621 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb980afe-3cd0-4aa1-bad3-6699ff18b4cb service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:22.624911 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb980afe-3cd0-4aa1-bad3-6699ff18b4cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:22.625178 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb980afe-3cd0-4aa1-bad3-6699ff18b4cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:22.626997 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-bb980afe-3cd0-4aa1-bad3-6699ff18b4cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:22.691491 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb980afe-3cd0-4aa1-bad3-6699ff18b4cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:22.692953 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb980afe-3cd0-4aa1-bad3-6699ff18b4cb service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:22.704295 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1239/2461] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:17:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:17:25.877142 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5d80c-c203-41ae-9f87-9850fbc58bec service nova] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:25.878662 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-67b5d80c-c203-41ae-9f87-9850fbc58bec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:25.892934 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5d80c-c203-41ae-9f87-9850fbc58bec service nova] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:25.898113 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0b125-e9ff-4666-8604-10fab41833c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a18591461343c3a0a1b0e317734ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:25.898907 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0b125-e9ff-4666-8604-10fab41833c0 service placement] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:25.899254 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0b125-e9ff-4666-8604-10fab41833c0 service placement] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:25.899597 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0b125-e9ff-4666-8604-10fab41833c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:25.901554 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-54a0b125-e9ff-4666-8604-10fab41833c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:25.916900 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0b125-e9ff-4666-8604-10fab41833c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:25.919278 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0b125-e9ff-4666-8604-10fab41833c0 service placement] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:25.932514 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1223/2462] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:17:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:17:25.946766 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb980afe-3cd0-4aa1-bad3-6699ff18b4cb service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:25.948579 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-bb980afe-3cd0-4aa1-bad3-6699ff18b4cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:25.969405 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb980afe-3cd0-4aa1-bad3-6699ff18b4cb service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:25.974425 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7aa405-3d38-48b4-85a6-c37adc21e5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:25.975377 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7aa405-3d38-48b4-85a6-c37adc21e5d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:25.975663 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7aa405-3d38-48b4-85a6-c37adc21e5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:25.975941 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7aa405-3d38-48b4-85a6-c37adc21e5d5 admin admin] PATH_INFO: `/v3/users/2648301ff6d24e14a2b0b8e34f742c9a` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:25.977141 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7aa405-3d38-48b4-85a6-c37adc21e5d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2648301ff6d24e14a2b0b8e34f742c9a)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:25.979253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7aa405-3d38-48b4-85a6-c37adc21e5d5 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:26.028660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1b7aa405-3d38-48b4-85a6-c37adc21e5d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2648301ff6d24e14a2b0b8e34f742c9a'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:26.041769 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1b7aa405-3d38-48b4-85a6-c37adc21e5d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2648301ff6d24e14a2b0b8e34f742c9a'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:26.042440 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1b7aa405-3d38-48b4-85a6-c37adc21e5d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2648301ff6d24e14a2b0b8e34f742c9a'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:26.054605 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1b7aa405-3d38-48b4-85a6-c37adc21e5d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2648301ff6d24e14a2b0b8e34f742c9a'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:26.055243 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1b7aa405-3d38-48b4-85a6-c37adc21e5d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2648301ff6d24e14a2b0b8e34f742c9a'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:26.067943 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1240/2463] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:17:25 2022] DELETE /identity/v3/users/2648301ff6d24e14a2b0b8e34f742c9a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:17:26.249888 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0b125-e9ff-4666-8604-10fab41833c0 service placement] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:26.261475 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0b125-e9ff-4666-8604-10fab41833c0 service placement] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:26.324565 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818bd225-67a5-49c5-ae02-cc8f32c2d669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:26.325423 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bd225-67a5-49c5-ae02-cc8f32c2d669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:26.325710 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bd225-67a5-49c5-ae02-cc8f32c2d669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:26.325996 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bd225-67a5-49c5-ae02-cc8f32c2d669 admin admin] PATH_INFO: `/v3/projects/e055788ea40d45d6941ea382fff04c77` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:26.327262 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818bd225-67a5-49c5-ae02-cc8f32c2d669 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e055788ea40d45d6941ea382fff04c77)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:26.329194 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818bd225-67a5-49c5-ae02-cc8f32c2d669 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:26.378566 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-818bd225-67a5-49c5-ae02-cc8f32c2d669 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e055788ea40d45d6941ea382fff04c77', 'request_id': 'req-818bd225-67a5-49c5-ae02-cc8f32c2d669'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:26.384624 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-818bd225-67a5-49c5-ae02-cc8f32c2d669 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e055788ea40d45d6941ea382fff04c77', 'request_id': 'req-818bd225-67a5-49c5-ae02-cc8f32c2d669'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:26.391333 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-818bd225-67a5-49c5-ae02-cc8f32c2d669 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e055788ea40d45d6941ea382fff04c77', 'request_id': 'req-818bd225-67a5-49c5-ae02-cc8f32c2d669'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:26.406123 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-818bd225-67a5-49c5-ae02-cc8f32c2d669 admin admin] The token cache is being invalidate because project e055788ea40d45d6941ea382fff04c77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:17:26.406458 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-818bd225-67a5-49c5-ae02-cc8f32c2d669 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:26.407079 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-818bd225-67a5-49c5-ae02-cc8f32c2d669 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:26.408664 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1224/2464] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:17:26 2022] DELETE /identity/v3/projects/e055788ea40d45d6941ea382fff04c77 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:17:26.413714 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f387019-dea5-42b0-a4fe-318b64f0a1f6 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:26.414004 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f387019-dea5-42b0-a4fe-318b64f0a1f6 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:26.414312 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f387019-dea5-42b0-a4fe-318b64f0a1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:26.432596 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-5f387019-dea5-42b0-a4fe-318b64f0a1f6 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:17:26.433829 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-5f387019-dea5-42b0-a4fe-318b64f0a1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:26.495970 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1241/2465] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:17:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:17:26.503776 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f98fb2-2583-43e5-a024-c4a9b8752b6d None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:26.504066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f98fb2-2583-43e5-a024-c4a9b8752b6d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:26.504348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f98fb2-2583-43e5-a024-c4a9b8752b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:26.523261 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-23f98fb2-2583-43e5-a024-c4a9b8752b6d None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:17:26.524488 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-23f98fb2-2583-43e5-a024-c4a9b8752b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:26.532838 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1225/2466] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:17:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:17:26.536964 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f387019-dea5-42b0-a4fe-318b64f0a1f6 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:26.546959 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f387019-dea5-42b0-a4fe-318b64f0a1f6 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:26.554130 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38044d4-6899-4801-8779-455ecdb1dadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:26.554824 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38044d4-6899-4801-8779-455ecdb1dadd admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:26.555112 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38044d4-6899-4801-8779-455ecdb1dadd admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:26.555396 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38044d4-6899-4801-8779-455ecdb1dadd admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:26.556175 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38044d4-6899-4801-8779-455ecdb1dadd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:17:26.556542 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38044d4-6899-4801-8779-455ecdb1dadd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:26.558446 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38044d4-6899-4801-8779-455ecdb1dadd admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:26.559983 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:26.575226 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1242/2467] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:17:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:17:26.576356 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f98fb2-2583-43e5-a024-c4a9b8752b6d None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:26.586046 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f98fb2-2583-43e5-a024-c4a9b8752b6d None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:26.591012 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b8075-f4de-4407-b5ae-0caded497680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:26.591662 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b8075-f4de-4407-b5ae-0caded497680 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:26.591941 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b8075-f4de-4407-b5ae-0caded497680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:26.592219 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b8075-f4de-4407-b5ae-0caded497680 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:26.593333 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b8075-f4de-4407-b5ae-0caded497680 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:26.595364 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b8075-f4de-4407-b5ae-0caded497680 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:26.634468 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1226/2468] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:17:26 2022] POST /identity/v3/projects => generated 355 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:17:26.639240 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38044d4-6899-4801-8779-455ecdb1dadd admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:26.651377 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38044d4-6899-4801-8779-455ecdb1dadd admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:26.707399 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52fa71f-d06a-43d3-a32d-50c08fe27d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:26.708073 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fa71f-d06a-43d3-a32d-50c08fe27d20 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:26.708366 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fa71f-d06a-43d3-a32d-50c08fe27d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:26.708681 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fa71f-d06a-43d3-a32d-50c08fe27d20 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:26.709377 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52fa71f-d06a-43d3-a32d-50c08fe27d20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:26.711363 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52fa71f-d06a-43d3-a32d-50c08fe27d20 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:26.736769 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1243/2469] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:17:26 2022] POST /identity/v3/users => generated 278 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:17:26.738660 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b8075-f4de-4407-b5ae-0caded497680 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:26.750318 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b8075-f4de-4407-b5ae-0caded497680 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:26.755297 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e636c2-6fcb-40b1-84b8-5129f13b49cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:26.755982 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e636c2-6fcb-40b1-84b8-5129f13b49cb admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:26.756266 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e636c2-6fcb-40b1-84b8-5129f13b49cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:26.756540 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e636c2-6fcb-40b1-84b8-5129f13b49cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:26.757271 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e636c2-6fcb-40b1-84b8-5129f13b49cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:26.758991 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e636c2-6fcb-40b1-84b8-5129f13b49cb admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:26.776154 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1227/2470] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:17:26.782783 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52fa71f-d06a-43d3-a32d-50c08fe27d20 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:26.798326 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52fa71f-d06a-43d3-a32d-50c08fe27d20 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:26.804999 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fbb30-c695-4c4a-9e12-f87a5c3a401f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:26.805914 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fbb30-c695-4c4a-9e12-f87a5c3a401f admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:26.806297 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fbb30-c695-4c4a-9e12-f87a5c3a401f admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:26.806615 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fbb30-c695-4c4a-9e12-f87a5c3a401f admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:26.807693 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8fbb30-c695-4c4a-9e12-f87a5c3a401f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:26.809969 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8fbb30-c695-4c4a-9e12-f87a5c3a401f admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:26.824279 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1244/2471] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:17:26.829371 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e636c2-6fcb-40b1-84b8-5129f13b49cb admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:26.840447 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e636c2-6fcb-40b1-84b8-5129f13b49cb admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:26.846864 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c08da6-9494-41c2-9562-a02242443190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:26.847755 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c08da6-9494-41c2-9562-a02242443190 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:26.848042 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c08da6-9494-41c2-9562-a02242443190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:26.848322 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c08da6-9494-41c2-9562-a02242443190 admin admin] PATH_INFO: `/v3/projects/fae5661546d5476cbb8fdcf6aa4d8d84/users/c96635436a77423898f1d491af6e1118/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:26.866272 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c08da6-9494-41c2-9562-a02242443190 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fae5661546d5476cbb8fdcf6aa4d8d84, user_id=c96635436a77423898f1d491af6e1118, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:26.868966 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c08da6-9494-41c2-9562-a02242443190 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:26.884220 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1228/2472] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:17:26 2022] PUT /identity/v3/projects/fae5661546d5476cbb8fdcf6aa4d8d84/users/c96635436a77423898f1d491af6e1118/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:17:26.895519 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00b7f3-a581-496d-8709-e1310b8216b5 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:26.895827 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00b7f3-a581-496d-8709-e1310b8216b5 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:26.896438 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00b7f3-a581-496d-8709-e1310b8216b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:26.923488 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-6b00b7f3-a581-496d-8709-e1310b8216b5 None None] MFA Rules not processed for user `c96635436a77423898f1d491af6e1118`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:17:26.924700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6b00b7f3-a581-496d-8709-e1310b8216b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:26.993535 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1245/2473] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:17:26 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:17:26.998465 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c08da6-9494-41c2-9562-a02242443190 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:27.004661 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:27.074006 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c08da6-9494-41c2-9562-a02242443190 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:27.081226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49edd92-acae-4ffc-80d7-9f0eb335c2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:27.082204 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49edd92-acae-4ffc-80d7-9f0eb335c2f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:27.082602 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49edd92-acae-4ffc-80d7-9f0eb335c2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:27.082976 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49edd92-acae-4ffc-80d7-9f0eb335c2f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:27.083927 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49edd92-acae-4ffc-80d7-9f0eb335c2f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:27.086910 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49edd92-acae-4ffc-80d7-9f0eb335c2f5 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:27.117898 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1229/2474] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:17:26 2022] POST /identity/v3/projects => generated 357 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:17:27.123688 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00b7f3-a581-496d-8709-e1310b8216b5 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:27.135285 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00b7f3-a581-496d-8709-e1310b8216b5 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:27.193180 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8586ff-c64e-4c73-8b43-fc6fae9ed4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:27.193848 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8586ff-c64e-4c73-8b43-fc6fae9ed4a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:27.194139 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8586ff-c64e-4c73-8b43-fc6fae9ed4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:27.194455 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8586ff-c64e-4c73-8b43-fc6fae9ed4a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:27.195172 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8586ff-c64e-4c73-8b43-fc6fae9ed4a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:27.197106 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8586ff-c64e-4c73-8b43-fc6fae9ed4a7 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:27.207164 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:27.221527 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1246/2475] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:17:27 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 04:17:27.225569 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49edd92-acae-4ffc-80d7-9f0eb335c2f5 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:27.237394 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49edd92-acae-4ffc-80d7-9f0eb335c2f5 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:27.243013 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9999e1-977d-403b-92b1-8e8c916b9ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:27.243706 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9999e1-977d-403b-92b1-8e8c916b9ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:27.243997 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9999e1-977d-403b-92b1-8e8c916b9ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:27.244271 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9999e1-977d-403b-92b1-8e8c916b9ef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:27.245024 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9999e1-977d-403b-92b1-8e8c916b9ef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:27.246727 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9999e1-977d-403b-92b1-8e8c916b9ef7 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:27.257730 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1230/2476] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:17:27.262111 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8586ff-c64e-4c73-8b43-fc6fae9ed4a7 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:27.272595 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8586ff-c64e-4c73-8b43-fc6fae9ed4a7 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:27.277793 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100275a-ca55-4140-ba70-a3e6a22e80f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:27.278728 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100275a-ca55-4140-ba70-a3e6a22e80f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:27.279020 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100275a-ca55-4140-ba70-a3e6a22e80f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:27.279303 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100275a-ca55-4140-ba70-a3e6a22e80f3 admin admin] PATH_INFO: `/v3/projects/2e8dad2cbf3d42b6adcab7703c6ee76c/users/4934ad9b9d264ad78b20c9ee72840664/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:27.294906 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100275a-ca55-4140-ba70-a3e6a22e80f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e8dad2cbf3d42b6adcab7703c6ee76c, user_id=4934ad9b9d264ad78b20c9ee72840664, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:27.297674 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100275a-ca55-4140-ba70-a3e6a22e80f3 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:27.313799 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1247/2477] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:17:27 2022] PUT /identity/v3/projects/2e8dad2cbf3d42b6adcab7703c6ee76c/users/4934ad9b9d264ad78b20c9ee72840664/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:17:27.318195 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9999e1-977d-403b-92b1-8e8c916b9ef7 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:27.329697 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9999e1-977d-403b-92b1-8e8c916b9ef7 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:27.389418 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc4e61-aa1f-48fd-8573-7784c8465778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:27.390114 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc4e61-aa1f-48fd-8573-7784c8465778 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:27.390434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc4e61-aa1f-48fd-8573-7784c8465778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:27.390726 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc4e61-aa1f-48fd-8573-7784c8465778 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:27.391462 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc4e61-aa1f-48fd-8573-7784c8465778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:27.393092 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc4e61-aa1f-48fd-8573-7784c8465778 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:27.405769 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1231/2478] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:17:27.407561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100275a-ca55-4140-ba70-a3e6a22e80f3 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:27.418282 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100275a-ca55-4140-ba70-a3e6a22e80f3 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:27.424191 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6803e9-fde1-41f1-a12f-1c42ca60ab20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:27.425092 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6803e9-fde1-41f1-a12f-1c42ca60ab20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:27.425403 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6803e9-fde1-41f1-a12f-1c42ca60ab20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:27.425678 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6803e9-fde1-41f1-a12f-1c42ca60ab20 admin admin] PATH_INFO: `/v3/projects/2e8dad2cbf3d42b6adcab7703c6ee76c/users/4934ad9b9d264ad78b20c9ee72840664/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:27.428006 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6803e9-fde1-41f1-a12f-1c42ca60ab20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e8dad2cbf3d42b6adcab7703c6ee76c, user_id=4934ad9b9d264ad78b20c9ee72840664, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:27.430724 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6803e9-fde1-41f1-a12f-1c42ca60ab20 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:27.441606 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1248/2479] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:17:27 2022] PUT /identity/v3/projects/2e8dad2cbf3d42b6adcab7703c6ee76c/users/4934ad9b9d264ad78b20c9ee72840664/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 04:17:27.451824 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35885a64-d576-476a-8b29-1fa02012487b None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:27.452056 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35885a64-d576-476a-8b29-1fa02012487b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:27.452335 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35885a64-d576-476a-8b29-1fa02012487b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:27.479017 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-35885a64-d576-476a-8b29-1fa02012487b None None] MFA Rules not processed for user `4934ad9b9d264ad78b20c9ee72840664`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:17:27.480535 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-35885a64-d576-476a-8b29-1fa02012487b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:27.547634 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:27.551698 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1232/2480] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:17:27 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:17:27.563105 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6803e9-fde1-41f1-a12f-1c42ca60ab20 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:27.565084 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-bb6803e9-fde1-41f1-a12f-1c42ca60ab20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:27.623947 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6803e9-fde1-41f1-a12f-1c42ca60ab20 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:27.628033 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927942dd-e2b4-451d-b96f-6421eaa5b8da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:27.628733 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927942dd-e2b4-451d-b96f-6421eaa5b8da service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:27.628956 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927942dd-e2b4-451d-b96f-6421eaa5b8da service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:27.629267 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927942dd-e2b4-451d-b96f-6421eaa5b8da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:27.640702 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927942dd-e2b4-451d-b96f-6421eaa5b8da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:27.642369 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927942dd-e2b4-451d-b96f-6421eaa5b8da service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:27.652257 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1249/2481] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:17:27 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:17:27.729376 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35885a64-d576-476a-8b29-1fa02012487b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:27.739994 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35885a64-d576-476a-8b29-1fa02012487b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:27.744122 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d1de9-0e8d-4ba0-852a-909631eb9ca4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:27.744800 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d1de9-0e8d-4ba0-852a-909631eb9ca4 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:27.745090 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d1de9-0e8d-4ba0-852a-909631eb9ca4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:27.745367 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d1de9-0e8d-4ba0-852a-909631eb9ca4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:27.811820 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d1de9-0e8d-4ba0-852a-909631eb9ca4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:27.813226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d1de9-0e8d-4ba0-852a-909631eb9ca4 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:27.822889 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1233/2482] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:17:27 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:17:37.647859 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:INSERT=4,keystone:SELECT=43 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:37.818723 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=28 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:42.907291 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927942dd-e2b4-451d-b96f-6421eaa5b8da service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:42.971048 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927942dd-e2b4-451d-b96f-6421eaa5b8da service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:42.978419 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517de110-91c0-4962-83a1-128dc7b3aa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:42.980078 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517de110-91c0-4962-83a1-128dc7b3aa29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:42.980513 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517de110-91c0-4962-83a1-128dc7b3aa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:42.980936 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517de110-91c0-4962-83a1-128dc7b3aa29 admin admin] PATH_INFO: `/v3/users/c96635436a77423898f1d491af6e1118` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:42.982678 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517de110-91c0-4962-83a1-128dc7b3aa29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c96635436a77423898f1d491af6e1118)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:42.984630 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517de110-91c0-4962-83a1-128dc7b3aa29 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:43.033351 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-517de110-91c0-4962-83a1-128dc7b3aa29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c96635436a77423898f1d491af6e1118'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:43.041484 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-517de110-91c0-4962-83a1-128dc7b3aa29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c96635436a77423898f1d491af6e1118'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:43.042280 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-517de110-91c0-4962-83a1-128dc7b3aa29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c96635436a77423898f1d491af6e1118'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:43.054909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-517de110-91c0-4962-83a1-128dc7b3aa29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c96635436a77423898f1d491af6e1118'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:43.055558 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-517de110-91c0-4962-83a1-128dc7b3aa29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c96635436a77423898f1d491af6e1118'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:43.068450 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1250/2483] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:17:42 2022] DELETE /identity/v3/users/c96635436a77423898f1d491af6e1118 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:17:43.073206 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1533ba-1aed-4746-8ed5-4d76d8bd3dae None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:43.073721 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1533ba-1aed-4746-8ed5-4d76d8bd3dae None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:43.073721 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1533ba-1aed-4746-8ed5-4d76d8bd3dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:43.092130 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-6a1533ba-1aed-4746-8ed5-4d76d8bd3dae None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:17:43.093345 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6a1533ba-1aed-4746-8ed5-4d76d8bd3dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:43.155025 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1234/2484] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:17:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:17:43.164711 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517de110-91c0-4962-83a1-128dc7b3aa29 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:43.166266 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-517de110-91c0-4962-83a1-128dc7b3aa29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:43.229963 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517de110-91c0-4962-83a1-128dc7b3aa29 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:43.234176 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7018a-1059-4b14-8da2-7d5dd6e5e959 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:43.234850 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7018a-1059-4b14-8da2-7d5dd6e5e959 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:43.235136 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7018a-1059-4b14-8da2-7d5dd6e5e959 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:43.235417 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7018a-1059-4b14-8da2-7d5dd6e5e959 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:43.247067 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7018a-1059-4b14-8da2-7d5dd6e5e959 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:43.249078 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7018a-1059-4b14-8da2-7d5dd6e5e959 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:43.259567 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1251/2485] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:17:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:17:43.532931 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1533ba-1aed-4746-8ed5-4d76d8bd3dae None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:43.534473 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6a1533ba-1aed-4746-8ed5-4d76d8bd3dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:43.548423 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1533ba-1aed-4746-8ed5-4d76d8bd3dae None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:43.554052 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8d1f7-017a-45c6-8231-bc5372fefcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:43.555832 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8d1f7-017a-45c6-8231-bc5372fefcdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:43.556183 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8d1f7-017a-45c6-8231-bc5372fefcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:43.556390 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8d1f7-017a-45c6-8231-bc5372fefcdb admin admin] PATH_INFO: `/v3/projects/fae5661546d5476cbb8fdcf6aa4d8d84` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:43.557742 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8d1f7-017a-45c6-8231-bc5372fefcdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=fae5661546d5476cbb8fdcf6aa4d8d84)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:43.559652 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8d1f7-017a-45c6-8231-bc5372fefcdb admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:43.610906 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f9a8d1f7-017a-45c6-8231-bc5372fefcdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fae5661546d5476cbb8fdcf6aa4d8d84', 'request_id': 'req-f9a8d1f7-017a-45c6-8231-bc5372fefcdb'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:43.617343 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f9a8d1f7-017a-45c6-8231-bc5372fefcdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fae5661546d5476cbb8fdcf6aa4d8d84', 'request_id': 'req-f9a8d1f7-017a-45c6-8231-bc5372fefcdb'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:43.623759 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f9a8d1f7-017a-45c6-8231-bc5372fefcdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fae5661546d5476cbb8fdcf6aa4d8d84', 'request_id': 'req-f9a8d1f7-017a-45c6-8231-bc5372fefcdb'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:43.637644 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f9a8d1f7-017a-45c6-8231-bc5372fefcdb admin admin] The token cache is being invalidate because project fae5661546d5476cbb8fdcf6aa4d8d84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:17:43.637933 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f9a8d1f7-017a-45c6-8231-bc5372fefcdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:43.638740 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f9a8d1f7-017a-45c6-8231-bc5372fefcdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:43.640315 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1235/2486] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:17:43 2022] DELETE /identity/v3/projects/fae5661546d5476cbb8fdcf6aa4d8d84 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:17:43.644394 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7018a-1059-4b14-8da2-7d5dd6e5e959 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:43.654109 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7018a-1059-4b14-8da2-7d5dd6e5e959 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:43.672039 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:43.711688 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc2e39-5505-4393-a419-622dcc42a596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:43.712567 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc2e39-5505-4393-a419-622dcc42a596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:43.712853 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc2e39-5505-4393-a419-622dcc42a596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:43.713132 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc2e39-5505-4393-a419-622dcc42a596 admin admin] PATH_INFO: `/v3/users/4934ad9b9d264ad78b20c9ee72840664` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:43.714362 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc2e39-5505-4393-a419-622dcc42a596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4934ad9b9d264ad78b20c9ee72840664)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:43.716333 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc2e39-5505-4393-a419-622dcc42a596 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:43.770735 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-cbbc2e39-5505-4393-a419-622dcc42a596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4934ad9b9d264ad78b20c9ee72840664'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:43.779173 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-cbbc2e39-5505-4393-a419-622dcc42a596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4934ad9b9d264ad78b20c9ee72840664'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:43.779827 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-cbbc2e39-5505-4393-a419-622dcc42a596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4934ad9b9d264ad78b20c9ee72840664'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:43.792865 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-cbbc2e39-5505-4393-a419-622dcc42a596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4934ad9b9d264ad78b20c9ee72840664'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:43.793511 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-cbbc2e39-5505-4393-a419-622dcc42a596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4934ad9b9d264ad78b20c9ee72840664'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:43.806228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1252/2487] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:17:43 2022] DELETE /identity/v3/users/4934ad9b9d264ad78b20c9ee72840664 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:17:44.084553 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8d1f7-017a-45c6-8231-bc5372fefcdb admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:44.086094 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f9a8d1f7-017a-45c6-8231-bc5372fefcdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:44.100918 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8d1f7-017a-45c6-8231-bc5372fefcdb admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:44.161204 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad0b0c-dcf5-4b2c-be11-217fd5f529d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:44.162071 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad0b0c-dcf5-4b2c-be11-217fd5f529d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:44.162409 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad0b0c-dcf5-4b2c-be11-217fd5f529d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:44.162687 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad0b0c-dcf5-4b2c-be11-217fd5f529d7 admin admin] PATH_INFO: `/v3/projects/2e8dad2cbf3d42b6adcab7703c6ee76c` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:44.163921 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad0b0c-dcf5-4b2c-be11-217fd5f529d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e8dad2cbf3d42b6adcab7703c6ee76c)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:44.165871 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad0b0c-dcf5-4b2c-be11-217fd5f529d7 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:44.198942 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:44.216273 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d4ad0b0c-dcf5-4b2c-be11-217fd5f529d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e8dad2cbf3d42b6adcab7703c6ee76c', 'request_id': 'req-d4ad0b0c-dcf5-4b2c-be11-217fd5f529d7'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:44.222182 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d4ad0b0c-dcf5-4b2c-be11-217fd5f529d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e8dad2cbf3d42b6adcab7703c6ee76c', 'request_id': 'req-d4ad0b0c-dcf5-4b2c-be11-217fd5f529d7'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:44.229352 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d4ad0b0c-dcf5-4b2c-be11-217fd5f529d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e8dad2cbf3d42b6adcab7703c6ee76c', 'request_id': 'req-d4ad0b0c-dcf5-4b2c-be11-217fd5f529d7'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:44.244585 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d4ad0b0c-dcf5-4b2c-be11-217fd5f529d7 admin admin] The token cache is being invalidate because project 2e8dad2cbf3d42b6adcab7703c6ee76c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:17:44.244880 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d4ad0b0c-dcf5-4b2c-be11-217fd5f529d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:44.245554 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d4ad0b0c-dcf5-4b2c-be11-217fd5f529d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:44.247187 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1236/2488] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:17:44 2022] DELETE /identity/v3/projects/2e8dad2cbf3d42b6adcab7703c6ee76c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:17:44.252201 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6846201-c00e-49fa-8d2c-fc69f6b395a5 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:44.252707 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6846201-c00e-49fa-8d2c-fc69f6b395a5 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:44.252821 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6846201-c00e-49fa-8d2c-fc69f6b395a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:44.270954 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-a6846201-c00e-49fa-8d2c-fc69f6b395a5 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:17:44.272161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a6846201-c00e-49fa-8d2c-fc69f6b395a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:44.333650 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1253/2489] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:17:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:17:44.342734 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba0f9a-a2f9-451b-b076-fcc817f8b08d None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:44.343033 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba0f9a-a2f9-451b-b076-fcc817f8b08d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:44.343313 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba0f9a-a2f9-451b-b076-fcc817f8b08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:44.363774 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-d4ba0f9a-a2f9-451b-b076-fcc817f8b08d None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:17:44.364982 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d4ba0f9a-a2f9-451b-b076-fcc817f8b08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:44.374268 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1237/2490] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:17:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:17:44.378640 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6846201-c00e-49fa-8d2c-fc69f6b395a5 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:44.389367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6846201-c00e-49fa-8d2c-fc69f6b395a5 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:44.395280 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db197ea8-b438-4cf2-9d3b-84ae7ebe6711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:44.395934 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db197ea8-b438-4cf2-9d3b-84ae7ebe6711 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:44.396217 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db197ea8-b438-4cf2-9d3b-84ae7ebe6711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:44.396489 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db197ea8-b438-4cf2-9d3b-84ae7ebe6711 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:44.397217 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db197ea8-b438-4cf2-9d3b-84ae7ebe6711 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:17:44.397520 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db197ea8-b438-4cf2-9d3b-84ae7ebe6711 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:44.399223 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db197ea8-b438-4cf2-9d3b-84ae7ebe6711 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:44.411625 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1254/2491] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:17:44.415861 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba0f9a-a2f9-451b-b076-fcc817f8b08d None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:44.425600 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba0f9a-a2f9-451b-b076-fcc817f8b08d None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:44.430787 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204e3ea-80bc-4090-89ae-7bdef7c8775d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:44.431437 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204e3ea-80bc-4090-89ae-7bdef7c8775d admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:44.431726 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204e3ea-80bc-4090-89ae-7bdef7c8775d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:44.432006 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204e3ea-80bc-4090-89ae-7bdef7c8775d admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:44.432696 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204e3ea-80bc-4090-89ae-7bdef7c8775d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:44.434689 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204e3ea-80bc-4090-89ae-7bdef7c8775d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:44.462768 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1238/2492] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:17:44 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:17:44.467231 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db197ea8-b438-4cf2-9d3b-84ae7ebe6711 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:44.477330 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db197ea8-b438-4cf2-9d3b-84ae7ebe6711 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:44.505269 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:44.537546 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dea3e6-653e-4e13-ace5-85d86fc8ce89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:44.538213 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dea3e6-653e-4e13-ace5-85d86fc8ce89 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:44.538528 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dea3e6-653e-4e13-ace5-85d86fc8ce89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:44.538808 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dea3e6-653e-4e13-ace5-85d86fc8ce89 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:44.539513 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dea3e6-653e-4e13-ace5-85d86fc8ce89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:44.541505 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dea3e6-653e-4e13-ace5-85d86fc8ce89 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:44.565507 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1255/2493] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:17:44 2022] POST /identity/v3/users => generated 284 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:17:44.568814 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204e3ea-80bc-4090-89ae-7bdef7c8775d admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:44.579239 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204e3ea-80bc-4090-89ae-7bdef7c8775d admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:44.584201 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8a319-09a2-4d74-98ee-790f413aa19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:44.584883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8a319-09a2-4d74-98ee-790f413aa19a admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:44.585177 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8a319-09a2-4d74-98ee-790f413aa19a admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:44.585461 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8a319-09a2-4d74-98ee-790f413aa19a admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:44.586250 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8a319-09a2-4d74-98ee-790f413aa19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:44.587891 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8a319-09a2-4d74-98ee-790f413aa19a admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:44.599796 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1239/2494] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:17:44.604628 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dea3e6-653e-4e13-ace5-85d86fc8ce89 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:44.615637 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dea3e6-653e-4e13-ace5-85d86fc8ce89 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:44.621543 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd6842-e943-450f-be62-6d8885823f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:44.622291 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd6842-e943-450f-be62-6d8885823f09 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:44.622598 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd6842-e943-450f-be62-6d8885823f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:44.622884 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd6842-e943-450f-be62-6d8885823f09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:44.623643 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd6842-e943-450f-be62-6d8885823f09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:44.625287 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd6842-e943-450f-be62-6d8885823f09 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:44.636274 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1256/2495] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:17:44.640405 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8a319-09a2-4d74-98ee-790f413aa19a admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:44.652866 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8a319-09a2-4d74-98ee-790f413aa19a admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:44.658628 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022216c-d916-4e95-be4a-06af79f0fdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:44.659538 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022216c-d916-4e95-be4a-06af79f0fdb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:44.659821 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022216c-d916-4e95-be4a-06af79f0fdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:44.660098 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022216c-d916-4e95-be4a-06af79f0fdb8 admin admin] PATH_INFO: `/v3/projects/f3a14f22b56b41db8dbf47aa6bbd3bf1/users/eafc6dc8c89144fe81082ba3b370ea4a/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:44.677252 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022216c-d916-4e95-be4a-06af79f0fdb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3a14f22b56b41db8dbf47aa6bbd3bf1, user_id=eafc6dc8c89144fe81082ba3b370ea4a, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:44.680046 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022216c-d916-4e95-be4a-06af79f0fdb8 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:44.696273 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1240/2496] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:17:44 2022] PUT /identity/v3/projects/f3a14f22b56b41db8dbf47aa6bbd3bf1/users/eafc6dc8c89144fe81082ba3b370ea4a/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:17:44.708258 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fdfa5-d998-4d16-9a8a-7a3c02a3554f None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:44.708569 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fdfa5-d998-4d16-9a8a-7a3c02a3554f None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:44.708866 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fdfa5-d998-4d16-9a8a-7a3c02a3554f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:44.735915 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-975fdfa5-d998-4d16-9a8a-7a3c02a3554f None None] MFA Rules not processed for user `eafc6dc8c89144fe81082ba3b370ea4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:17:44.737080 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-975fdfa5-d998-4d16-9a8a-7a3c02a3554f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:44.800832 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1257/2497] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:17:44 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:17:44.805512 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022216c-d916-4e95-be4a-06af79f0fdb8 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:44.869181 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022216c-d916-4e95-be4a-06af79f0fdb8 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:44.875080 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386a3ac-75a8-4bc8-9085-2b1532eec779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:44.875742 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386a3ac-75a8-4bc8-9085-2b1532eec779 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:44.876031 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386a3ac-75a8-4bc8-9085-2b1532eec779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:44.876309 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386a3ac-75a8-4bc8-9085-2b1532eec779 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:44.877001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386a3ac-75a8-4bc8-9085-2b1532eec779 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:44.878979 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386a3ac-75a8-4bc8-9085-2b1532eec779 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:44.907841 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1241/2498] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:17:44 2022] POST /identity/v3/projects => generated 369 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:17:44.912119 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fdfa5-d998-4d16-9a8a-7a3c02a3554f None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:44.923175 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fdfa5-d998-4d16-9a8a-7a3c02a3554f None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:44.983280 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c66809-de70-4a00-9080-05dab0df342c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:44.984007 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c66809-de70-4a00-9080-05dab0df342c admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:44.984289 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c66809-de70-4a00-9080-05dab0df342c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:44.984553 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c66809-de70-4a00-9080-05dab0df342c admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:44.985259 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c66809-de70-4a00-9080-05dab0df342c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:44.987307 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c66809-de70-4a00-9080-05dab0df342c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:45.013087 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1258/2499] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:17:44 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:17:45.017140 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386a3ac-75a8-4bc8-9085-2b1532eec779 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:45.027964 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386a3ac-75a8-4bc8-9085-2b1532eec779 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:45.033184 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec09888-df2e-4bad-a4fb-990c1fa4e3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:45.033871 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec09888-df2e-4bad-a4fb-990c1fa4e3ab admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:45.034167 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec09888-df2e-4bad-a4fb-990c1fa4e3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:45.034460 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec09888-df2e-4bad-a4fb-990c1fa4e3ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:45.035196 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec09888-df2e-4bad-a4fb-990c1fa4e3ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:45.036839 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec09888-df2e-4bad-a4fb-990c1fa4e3ab admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:45.047821 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1242/2500] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:17:45.051972 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c66809-de70-4a00-9080-05dab0df342c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:45.062366 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c66809-de70-4a00-9080-05dab0df342c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:45.068155 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1bb67-8c9a-42b6-a1ad-63fd734b21b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:45.069037 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1bb67-8c9a-42b6-a1ad-63fd734b21b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:45.069319 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1bb67-8c9a-42b6-a1ad-63fd734b21b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:45.069593 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1bb67-8c9a-42b6-a1ad-63fd734b21b3 admin admin] PATH_INFO: `/v3/projects/0e03d22c68ef44faa9197490f8699ef5/users/1a89d6d063f94942b239ef093f854101/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:45.085411 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f1bb67-8c9a-42b6-a1ad-63fd734b21b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e03d22c68ef44faa9197490f8699ef5, user_id=1a89d6d063f94942b239ef093f854101, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:45.088118 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f1bb67-8c9a-42b6-a1ad-63fd734b21b3 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:45.103616 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1259/2501] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:17:45 2022] PUT /identity/v3/projects/0e03d22c68ef44faa9197490f8699ef5/users/1a89d6d063f94942b239ef093f854101/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:17:45.107948 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec09888-df2e-4bad-a4fb-990c1fa4e3ab admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:45.118781 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec09888-df2e-4bad-a4fb-990c1fa4e3ab admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:45.141224 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:45.188634 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060d06b-84b7-4077-9f72-bb36fc31a2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:45.189298 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060d06b-84b7-4077-9f72-bb36fc31a2d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:45.189580 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060d06b-84b7-4077-9f72-bb36fc31a2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:45.189863 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060d06b-84b7-4077-9f72-bb36fc31a2d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:45.190630 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060d06b-84b7-4077-9f72-bb36fc31a2d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:45.192255 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060d06b-84b7-4077-9f72-bb36fc31a2d7 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:45.202533 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1243/2502] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:17:45.206485 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1bb67-8c9a-42b6-a1ad-63fd734b21b3 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:45.211996 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:45.217660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1bb67-8c9a-42b6-a1ad-63fd734b21b3 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:45.223213 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0abe384-e419-4436-a863-96fd2085358b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:45.224130 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abe384-e419-4436-a863-96fd2085358b admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:45.224417 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abe384-e419-4436-a863-96fd2085358b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:45.224693 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abe384-e419-4436-a863-96fd2085358b admin admin] PATH_INFO: `/v3/projects/0e03d22c68ef44faa9197490f8699ef5/users/1a89d6d063f94942b239ef093f854101/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:45.226712 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0abe384-e419-4436-a863-96fd2085358b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e03d22c68ef44faa9197490f8699ef5, user_id=1a89d6d063f94942b239ef093f854101, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:45.229673 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0abe384-e419-4436-a863-96fd2085358b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:45.240005 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1260/2503] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:17:45 2022] PUT /identity/v3/projects/0e03d22c68ef44faa9197490f8699ef5/users/1a89d6d063f94942b239ef093f854101/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:17:45.250307 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef089a-3e57-4656-8e48-b73760558aa0 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:45.250600 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef089a-3e57-4656-8e48-b73760558aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:45.250843 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef089a-3e57-4656-8e48-b73760558aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:45.277565 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-afef089a-3e57-4656-8e48-b73760558aa0 None None] MFA Rules not processed for user `1a89d6d063f94942b239ef093f854101`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:17:45.278821 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-afef089a-3e57-4656-8e48-b73760558aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:45.356062 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1244/2504] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:17:45 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:17:45.370310 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0abe384-e419-4436-a863-96fd2085358b admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:45.373122 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d0abe384-e419-4436-a863-96fd2085358b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:45.437691 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0abe384-e419-4436-a863-96fd2085358b admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:45.441567 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f44dc8-6b79-423f-b66f-a693ea37b821 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:45.442288 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f44dc8-6b79-423f-b66f-a693ea37b821 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:45.442578 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f44dc8-6b79-423f-b66f-a693ea37b821 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:45.442889 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f44dc8-6b79-423f-b66f-a693ea37b821 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:45.452956 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f44dc8-6b79-423f-b66f-a693ea37b821 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:45.454434 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f44dc8-6b79-423f-b66f-a693ea37b821 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:45.464118 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1261/2505] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:17:45 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:17:45.509498 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef089a-3e57-4656-8e48-b73760558aa0 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:45.510976 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-afef089a-3e57-4656-8e48-b73760558aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:45.523830 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef089a-3e57-4656-8e48-b73760558aa0 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:45.528077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435eaeb-4dda-4033-836b-46ebbf8038ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:45.528844 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435eaeb-4dda-4033-836b-46ebbf8038ba service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:45.529133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435eaeb-4dda-4033-836b-46ebbf8038ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:45.529423 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435eaeb-4dda-4033-836b-46ebbf8038ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:45.591978 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435eaeb-4dda-4033-836b-46ebbf8038ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:45.593447 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435eaeb-4dda-4033-836b-46ebbf8038ba service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:45.602743 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1245/2506] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:17:45 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:17:48.938524 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f44dc8-6b79-423f-b66f-a693ea37b821 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:49.002196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f44dc8-6b79-423f-b66f-a693ea37b821 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:49.007397 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb4ac3-2ba8-4f94-9248-993b63e98044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:49.008338 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb4ac3-2ba8-4f94-9248-993b63e98044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:49.008651 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb4ac3-2ba8-4f94-9248-993b63e98044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:49.009038 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb4ac3-2ba8-4f94-9248-993b63e98044 admin admin] PATH_INFO: `/v3/users/eafc6dc8c89144fe81082ba3b370ea4a` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:49.010291 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb4ac3-2ba8-4f94-9248-993b63e98044 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eafc6dc8c89144fe81082ba3b370ea4a)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:49.012216 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb4ac3-2ba8-4f94-9248-993b63e98044 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:49.062003 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-cbbb4ac3-2ba8-4f94-9248-993b63e98044 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eafc6dc8c89144fe81082ba3b370ea4a'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:49.072099 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-cbbb4ac3-2ba8-4f94-9248-993b63e98044 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eafc6dc8c89144fe81082ba3b370ea4a'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:49.072901 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-cbbb4ac3-2ba8-4f94-9248-993b63e98044 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eafc6dc8c89144fe81082ba3b370ea4a'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:49.085982 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-cbbb4ac3-2ba8-4f94-9248-993b63e98044 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eafc6dc8c89144fe81082ba3b370ea4a'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:49.086573 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-cbbb4ac3-2ba8-4f94-9248-993b63e98044 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eafc6dc8c89144fe81082ba3b370ea4a'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:49.098667 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1262/2507] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:17:48 2022] DELETE /identity/v3/users/eafc6dc8c89144fe81082ba3b370ea4a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:17:49.104510 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d481d-b7ab-4fec-a1e1-3e312fc3a96e None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:49.105033 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d481d-b7ab-4fec-a1e1-3e312fc3a96e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:49.105119 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d481d-b7ab-4fec-a1e1-3e312fc3a96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:49.128489 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-da6d481d-b7ab-4fec-a1e1-3e312fc3a96e None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:17:49.129748 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-da6d481d-b7ab-4fec-a1e1-3e312fc3a96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:49.172597 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:49.192529 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1246/2508] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:17:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:17:49.202649 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb4ac3-2ba8-4f94-9248-993b63e98044 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:49.204268 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-cbbb4ac3-2ba8-4f94-9248-993b63e98044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:49.219583 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:49.264998 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb4ac3-2ba8-4f94-9248-993b63e98044 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:49.269192 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4bfc3-f1e3-4d0f-988c-6a52da9614ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:49.269843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4bfc3-f1e3-4d0f-988c-6a52da9614ce service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:49.270115 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4bfc3-f1e3-4d0f-988c-6a52da9614ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:49.270382 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4bfc3-f1e3-4d0f-988c-6a52da9614ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:49.280012 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea4bfc3-f1e3-4d0f-988c-6a52da9614ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:49.281452 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea4bfc3-f1e3-4d0f-988c-6a52da9614ce service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:49.296968 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1263/2509] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:17:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:17:49.577236 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d481d-b7ab-4fec-a1e1-3e312fc3a96e None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:49.578879 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-da6d481d-b7ab-4fec-a1e1-3e312fc3a96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:49.590979 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d481d-b7ab-4fec-a1e1-3e312fc3a96e None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:49.595978 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730b666-54c8-4c55-99ea-4a525be097bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:49.597407 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730b666-54c8-4c55-99ea-4a525be097bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:49.597407 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730b666-54c8-4c55-99ea-4a525be097bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:49.597591 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730b666-54c8-4c55-99ea-4a525be097bc admin admin] PATH_INFO: `/v3/projects/f3a14f22b56b41db8dbf47aa6bbd3bf1` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:49.598689 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730b666-54c8-4c55-99ea-4a525be097bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3a14f22b56b41db8dbf47aa6bbd3bf1)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:49.600623 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730b666-54c8-4c55-99ea-4a525be097bc admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:49.648350 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5730b666-54c8-4c55-99ea-4a525be097bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3a14f22b56b41db8dbf47aa6bbd3bf1', 'request_id': 'req-5730b666-54c8-4c55-99ea-4a525be097bc'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:49.653853 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5730b666-54c8-4c55-99ea-4a525be097bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3a14f22b56b41db8dbf47aa6bbd3bf1', 'request_id': 'req-5730b666-54c8-4c55-99ea-4a525be097bc'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:49.660631 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5730b666-54c8-4c55-99ea-4a525be097bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3a14f22b56b41db8dbf47aa6bbd3bf1', 'request_id': 'req-5730b666-54c8-4c55-99ea-4a525be097bc'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:49.675916 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5730b666-54c8-4c55-99ea-4a525be097bc admin admin] The token cache is being invalidate because project f3a14f22b56b41db8dbf47aa6bbd3bf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:17:49.676212 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5730b666-54c8-4c55-99ea-4a525be097bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:49.676865 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5730b666-54c8-4c55-99ea-4a525be097bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:49.678503 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1247/2510] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:17:49 2022] DELETE /identity/v3/projects/f3a14f22b56b41db8dbf47aa6bbd3bf1 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:17:49.682551 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4bfc3-f1e3-4d0f-988c-6a52da9614ce service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:49.692438 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4bfc3-f1e3-4d0f-988c-6a52da9614ce service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:49.752340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9175d-cd32-4aca-a7de-fa28b175f4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:49.753219 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9175d-cd32-4aca-a7de-fa28b175f4f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:49.753507 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9175d-cd32-4aca-a7de-fa28b175f4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:49.753786 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9175d-cd32-4aca-a7de-fa28b175f4f3 admin admin] PATH_INFO: `/v3/users/1a89d6d063f94942b239ef093f854101` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:49.755001 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e9175d-cd32-4aca-a7de-fa28b175f4f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a89d6d063f94942b239ef093f854101)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:49.756967 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e9175d-cd32-4aca-a7de-fa28b175f4f3 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:49.805965 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a4e9175d-cd32-4aca-a7de-fa28b175f4f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a89d6d063f94942b239ef093f854101'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:49.814493 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a4e9175d-cd32-4aca-a7de-fa28b175f4f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a89d6d063f94942b239ef093f854101'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:49.815124 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a4e9175d-cd32-4aca-a7de-fa28b175f4f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a89d6d063f94942b239ef093f854101'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:49.827409 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a4e9175d-cd32-4aca-a7de-fa28b175f4f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a89d6d063f94942b239ef093f854101'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:49.828082 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a4e9175d-cd32-4aca-a7de-fa28b175f4f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a89d6d063f94942b239ef093f854101'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:49.840944 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1264/2511] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:17:49 2022] DELETE /identity/v3/users/1a89d6d063f94942b239ef093f854101 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:17:50.116864 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730b666-54c8-4c55-99ea-4a525be097bc admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:50.118409 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5730b666-54c8-4c55-99ea-4a525be097bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:50.132282 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730b666-54c8-4c55-99ea-4a525be097bc admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:50.191847 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47dd5fc-68cf-413c-b091-e85d43d3dda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:50.192625 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47dd5fc-68cf-413c-b091-e85d43d3dda6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:50.192924 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47dd5fc-68cf-413c-b091-e85d43d3dda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:50.193199 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47dd5fc-68cf-413c-b091-e85d43d3dda6 admin admin] PATH_INFO: `/v3/projects/0e03d22c68ef44faa9197490f8699ef5` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:50.194458 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47dd5fc-68cf-413c-b091-e85d43d3dda6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e03d22c68ef44faa9197490f8699ef5)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:50.196386 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47dd5fc-68cf-413c-b091-e85d43d3dda6 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:50.246593 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e47dd5fc-68cf-413c-b091-e85d43d3dda6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e03d22c68ef44faa9197490f8699ef5', 'request_id': 'req-e47dd5fc-68cf-413c-b091-e85d43d3dda6'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:50.252329 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e47dd5fc-68cf-413c-b091-e85d43d3dda6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e03d22c68ef44faa9197490f8699ef5', 'request_id': 'req-e47dd5fc-68cf-413c-b091-e85d43d3dda6'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:50.258616 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e47dd5fc-68cf-413c-b091-e85d43d3dda6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e03d22c68ef44faa9197490f8699ef5', 'request_id': 'req-e47dd5fc-68cf-413c-b091-e85d43d3dda6'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:50.271112 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:50.278668 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e47dd5fc-68cf-413c-b091-e85d43d3dda6 admin admin] The token cache is being invalidate because project 0e03d22c68ef44faa9197490f8699ef5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:17:50.279328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e47dd5fc-68cf-413c-b091-e85d43d3dda6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:50.280939 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e47dd5fc-68cf-413c-b091-e85d43d3dda6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:50.283276 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1248/2512] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:17:50 2022] DELETE /identity/v3/projects/0e03d22c68ef44faa9197490f8699ef5 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:17:50.290656 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad4834-6589-4e3f-8450-0ce451644693 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:50.291251 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad4834-6589-4e3f-8450-0ce451644693 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:50.291251 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad4834-6589-4e3f-8450-0ce451644693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:50.311803 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-b0ad4834-6589-4e3f-8450-0ce451644693 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:17:50.313006 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b0ad4834-6589-4e3f-8450-0ce451644693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:50.343826 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:50.378060 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1265/2513] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:17:50.386881 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708a255-7da1-4f27-a2e5-c217979df606 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:50.387204 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708a255-7da1-4f27-a2e5-c217979df606 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:50.387478 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708a255-7da1-4f27-a2e5-c217979df606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:50.406929 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-0708a255-7da1-4f27-a2e5-c217979df606 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:17:50.408125 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0708a255-7da1-4f27-a2e5-c217979df606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:50.416457 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1249/2514] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:17:50.420761 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad4834-6589-4e3f-8450-0ce451644693 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:50.431783 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad4834-6589-4e3f-8450-0ce451644693 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:50.438685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364b5fd-aa5b-4a31-a8c5-81381b5b46af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:50.439550 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364b5fd-aa5b-4a31-a8c5-81381b5b46af admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:50.439913 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364b5fd-aa5b-4a31-a8c5-81381b5b46af admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:50.440235 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364b5fd-aa5b-4a31-a8c5-81381b5b46af admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:50.441356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f364b5fd-aa5b-4a31-a8c5-81381b5b46af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:17:50.441790 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f364b5fd-aa5b-4a31-a8c5-81381b5b46af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:50.444403 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f364b5fd-aa5b-4a31-a8c5-81381b5b46af admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:50.458769 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1266/2515] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:17:50.464619 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0708a255-7da1-4f27-a2e5-c217979df606 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:50.476575 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0708a255-7da1-4f27-a2e5-c217979df606 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:50.483185 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417174a-2083-4768-b63b-1a34feec52e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:50.483838 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417174a-2083-4768-b63b-1a34feec52e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:50.484118 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417174a-2083-4768-b63b-1a34feec52e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:50.484396 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417174a-2083-4768-b63b-1a34feec52e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:50.485109 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3417174a-2083-4768-b63b-1a34feec52e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:50.487050 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3417174a-2083-4768-b63b-1a34feec52e4 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:50.516211 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1250/2516] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:17:50 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:17:50.519834 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364b5fd-aa5b-4a31-a8c5-81381b5b46af admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:50.530111 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364b5fd-aa5b-4a31-a8c5-81381b5b46af admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:50.598003 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a9687-b0e1-4981-a1d5-98c7a2e2b5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:50.598725 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a9687-b0e1-4981-a1d5-98c7a2e2b5ab admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:50.598995 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a9687-b0e1-4981-a1d5-98c7a2e2b5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:50.599278 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a9687-b0e1-4981-a1d5-98c7a2e2b5ab admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:50.599969 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148a9687-b0e1-4981-a1d5-98c7a2e2b5ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:50.601913 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148a9687-b0e1-4981-a1d5-98c7a2e2b5ab admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:50.625913 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1267/2517] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:17:50 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:17:50.630229 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417174a-2083-4768-b63b-1a34feec52e4 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:50.640836 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417174a-2083-4768-b63b-1a34feec52e4 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:50.646082 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa011a2-17a3-4f94-9d22-e6d70f579ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:50.646797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa011a2-17a3-4f94-9d22-e6d70f579ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:50.647080 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa011a2-17a3-4f94-9d22-e6d70f579ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:50.647357 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa011a2-17a3-4f94-9d22-e6d70f579ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:50.648175 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa011a2-17a3-4f94-9d22-e6d70f579ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:50.649924 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa011a2-17a3-4f94-9d22-e6d70f579ae7 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:50.660861 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1251/2518] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:17:50.664892 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a9687-b0e1-4981-a1d5-98c7a2e2b5ab admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:50.675307 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a9687-b0e1-4981-a1d5-98c7a2e2b5ab admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:50.680498 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0956cd-93cb-4dc7-99ee-a0abe994a2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:50.681156 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0956cd-93cb-4dc7-99ee-a0abe994a2d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:50.681446 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0956cd-93cb-4dc7-99ee-a0abe994a2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:50.681726 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0956cd-93cb-4dc7-99ee-a0abe994a2d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:50.682539 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0956cd-93cb-4dc7-99ee-a0abe994a2d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:50.684264 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0956cd-93cb-4dc7-99ee-a0abe994a2d5 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:50.694642 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1268/2519] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:17:50.698909 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa011a2-17a3-4f94-9d22-e6d70f579ae7 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:50.712485 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa011a2-17a3-4f94-9d22-e6d70f579ae7 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:50.719500 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d488369-5096-4d14-8776-6d2bdcd0a53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:50.720385 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d488369-5096-4d14-8776-6d2bdcd0a53c admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:50.720690 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d488369-5096-4d14-8776-6d2bdcd0a53c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:50.720943 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d488369-5096-4d14-8776-6d2bdcd0a53c admin admin] PATH_INFO: `/v3/projects/2a0c89f8f11242d2bf5ddff4e0a1ea15/users/b168125759824a7fbf6eb8023e76d90e/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:50.737210 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d488369-5096-4d14-8776-6d2bdcd0a53c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a0c89f8f11242d2bf5ddff4e0a1ea15, user_id=b168125759824a7fbf6eb8023e76d90e, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:50.739969 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d488369-5096-4d14-8776-6d2bdcd0a53c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:50.756733 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1252/2520] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:17:50 2022] PUT /identity/v3/projects/2a0c89f8f11242d2bf5ddff4e0a1ea15/users/b168125759824a7fbf6eb8023e76d90e/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:17:50.767097 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6532f6b-8c62-46cf-b998-210d815480bb None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:50.767394 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6532f6b-8c62-46cf-b998-210d815480bb None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:50.767678 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6532f6b-8c62-46cf-b998-210d815480bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:50.794854 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-b6532f6b-8c62-46cf-b998-210d815480bb None None] MFA Rules not processed for user `b168125759824a7fbf6eb8023e76d90e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:17:50.796046 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b6532f6b-8c62-46cf-b998-210d815480bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:50.869844 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1269/2521] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:17:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:17:50.875519 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d488369-5096-4d14-8776-6d2bdcd0a53c admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:50.939061 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d488369-5096-4d14-8776-6d2bdcd0a53c admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:50.945049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158efd4e-1517-4c44-b620-312f978fb712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:50.945649 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158efd4e-1517-4c44-b620-312f978fb712 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:50.945930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158efd4e-1517-4c44-b620-312f978fb712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:50.946211 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158efd4e-1517-4c44-b620-312f978fb712 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:50.946922 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158efd4e-1517-4c44-b620-312f978fb712 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:50.948863 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158efd4e-1517-4c44-b620-312f978fb712 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:50.976721 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1253/2522] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:17:50 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:17:50.981446 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6532f6b-8c62-46cf-b998-210d815480bb None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:50.992499 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6532f6b-8c62-46cf-b998-210d815480bb None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:51.018134 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:51.050065 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40df7cb-c7d1-4248-afa3-4b61b6c0771f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:51.050767 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40df7cb-c7d1-4248-afa3-4b61b6c0771f admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:51.051053 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40df7cb-c7d1-4248-afa3-4b61b6c0771f admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:51.051337 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40df7cb-c7d1-4248-afa3-4b61b6c0771f admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:51.052025 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40df7cb-c7d1-4248-afa3-4b61b6c0771f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:51.053957 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40df7cb-c7d1-4248-afa3-4b61b6c0771f admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:51.078022 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1270/2523] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:17:50 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:17:51.079395 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158efd4e-1517-4c44-b620-312f978fb712 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:51.090108 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158efd4e-1517-4c44-b620-312f978fb712 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:51.095411 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840a533-396f-4c77-82b7-3a00e71a8fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:51.096098 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840a533-396f-4c77-82b7-3a00e71a8fef admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:51.096388 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840a533-396f-4c77-82b7-3a00e71a8fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:51.096652 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840a533-396f-4c77-82b7-3a00e71a8fef admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:51.097397 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840a533-396f-4c77-82b7-3a00e71a8fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:51.099076 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840a533-396f-4c77-82b7-3a00e71a8fef admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:51.112461 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1254/2524] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 04:17:51.117011 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40df7cb-c7d1-4248-afa3-4b61b6c0771f admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:51.130341 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40df7cb-c7d1-4248-afa3-4b61b6c0771f admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:51.135473 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73882999-4eee-49a7-a353-d733e0e786ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:51.136129 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73882999-4eee-49a7-a353-d733e0e786ee admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:51.136449 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73882999-4eee-49a7-a353-d733e0e786ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:51.136728 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73882999-4eee-49a7-a353-d733e0e786ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:51.137467 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73882999-4eee-49a7-a353-d733e0e786ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:51.139253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73882999-4eee-49a7-a353-d733e0e786ee admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:51.149688 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1271/2525] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:17:51.153857 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840a533-396f-4c77-82b7-3a00e71a8fef admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:51.164079 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840a533-396f-4c77-82b7-3a00e71a8fef admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:51.169111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebae7de-54e6-4aa7-b967-1ac12bbdc012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:51.169992 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebae7de-54e6-4aa7-b967-1ac12bbdc012 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:51.170306 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebae7de-54e6-4aa7-b967-1ac12bbdc012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:51.170589 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebae7de-54e6-4aa7-b967-1ac12bbdc012 admin admin] PATH_INFO: `/v3/projects/ff247c01dfea4e2686fd6e6009460225/users/713c3f3856bb427f851f61eef03410c6/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:51.185659 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebae7de-54e6-4aa7-b967-1ac12bbdc012 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff247c01dfea4e2686fd6e6009460225, user_id=713c3f3856bb427f851f61eef03410c6, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:51.188382 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebae7de-54e6-4aa7-b967-1ac12bbdc012 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:51.203872 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1255/2526] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:17:51 2022] PUT /identity/v3/projects/ff247c01dfea4e2686fd6e6009460225/users/713c3f3856bb427f851f61eef03410c6/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:17:51.215296 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38d2ed-f063-4eef-8ef1-d442262383c1 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:51.215599 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38d2ed-f063-4eef-8ef1-d442262383c1 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:51.215889 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38d2ed-f063-4eef-8ef1-d442262383c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:51.243582 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-cd38d2ed-f063-4eef-8ef1-d442262383c1 None None] MFA Rules not processed for user `713c3f3856bb427f851f61eef03410c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:17:51.244816 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-cd38d2ed-f063-4eef-8ef1-d442262383c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:51.311915 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1272/2527] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:17:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:17:51.316545 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebae7de-54e6-4aa7-b967-1ac12bbdc012 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:51.365765 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:51.386289 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebae7de-54e6-4aa7-b967-1ac12bbdc012 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:51.391199 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eac06e-357a-414c-b0a9-f7c22cfff063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:51.391861 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eac06e-357a-414c-b0a9-f7c22cfff063 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:51.392151 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eac06e-357a-414c-b0a9-f7c22cfff063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:51.392435 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eac06e-357a-414c-b0a9-f7c22cfff063 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:51.393131 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eac06e-357a-414c-b0a9-f7c22cfff063 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:51.395273 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eac06e-357a-414c-b0a9-f7c22cfff063 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:51.423607 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1256/2528] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:17:51 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:17:51.427866 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38d2ed-f063-4eef-8ef1-d442262383c1 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:51.439255 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38d2ed-f063-4eef-8ef1-d442262383c1 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:51.500516 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ad33c-4824-43c8-add0-84f8d757ed31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:51.501100 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ad33c-4824-43c8-add0-84f8d757ed31 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:51.501385 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ad33c-4824-43c8-add0-84f8d757ed31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:51.501655 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ad33c-4824-43c8-add0-84f8d757ed31 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:51.502390 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21ad33c-4824-43c8-add0-84f8d757ed31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:51.504504 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21ad33c-4824-43c8-add0-84f8d757ed31 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:51.526211 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1273/2529] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:17:51 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 04:17:51.531076 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eac06e-357a-414c-b0a9-f7c22cfff063 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:51.541766 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eac06e-357a-414c-b0a9-f7c22cfff063 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:51.547124 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0a990-6428-401a-b96a-bddc53a0788f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:51.547778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0a990-6428-401a-b96a-bddc53a0788f admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:51.548066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0a990-6428-401a-b96a-bddc53a0788f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:51.548346 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0a990-6428-401a-b96a-bddc53a0788f admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:51.549083 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e0a990-6428-401a-b96a-bddc53a0788f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:51.551071 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e0a990-6428-401a-b96a-bddc53a0788f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:51.565722 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1257/2530] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:17:51.570749 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ad33c-4824-43c8-add0-84f8d757ed31 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:51.586874 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ad33c-4824-43c8-add0-84f8d757ed31 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:51.594353 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594096b-52e0-4b15-aa49-b368bd4786f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:51.595256 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594096b-52e0-4b15-aa49-b368bd4786f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:51.595549 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594096b-52e0-4b15-aa49-b368bd4786f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:51.595832 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594096b-52e0-4b15-aa49-b368bd4786f1 admin admin] PATH_INFO: `/v3/projects/58e700df5ca14384b221c359d8dc7b31/users/e0e2c4eaac324898ac309144c025f745/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:51.612478 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7594096b-52e0-4b15-aa49-b368bd4786f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58e700df5ca14384b221c359d8dc7b31, user_id=e0e2c4eaac324898ac309144c025f745, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:51.615287 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7594096b-52e0-4b15-aa49-b368bd4786f1 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:51.629282 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1274/2531] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:17:51 2022] PUT /identity/v3/projects/58e700df5ca14384b221c359d8dc7b31/users/e0e2c4eaac324898ac309144c025f745/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:17:51.633491 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0a990-6428-401a-b96a-bddc53a0788f admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:51.643704 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0a990-6428-401a-b96a-bddc53a0788f admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:51.707609 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db37f27-c97f-4203-8ba7-e1532a294c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:51.708320 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db37f27-c97f-4203-8ba7-e1532a294c44 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:51.708601 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db37f27-c97f-4203-8ba7-e1532a294c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:51.708884 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db37f27-c97f-4203-8ba7-e1532a294c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:51.709620 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db37f27-c97f-4203-8ba7-e1532a294c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:51.711315 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db37f27-c97f-4203-8ba7-e1532a294c44 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:51.723369 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1258/2532] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:17:51.727456 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594096b-52e0-4b15-aa49-b368bd4786f1 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:51.733585 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:51.740320 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594096b-52e0-4b15-aa49-b368bd4786f1 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:51.745524 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a432a-af34-4cab-92a8-b3db4d38ed2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:51.746471 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a432a-af34-4cab-92a8-b3db4d38ed2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:51.746758 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a432a-af34-4cab-92a8-b3db4d38ed2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:51.747041 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a432a-af34-4cab-92a8-b3db4d38ed2b admin admin] PATH_INFO: `/v3/projects/58e700df5ca14384b221c359d8dc7b31/users/e0e2c4eaac324898ac309144c025f745/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:51.749059 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7a432a-af34-4cab-92a8-b3db4d38ed2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=58e700df5ca14384b221c359d8dc7b31, user_id=e0e2c4eaac324898ac309144c025f745, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:51.751832 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7a432a-af34-4cab-92a8-b3db4d38ed2b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:51.762172 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1275/2533] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:17:51 2022] PUT /identity/v3/projects/58e700df5ca14384b221c359d8dc7b31/users/e0e2c4eaac324898ac309144c025f745/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:17:51.772599 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14553054-1378-420c-b359-ff91aa3fbda5 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:51.772885 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14553054-1378-420c-b359-ff91aa3fbda5 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:51.773198 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14553054-1378-420c-b359-ff91aa3fbda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:51.802048 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-14553054-1378-420c-b359-ff91aa3fbda5 None None] MFA Rules not processed for user `e0e2c4eaac324898ac309144c025f745`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:17:51.803300 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-14553054-1378-420c-b359-ff91aa3fbda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:51.875286 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1259/2534] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:17:51 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:17:51.887103 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a432a-af34-4cab-92a8-b3db4d38ed2b admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:51.889178 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3c7a432a-af34-4cab-92a8-b3db4d38ed2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:51.949364 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a432a-af34-4cab-92a8-b3db4d38ed2b admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:51.953456 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc07d5-1153-4113-aceb-b3fe5785a9e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:51.954101 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc07d5-1153-4113-aceb-b3fe5785a9e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:51.954420 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc07d5-1153-4113-aceb-b3fe5785a9e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:51.954700 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc07d5-1153-4113-aceb-b3fe5785a9e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:51.964144 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc07d5-1153-4113-aceb-b3fe5785a9e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:51.965562 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc07d5-1153-4113-aceb-b3fe5785a9e4 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:51.977189 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1276/2535] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:17:51 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:17:52.018835 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14553054-1378-420c-b359-ff91aa3fbda5 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:52.020453 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-14553054-1378-420c-b359-ff91aa3fbda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:52.033544 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14553054-1378-420c-b359-ff91aa3fbda5 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:52.037659 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e7574-c193-47aa-a939-c73732b6cfa6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:52.038340 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e7574-c193-47aa-a939-c73732b6cfa6 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:52.038628 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e7574-c193-47aa-a939-c73732b6cfa6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:52.038908 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e7574-c193-47aa-a939-c73732b6cfa6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:52.079544 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:52.099678 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e7574-c193-47aa-a939-c73732b6cfa6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:52.101144 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e7574-c193-47aa-a939-c73732b6cfa6 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:52.110649 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1260/2536] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:17:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:17:55.008985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc07d5-1153-4113-aceb-b3fe5785a9e4 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:55.080012 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc07d5-1153-4113-aceb-b3fe5785a9e4 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:55.084553 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fddbda-9dad-4619-9da8-a5088841efed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:55.085428 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fddbda-9dad-4619-9da8-a5088841efed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:55.085709 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fddbda-9dad-4619-9da8-a5088841efed admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:55.085984 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fddbda-9dad-4619-9da8-a5088841efed admin admin] PATH_INFO: `/v3/users/b168125759824a7fbf6eb8023e76d90e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:55.087237 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fddbda-9dad-4619-9da8-a5088841efed admin admin] RBAC: Authorizing `identity:delete_user(user_id=b168125759824a7fbf6eb8023e76d90e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:55.089185 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fddbda-9dad-4619-9da8-a5088841efed admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:55.136960 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-13fddbda-9dad-4619-9da8-a5088841efed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b168125759824a7fbf6eb8023e76d90e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:55.145674 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-13fddbda-9dad-4619-9da8-a5088841efed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b168125759824a7fbf6eb8023e76d90e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:55.146372 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-13fddbda-9dad-4619-9da8-a5088841efed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b168125759824a7fbf6eb8023e76d90e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:55.159748 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-13fddbda-9dad-4619-9da8-a5088841efed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b168125759824a7fbf6eb8023e76d90e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:55.160473 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-13fddbda-9dad-4619-9da8-a5088841efed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b168125759824a7fbf6eb8023e76d90e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:55.173575 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1277/2537] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:17:55 2022] DELETE /identity/v3/users/b168125759824a7fbf6eb8023e76d90e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:17:55.178332 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66456635-e2cf-4ded-8844-a8f1240f9e14 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:55.178848 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66456635-e2cf-4ded-8844-a8f1240f9e14 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:55.178848 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66456635-e2cf-4ded-8844-a8f1240f9e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:55.197121 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-66456635-e2cf-4ded-8844-a8f1240f9e14 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:17:55.198419 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-66456635-e2cf-4ded-8844-a8f1240f9e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:55.261214 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1261/2538] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:17:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:17:55.271277 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fddbda-9dad-4619-9da8-a5088841efed admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:55.272929 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-13fddbda-9dad-4619-9da8-a5088841efed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:55.288252 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:55.336167 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fddbda-9dad-4619-9da8-a5088841efed admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:55.340152 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9622ea-58e4-451b-aee1-e3ffb19d76a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:55.340873 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9622ea-58e4-451b-aee1-e3ffb19d76a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:55.341171 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9622ea-58e4-451b-aee1-e3ffb19d76a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:55.341472 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9622ea-58e4-451b-aee1-e3ffb19d76a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:55.350807 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9622ea-58e4-451b-aee1-e3ffb19d76a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:55.352316 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9622ea-58e4-451b-aee1-e3ffb19d76a3 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:55.362415 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1278/2539] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:17:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:17:55.662083 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66456635-e2cf-4ded-8844-a8f1240f9e14 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:55.663577 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-66456635-e2cf-4ded-8844-a8f1240f9e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:55.678356 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66456635-e2cf-4ded-8844-a8f1240f9e14 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:55.684190 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f19a78-814e-4c50-9fef-d3b1da172071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:55.685491 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f19a78-814e-4c50-9fef-d3b1da172071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:55.685795 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f19a78-814e-4c50-9fef-d3b1da172071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:55.686054 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f19a78-814e-4c50-9fef-d3b1da172071 admin admin] PATH_INFO: `/v3/projects/2a0c89f8f11242d2bf5ddff4e0a1ea15` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:55.687916 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f19a78-814e-4c50-9fef-d3b1da172071 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a0c89f8f11242d2bf5ddff4e0a1ea15)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:55.690780 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f19a78-814e-4c50-9fef-d3b1da172071 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:55.747684 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-21f19a78-814e-4c50-9fef-d3b1da172071 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a0c89f8f11242d2bf5ddff4e0a1ea15', 'request_id': 'req-21f19a78-814e-4c50-9fef-d3b1da172071'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:55.755440 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-21f19a78-814e-4c50-9fef-d3b1da172071 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a0c89f8f11242d2bf5ddff4e0a1ea15', 'request_id': 'req-21f19a78-814e-4c50-9fef-d3b1da172071'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:55.764027 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-21f19a78-814e-4c50-9fef-d3b1da172071 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a0c89f8f11242d2bf5ddff4e0a1ea15', 'request_id': 'req-21f19a78-814e-4c50-9fef-d3b1da172071'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:55.779385 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-21f19a78-814e-4c50-9fef-d3b1da172071 admin admin] The token cache is being invalidate because project 2a0c89f8f11242d2bf5ddff4e0a1ea15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:17:55.779680 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-21f19a78-814e-4c50-9fef-d3b1da172071 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:55.780320 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-21f19a78-814e-4c50-9fef-d3b1da172071 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:55.781952 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1262/2540] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:17:55 2022] DELETE /identity/v3/projects/2a0c89f8f11242d2bf5ddff4e0a1ea15 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:17:55.789022 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9622ea-58e4-451b-aee1-e3ffb19d76a3 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:55.799678 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9622ea-58e4-451b-aee1-e3ffb19d76a3 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:55.861443 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e4d6c2-45a6-4619-96bb-ab0dea0355fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:55.862351 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4d6c2-45a6-4619-96bb-ab0dea0355fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:55.862642 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4d6c2-45a6-4619-96bb-ab0dea0355fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:55.862922 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4d6c2-45a6-4619-96bb-ab0dea0355fd admin admin] PATH_INFO: `/v3/users/713c3f3856bb427f851f61eef03410c6` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:55.864130 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e4d6c2-45a6-4619-96bb-ab0dea0355fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=713c3f3856bb427f851f61eef03410c6)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:55.866130 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e4d6c2-45a6-4619-96bb-ab0dea0355fd admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:55.921551 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b4e4d6c2-45a6-4619-96bb-ab0dea0355fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '713c3f3856bb427f851f61eef03410c6'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:55.931005 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b4e4d6c2-45a6-4619-96bb-ab0dea0355fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '713c3f3856bb427f851f61eef03410c6'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:55.931789 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b4e4d6c2-45a6-4619-96bb-ab0dea0355fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '713c3f3856bb427f851f61eef03410c6'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:55.944567 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b4e4d6c2-45a6-4619-96bb-ab0dea0355fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '713c3f3856bb427f851f61eef03410c6'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:55.945186 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b4e4d6c2-45a6-4619-96bb-ab0dea0355fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '713c3f3856bb427f851f61eef03410c6'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:55.958117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1279/2541] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:17:55 2022] DELETE /identity/v3/users/713c3f3856bb427f851f61eef03410c6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:17:56.239086 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f19a78-814e-4c50-9fef-d3b1da172071 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:56.240856 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-21f19a78-814e-4c50-9fef-d3b1da172071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:56.255239 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f19a78-814e-4c50-9fef-d3b1da172071 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:56.320289 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f3383-6482-4f0d-83c4-1aff851088e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:56.321174 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f3383-6482-4f0d-83c4-1aff851088e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:56.321472 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f3383-6482-4f0d-83c4-1aff851088e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:56.321746 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f3383-6482-4f0d-83c4-1aff851088e3 admin admin] PATH_INFO: `/v3/projects/ff247c01dfea4e2686fd6e6009460225` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:56.322963 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f3383-6482-4f0d-83c4-1aff851088e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff247c01dfea4e2686fd6e6009460225)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:56.325231 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f3383-6482-4f0d-83c4-1aff851088e3 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:56.328076 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:56.375380 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c77f3383-6482-4f0d-83c4-1aff851088e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff247c01dfea4e2686fd6e6009460225', 'request_id': 'req-c77f3383-6482-4f0d-83c4-1aff851088e3'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:56.381621 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c77f3383-6482-4f0d-83c4-1aff851088e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff247c01dfea4e2686fd6e6009460225', 'request_id': 'req-c77f3383-6482-4f0d-83c4-1aff851088e3'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:56.388143 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c77f3383-6482-4f0d-83c4-1aff851088e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff247c01dfea4e2686fd6e6009460225', 'request_id': 'req-c77f3383-6482-4f0d-83c4-1aff851088e3'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:56.400841 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c77f3383-6482-4f0d-83c4-1aff851088e3 admin admin] The token cache is being invalidate because project ff247c01dfea4e2686fd6e6009460225 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:17:56.401140 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c77f3383-6482-4f0d-83c4-1aff851088e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:56.401915 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c77f3383-6482-4f0d-83c4-1aff851088e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:56.403788 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1263/2542] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:17:56 2022] DELETE /identity/v3/projects/ff247c01dfea4e2686fd6e6009460225 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:17:56.407926 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e4d6c2-45a6-4619-96bb-ab0dea0355fd admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:56.409382 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b4e4d6c2-45a6-4619-96bb-ab0dea0355fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:56.422960 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e4d6c2-45a6-4619-96bb-ab0dea0355fd admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:56.453811 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:56.482995 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01062bed-7790-48c5-bfcc-2b7c948b0c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:56.483896 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01062bed-7790-48c5-bfcc-2b7c948b0c86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:56.484185 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01062bed-7790-48c5-bfcc-2b7c948b0c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:56.484473 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01062bed-7790-48c5-bfcc-2b7c948b0c86 admin admin] PATH_INFO: `/v3/users/e0e2c4eaac324898ac309144c025f745` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:56.485733 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01062bed-7790-48c5-bfcc-2b7c948b0c86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0e2c4eaac324898ac309144c025f745)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:56.487854 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01062bed-7790-48c5-bfcc-2b7c948b0c86 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:56.551773 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-01062bed-7790-48c5-bfcc-2b7c948b0c86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0e2c4eaac324898ac309144c025f745'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:56.559382 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-01062bed-7790-48c5-bfcc-2b7c948b0c86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0e2c4eaac324898ac309144c025f745'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:56.560019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-01062bed-7790-48c5-bfcc-2b7c948b0c86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0e2c4eaac324898ac309144c025f745'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:56.573003 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-01062bed-7790-48c5-bfcc-2b7c948b0c86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0e2c4eaac324898ac309144c025f745'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:56.573687 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-01062bed-7790-48c5-bfcc-2b7c948b0c86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0e2c4eaac324898ac309144c025f745'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:56.586448 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1280/2543] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:17:56 2022] DELETE /identity/v3/users/e0e2c4eaac324898ac309144c025f745 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:17:56.879278 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f3383-6482-4f0d-83c4-1aff851088e3 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:56.880710 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c77f3383-6482-4f0d-83c4-1aff851088e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:56.897498 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f3383-6482-4f0d-83c4-1aff851088e3 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:56.956214 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e136d19-98cc-434e-aa05-76c85150fd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:56.957091 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e136d19-98cc-434e-aa05-76c85150fd1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:56.957379 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e136d19-98cc-434e-aa05-76c85150fd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:56.957656 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e136d19-98cc-434e-aa05-76c85150fd1c admin admin] PATH_INFO: `/v3/projects/58e700df5ca14384b221c359d8dc7b31` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:56.958923 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e136d19-98cc-434e-aa05-76c85150fd1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=58e700df5ca14384b221c359d8dc7b31)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:56.960901 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e136d19-98cc-434e-aa05-76c85150fd1c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:57.010415 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0e136d19-98cc-434e-aa05-76c85150fd1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58e700df5ca14384b221c359d8dc7b31', 'request_id': 'req-0e136d19-98cc-434e-aa05-76c85150fd1c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:57.015933 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0e136d19-98cc-434e-aa05-76c85150fd1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58e700df5ca14384b221c359d8dc7b31', 'request_id': 'req-0e136d19-98cc-434e-aa05-76c85150fd1c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:57.022006 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0e136d19-98cc-434e-aa05-76c85150fd1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58e700df5ca14384b221c359d8dc7b31', 'request_id': 'req-0e136d19-98cc-434e-aa05-76c85150fd1c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:57.035304 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0e136d19-98cc-434e-aa05-76c85150fd1c admin admin] The token cache is being invalidate because project 58e700df5ca14384b221c359d8dc7b31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:17:57.035595 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0e136d19-98cc-434e-aa05-76c85150fd1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:57.036216 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0e136d19-98cc-434e-aa05-76c85150fd1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:17:57.037766 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1264/2544] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:17:56 2022] DELETE /identity/v3/projects/58e700df5ca14384b221c359d8dc7b31 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:17:57.043986 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6761e-af1d-49b6-bfc7-1252b8f9fca1 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:57.044291 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6761e-af1d-49b6-bfc7-1252b8f9fca1 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:57.044576 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6761e-af1d-49b6-bfc7-1252b8f9fca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:57.063227 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-f5d6761e-af1d-49b6-bfc7-1252b8f9fca1 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:17:57.064577 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f5d6761e-af1d-49b6-bfc7-1252b8f9fca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:57.126228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1281/2545] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:17:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:17:57.135593 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38234984-938e-4f7b-b005-6f5b2d437c3b None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:57.135975 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38234984-938e-4f7b-b005-6f5b2d437c3b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:57.136317 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38234984-938e-4f7b-b005-6f5b2d437c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:57.156474 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-38234984-938e-4f7b-b005-6f5b2d437c3b None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:17:57.157704 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-38234984-938e-4f7b-b005-6f5b2d437c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:57.166824 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1265/2546] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:17:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:17:57.171294 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6761e-af1d-49b6-bfc7-1252b8f9fca1 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:57.181355 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6761e-af1d-49b6-bfc7-1252b8f9fca1 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:57.186291 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3d395-849b-4e1d-ba09-7a28d48194b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:57.186965 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3d395-849b-4e1d-ba09-7a28d48194b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:57.187294 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3d395-849b-4e1d-ba09-7a28d48194b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:57.187576 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3d395-849b-4e1d-ba09-7a28d48194b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:57.188322 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3d395-849b-4e1d-ba09-7a28d48194b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:17:57.188634 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3d395-849b-4e1d-ba09-7a28d48194b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:57.190309 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3d395-849b-4e1d-ba09-7a28d48194b4 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:57.205140 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1282/2547] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:17:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:17:57.207122 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38234984-938e-4f7b-b005-6f5b2d437c3b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:57.216831 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38234984-938e-4f7b-b005-6f5b2d437c3b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:57.222566 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa331457-6af0-4618-aa38-871096432939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:57.223230 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa331457-6af0-4618-aa38-871096432939 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:57.223511 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa331457-6af0-4618-aa38-871096432939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:57.223786 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa331457-6af0-4618-aa38-871096432939 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:57.224482 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa331457-6af0-4618-aa38-871096432939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:57.226452 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa331457-6af0-4618-aa38-871096432939 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:57.240734 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:57.255008 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1266/2548] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:17:57 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:17:57.259215 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3d395-849b-4e1d-ba09-7a28d48194b4 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:57.269484 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3d395-849b-4e1d-ba09-7a28d48194b4 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:57.309805 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:17:57.331250 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950d33b-bcbc-4856-8897-d50558f9e70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:57.331991 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950d33b-bcbc-4856-8897-d50558f9e70a admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:57.332243 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950d33b-bcbc-4856-8897-d50558f9e70a admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:57.332556 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950d33b-bcbc-4856-8897-d50558f9e70a admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:57.333245 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950d33b-bcbc-4856-8897-d50558f9e70a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:57.335198 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950d33b-bcbc-4856-8897-d50558f9e70a admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:57.356571 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1283/2549] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:17:57 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:17:57.360673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa331457-6af0-4618-aa38-871096432939 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:57.371404 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa331457-6af0-4618-aa38-871096432939 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:57.377627 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f87c4c-08cf-4e4d-947b-e8bf93256145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:57.378389 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f87c4c-08cf-4e4d-947b-e8bf93256145 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:57.378679 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f87c4c-08cf-4e4d-947b-e8bf93256145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:57.378960 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f87c4c-08cf-4e4d-947b-e8bf93256145 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:57.379702 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f87c4c-08cf-4e4d-947b-e8bf93256145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:57.381349 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f87c4c-08cf-4e4d-947b-e8bf93256145 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:57.392616 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1267/2550] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:17:57.396854 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950d33b-bcbc-4856-8897-d50558f9e70a admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:57.407742 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950d33b-bcbc-4856-8897-d50558f9e70a admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:57.414813 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223d6ad-ae05-4703-b006-aab1bff41a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:57.415627 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223d6ad-ae05-4703-b006-aab1bff41a80 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:57.415990 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223d6ad-ae05-4703-b006-aab1bff41a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:57.416278 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223d6ad-ae05-4703-b006-aab1bff41a80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:57.417089 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223d6ad-ae05-4703-b006-aab1bff41a80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:57.418845 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223d6ad-ae05-4703-b006-aab1bff41a80 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:57.432477 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1284/2551] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:17:57.433704 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f87c4c-08cf-4e4d-947b-e8bf93256145 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:57.444595 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f87c4c-08cf-4e4d-947b-e8bf93256145 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:57.450046 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f28f1-b822-4be1-88df-a5e645f03a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:57.450985 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f28f1-b822-4be1-88df-a5e645f03a2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:57.451274 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f28f1-b822-4be1-88df-a5e645f03a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:57.451554 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f28f1-b822-4be1-88df-a5e645f03a2c admin admin] PATH_INFO: `/v3/projects/a0f51a045a864cbc8e4c786a656819ef/users/82ad8fb3b671415a8f74a0c4871ca28c/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:57.466962 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f28f1-b822-4be1-88df-a5e645f03a2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0f51a045a864cbc8e4c786a656819ef, user_id=82ad8fb3b671415a8f74a0c4871ca28c, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:57.469655 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f28f1-b822-4be1-88df-a5e645f03a2c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:57.485220 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1268/2552] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:17:57 2022] PUT /identity/v3/projects/a0f51a045a864cbc8e4c786a656819ef/users/82ad8fb3b671415a8f74a0c4871ca28c/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:17:57.498188 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f059f-c124-4c24-8ed3-bf13e5009a05 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:57.498503 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f059f-c124-4c24-8ed3-bf13e5009a05 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:57.498767 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f059f-c124-4c24-8ed3-bf13e5009a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:57.529203 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-438f059f-c124-4c24-8ed3-bf13e5009a05 None None] MFA Rules not processed for user `82ad8fb3b671415a8f74a0c4871ca28c`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:17:57.530484 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-438f059f-c124-4c24-8ed3-bf13e5009a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:57.603200 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1285/2553] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:17:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:17:57.615130 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f28f1-b822-4be1-88df-a5e645f03a2c admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:17:57.617000 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f30f28f1-b822-4be1-88df-a5e645f03a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:17:57.678946 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f28f1-b822-4be1-88df-a5e645f03a2c admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:17:57.682839 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81e572-5213-4d40-a827-c5cde0cabcf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:17:57.683497 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81e572-5213-4d40-a827-c5cde0cabcf4 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:17:57.683786 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81e572-5213-4d40-a827-c5cde0cabcf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:17:57.684097 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81e572-5213-4d40-a827-c5cde0cabcf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:17:57.693016 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e81e572-5213-4d40-a827-c5cde0cabcf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:17:57.694558 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e81e572-5213-4d40-a827-c5cde0cabcf4 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:17:57.703630 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1269/2554] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:17:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:18:04.704870 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa38627-8338-4fb6-9c6b-727dcdfad35b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:04.705409 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa38627-8338-4fb6-9c6b-727dcdfad35b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:04.705409 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa38627-8338-4fb6-9c6b-727dcdfad35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:04.723258 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-0aa38627-8338-4fb6-9c6b-727dcdfad35b None None] MFA Rules not processed for user `c8ada8b86e2f4ad18c8af021def1a30e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:18:04.724486 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0aa38627-8338-4fb6-9c6b-727dcdfad35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:18:04.782140 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1286/2555] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:18:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:18:05.106011 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81e572-5213-4d40-a827-c5cde0cabcf4 service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:05.107814 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5e81e572-5213-4d40-a827-c5cde0cabcf4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:18:05.170174 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81e572-5213-4d40-a827-c5cde0cabcf4 service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:05.174712 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd15500-aa93-4ded-89e7-a2ace1d12431 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:05.175395 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd15500-aa93-4ded-89e7-a2ace1d12431 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:05.175679 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd15500-aa93-4ded-89e7-a2ace1d12431 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:05.175954 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd15500-aa93-4ded-89e7-a2ace1d12431 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:05.177757 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ecd15500-aa93-4ded-89e7-a2ace1d12431 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:18:05.187783 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd15500-aa93-4ded-89e7-a2ace1d12431 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:05.189256 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd15500-aa93-4ded-89e7-a2ace1d12431 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:05.197945 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1270/2556] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:18:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:18:11.291770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa38627-8338-4fb6-9c6b-727dcdfad35b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:11.355237 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:18:11.373189 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa38627-8338-4fb6-9c6b-727dcdfad35b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:11.378475 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b7bf1-4b11-4f2d-8ee0-c27e4992b263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:11.379427 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b7bf1-4b11-4f2d-8ee0-c27e4992b263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:11.380152 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b7bf1-4b11-4f2d-8ee0-c27e4992b263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:11.380384 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b7bf1-4b11-4f2d-8ee0-c27e4992b263 admin admin] PATH_INFO: `/v3/users/82ad8fb3b671415a8f74a0c4871ca28c` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:11.384079 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b7bf1-4b11-4f2d-8ee0-c27e4992b263 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82ad8fb3b671415a8f74a0c4871ca28c)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:11.386473 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b7bf1-4b11-4f2d-8ee0-c27e4992b263 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:11.439479 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-815b7bf1-4b11-4f2d-8ee0-c27e4992b263 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82ad8fb3b671415a8f74a0c4871ca28c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:11.447585 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-815b7bf1-4b11-4f2d-8ee0-c27e4992b263 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82ad8fb3b671415a8f74a0c4871ca28c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:11.448269 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-815b7bf1-4b11-4f2d-8ee0-c27e4992b263 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82ad8fb3b671415a8f74a0c4871ca28c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:11.460907 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-815b7bf1-4b11-4f2d-8ee0-c27e4992b263 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82ad8fb3b671415a8f74a0c4871ca28c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:11.461593 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-815b7bf1-4b11-4f2d-8ee0-c27e4992b263 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82ad8fb3b671415a8f74a0c4871ca28c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:11.473976 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1287/2557] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:18:11 2022] DELETE /identity/v3/users/82ad8fb3b671415a8f74a0c4871ca28c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:18:11.478913 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af2025-b2b1-421a-97c8-1b227dc30ba4 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:11.479419 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af2025-b2b1-421a-97c8-1b227dc30ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:11.479599 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af2025-b2b1-421a-97c8-1b227dc30ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:11.497049 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-19af2025-b2b1-421a-97c8-1b227dc30ba4 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:18:11.498233 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-19af2025-b2b1-421a-97c8-1b227dc30ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:18:11.563191 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1271/2558] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:18:11.573091 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b7bf1-4b11-4f2d-8ee0-c27e4992b263 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:11.574727 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-815b7bf1-4b11-4f2d-8ee0-c27e4992b263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:18:11.635365 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b7bf1-4b11-4f2d-8ee0-c27e4992b263 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:11.639332 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc55599-07c1-46bb-9202-9fe1b659dcef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:11.640000 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc55599-07c1-46bb-9202-9fe1b659dcef service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:11.640280 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc55599-07c1-46bb-9202-9fe1b659dcef service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:11.640557 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc55599-07c1-46bb-9202-9fe1b659dcef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:11.650075 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc55599-07c1-46bb-9202-9fe1b659dcef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:11.651775 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc55599-07c1-46bb-9202-9fe1b659dcef service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:11.662999 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1288/2559] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:18:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:18:12.107269 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af2025-b2b1-421a-97c8-1b227dc30ba4 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:12.110701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-19af2025-b2b1-421a-97c8-1b227dc30ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:18:12.125746 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:18:12.138687 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af2025-b2b1-421a-97c8-1b227dc30ba4 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:12.144099 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6662f-fda4-406a-8dbd-c43862a4e4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:12.145048 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6662f-fda4-406a-8dbd-c43862a4e4d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:12.145414 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6662f-fda4-406a-8dbd-c43862a4e4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:12.145580 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6662f-fda4-406a-8dbd-c43862a4e4d7 admin admin] PATH_INFO: `/v3/projects/a0f51a045a864cbc8e4c786a656819ef` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:12.146808 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6662f-fda4-406a-8dbd-c43862a4e4d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0f51a045a864cbc8e4c786a656819ef)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:12.148828 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6662f-fda4-406a-8dbd-c43862a4e4d7 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:12.206879 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2de6662f-fda4-406a-8dbd-c43862a4e4d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0f51a045a864cbc8e4c786a656819ef', 'request_id': 'req-2de6662f-fda4-406a-8dbd-c43862a4e4d7'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:12.212617 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2de6662f-fda4-406a-8dbd-c43862a4e4d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0f51a045a864cbc8e4c786a656819ef', 'request_id': 'req-2de6662f-fda4-406a-8dbd-c43862a4e4d7'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:12.219295 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2de6662f-fda4-406a-8dbd-c43862a4e4d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0f51a045a864cbc8e4c786a656819ef', 'request_id': 'req-2de6662f-fda4-406a-8dbd-c43862a4e4d7'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:12.236414 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2de6662f-fda4-406a-8dbd-c43862a4e4d7 admin admin] The token cache is being invalidate because project a0f51a045a864cbc8e4c786a656819ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:18:12.236704 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2de6662f-fda4-406a-8dbd-c43862a4e4d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:12.237357 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2de6662f-fda4-406a-8dbd-c43862a4e4d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:12.239081 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1272/2560] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:18:12 2022] DELETE /identity/v3/projects/a0f51a045a864cbc8e4c786a656819ef => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:18:12.244112 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53678304-2d4b-4a89-ba34-a549130682b7 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:12.244410 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53678304-2d4b-4a89-ba34-a549130682b7 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:12.244692 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53678304-2d4b-4a89-ba34-a549130682b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:12.265210 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-53678304-2d4b-4a89-ba34-a549130682b7 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:18:12.266453 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-53678304-2d4b-4a89-ba34-a549130682b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:18:12.332260 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1289/2561] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:18:12.340482 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102cd17-8c74-41be-a19a-05605fd7bc8e None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:12.340783 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102cd17-8c74-41be-a19a-05605fd7bc8e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:12.341070 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102cd17-8c74-41be-a19a-05605fd7bc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:12.362804 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-7102cd17-8c74-41be-a19a-05605fd7bc8e None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:18:12.363951 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-7102cd17-8c74-41be-a19a-05605fd7bc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:18:12.374055 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1273/2562] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:18:12.378486 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53678304-2d4b-4a89-ba34-a549130682b7 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:12.388715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53678304-2d4b-4a89-ba34-a549130682b7 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:12.394119 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2c3b3-f481-4943-95cf-bcb8f6447b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:12.394847 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2c3b3-f481-4943-95cf-bcb8f6447b66 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:12.395138 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2c3b3-f481-4943-95cf-bcb8f6447b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:12.395446 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2c3b3-f481-4943-95cf-bcb8f6447b66 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:12.396185 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d2c3b3-f481-4943-95cf-bcb8f6447b66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:18:12.396498 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d2c3b3-f481-4943-95cf-bcb8f6447b66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:12.398194 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d2c3b3-f481-4943-95cf-bcb8f6447b66 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:12.410965 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1290/2563] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:18:12.416931 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102cd17-8c74-41be-a19a-05605fd7bc8e None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:12.426807 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102cd17-8c74-41be-a19a-05605fd7bc8e None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:12.432654 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43cad2e-fc20-4054-9e92-dc9c021f17dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:12.433356 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cad2e-fc20-4054-9e92-dc9c021f17dc admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:12.433644 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cad2e-fc20-4054-9e92-dc9c021f17dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:12.433923 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cad2e-fc20-4054-9e92-dc9c021f17dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:12.434671 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43cad2e-fc20-4054-9e92-dc9c021f17dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:12.436642 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43cad2e-fc20-4054-9e92-dc9c021f17dc admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:12.465344 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1274/2564] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:18:12 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:18:12.469716 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2c3b3-f481-4943-95cf-bcb8f6447b66 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:12.475230 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:18:12.482790 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2c3b3-f481-4943-95cf-bcb8f6447b66 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:12.546786 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55518a63-6f06-4a6d-a050-4069432c1faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:12.547477 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55518a63-6f06-4a6d-a050-4069432c1faa admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:12.547766 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55518a63-6f06-4a6d-a050-4069432c1faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:12.548051 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55518a63-6f06-4a6d-a050-4069432c1faa admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:12.548857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55518a63-6f06-4a6d-a050-4069432c1faa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:12.550825 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55518a63-6f06-4a6d-a050-4069432c1faa admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:12.578483 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1291/2565] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:18:12 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:18:12.580088 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43cad2e-fc20-4054-9e92-dc9c021f17dc admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:12.591591 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43cad2e-fc20-4054-9e92-dc9c021f17dc admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:12.597111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d75b483-b068-4495-a995-c39a39ce1fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:12.597833 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75b483-b068-4495-a995-c39a39ce1fbf admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:12.598124 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75b483-b068-4495-a995-c39a39ce1fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:12.598459 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75b483-b068-4495-a995-c39a39ce1fbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:12.599611 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d75b483-b068-4495-a995-c39a39ce1fbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:12.601299 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d75b483-b068-4495-a995-c39a39ce1fbf admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:12.616896 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1275/2566] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 04:18:12.618110 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55518a63-6f06-4a6d-a050-4069432c1faa admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:12.630415 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55518a63-6f06-4a6d-a050-4069432c1faa admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:12.635463 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49089fc7-9f14-4b39-841e-cabe0cb2a52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:12.636151 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49089fc7-9f14-4b39-841e-cabe0cb2a52b admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:12.636726 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49089fc7-9f14-4b39-841e-cabe0cb2a52b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:12.637042 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49089fc7-9f14-4b39-841e-cabe0cb2a52b admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:12.637823 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49089fc7-9f14-4b39-841e-cabe0cb2a52b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:12.639562 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49089fc7-9f14-4b39-841e-cabe0cb2a52b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:12.651454 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1292/2567] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:18:12.657714 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d75b483-b068-4495-a995-c39a39ce1fbf admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:12.669652 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d75b483-b068-4495-a995-c39a39ce1fbf admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:12.675304 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ccea4-3769-4c81-abf6-9157fd0723d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:12.676006 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ccea4-3769-4c81-abf6-9157fd0723d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:12.676301 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ccea4-3769-4c81-abf6-9157fd0723d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:12.676586 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ccea4-3769-4c81-abf6-9157fd0723d0 admin admin] PATH_INFO: `/v3/projects/dc5724c5b92944d4b105ac8931d5cec9/users/672f25a52ff149169a140cce726f9ee2/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:12.694813 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ccea4-3769-4c81-abf6-9157fd0723d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc5724c5b92944d4b105ac8931d5cec9, user_id=672f25a52ff149169a140cce726f9ee2, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:12.697535 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ccea4-3769-4c81-abf6-9157fd0723d0 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:12.713463 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1276/2568] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:18:12 2022] PUT /identity/v3/projects/dc5724c5b92944d4b105ac8931d5cec9/users/672f25a52ff149169a140cce726f9ee2/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:18:12.728902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc21798-2b14-416a-9bad-169147ca6739 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:12.729196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc21798-2b14-416a-9bad-169147ca6739 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:12.729480 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc21798-2b14-416a-9bad-169147ca6739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:12.756328 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-dfc21798-2b14-416a-9bad-169147ca6739 None None] MFA Rules not processed for user `672f25a52ff149169a140cce726f9ee2`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:18:12.757577 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-dfc21798-2b14-416a-9bad-169147ca6739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:18:12.821580 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1293/2569] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:18:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:18:12.826286 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ccea4-3769-4c81-abf6-9157fd0723d0 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:12.889407 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ccea4-3769-4c81-abf6-9157fd0723d0 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:12.895366 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019348b-4026-4b29-b6eb-0a5946b5c2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:12.896037 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019348b-4026-4b29-b6eb-0a5946b5c2ba admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:12.896358 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019348b-4026-4b29-b6eb-0a5946b5c2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:12.896637 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019348b-4026-4b29-b6eb-0a5946b5c2ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:12.897383 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c019348b-4026-4b29-b6eb-0a5946b5c2ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:12.899410 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c019348b-4026-4b29-b6eb-0a5946b5c2ba admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:12.928528 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1277/2570] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:18:12 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:18:12.932527 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc21798-2b14-416a-9bad-169147ca6739 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:12.943945 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc21798-2b14-416a-9bad-169147ca6739 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:13.003820 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6cce0e-2ba1-4aa2-8406-1caeed0646e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:13.004510 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6cce0e-2ba1-4aa2-8406-1caeed0646e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:13.004789 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6cce0e-2ba1-4aa2-8406-1caeed0646e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:13.005084 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6cce0e-2ba1-4aa2-8406-1caeed0646e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:13.005796 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6cce0e-2ba1-4aa2-8406-1caeed0646e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:13.007808 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6cce0e-2ba1-4aa2-8406-1caeed0646e6 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:13.025171 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:18:13.031317 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1294/2571] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:18:12 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:18:13.035168 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019348b-4026-4b29-b6eb-0a5946b5c2ba admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:13.045907 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019348b-4026-4b29-b6eb-0a5946b5c2ba admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:13.050844 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56e404-c224-41ed-ad83-9fa34e1cd0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:13.051527 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56e404-c224-41ed-ad83-9fa34e1cd0ee admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:13.051815 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56e404-c224-41ed-ad83-9fa34e1cd0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:13.052097 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56e404-c224-41ed-ad83-9fa34e1cd0ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:13.052832 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56e404-c224-41ed-ad83-9fa34e1cd0ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:13.054526 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56e404-c224-41ed-ad83-9fa34e1cd0ee admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:13.056669 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:18:13.066683 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1278/2572] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:18:13.071058 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6cce0e-2ba1-4aa2-8406-1caeed0646e6 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:13.081342 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6cce0e-2ba1-4aa2-8406-1caeed0646e6 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:13.087149 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14488f04-1abf-4ceb-aef1-3e8adac7cdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:13.087872 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14488f04-1abf-4ceb-aef1-3e8adac7cdbb admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:13.088157 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14488f04-1abf-4ceb-aef1-3e8adac7cdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:13.088433 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14488f04-1abf-4ceb-aef1-3e8adac7cdbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:13.089218 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14488f04-1abf-4ceb-aef1-3e8adac7cdbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:13.090906 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14488f04-1abf-4ceb-aef1-3e8adac7cdbb admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:13.101801 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1295/2573] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:18:13.106333 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56e404-c224-41ed-ad83-9fa34e1cd0ee admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:13.116635 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56e404-c224-41ed-ad83-9fa34e1cd0ee admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:13.121805 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f77aa-7cd2-4141-b515-0175890a93ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:13.122735 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f77aa-7cd2-4141-b515-0175890a93ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:13.123019 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f77aa-7cd2-4141-b515-0175890a93ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:13.123303 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f77aa-7cd2-4141-b515-0175890a93ae admin admin] PATH_INFO: `/v3/projects/611fc5dccea943ceaa13debf98389156/users/954b2d9a0c9f4b5787ffecba1cd3a81a/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:13.138681 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f77aa-7cd2-4141-b515-0175890a93ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=611fc5dccea943ceaa13debf98389156, user_id=954b2d9a0c9f4b5787ffecba1cd3a81a, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:13.141427 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f77aa-7cd2-4141-b515-0175890a93ae admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:13.156786 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1279/2574] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:18:13 2022] PUT /identity/v3/projects/611fc5dccea943ceaa13debf98389156/users/954b2d9a0c9f4b5787ffecba1cd3a81a/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 04:18:13.225847 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea526f2-c0c4-4978-9474-353a2739fb19 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:13.226213 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea526f2-c0c4-4978-9474-353a2739fb19 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:13.226444 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea526f2-c0c4-4978-9474-353a2739fb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:13.255119 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-0ea526f2-c0c4-4978-9474-353a2739fb19 None None] MFA Rules not processed for user `954b2d9a0c9f4b5787ffecba1cd3a81a`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:18:13.256376 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0ea526f2-c0c4-4978-9474-353a2739fb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:18:13.327154 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1296/2575] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:18:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:18:13.331895 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f77aa-7cd2-4141-b515-0175890a93ae admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:13.396992 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f77aa-7cd2-4141-b515-0175890a93ae admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:13.401993 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e469a-b60e-4067-8f67-455d77dbc40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:13.402713 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e469a-b60e-4067-8f67-455d77dbc40b admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:13.403002 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e469a-b60e-4067-8f67-455d77dbc40b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:13.403284 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e469a-b60e-4067-8f67-455d77dbc40b admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:13.403993 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e469a-b60e-4067-8f67-455d77dbc40b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:13.405943 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e469a-b60e-4067-8f67-455d77dbc40b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:13.433431 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1280/2576] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:18:13 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:18:13.437767 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea526f2-c0c4-4978-9474-353a2739fb19 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:13.448822 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea526f2-c0c4-4978-9474-353a2739fb19 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:13.511672 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683e44c-5068-4433-8e99-cc95fa2bf47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:13.512360 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683e44c-5068-4433-8e99-cc95fa2bf47b admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:13.512645 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683e44c-5068-4433-8e99-cc95fa2bf47b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:13.512928 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683e44c-5068-4433-8e99-cc95fa2bf47b admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:13.513623 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1683e44c-5068-4433-8e99-cc95fa2bf47b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:13.515714 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1683e44c-5068-4433-8e99-cc95fa2bf47b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:13.538463 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1297/2577] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:18:13 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:18:13.542835 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e469a-b60e-4067-8f67-455d77dbc40b admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:13.553366 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e469a-b60e-4067-8f67-455d77dbc40b admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:13.558242 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264fbb21-0c29-4933-8f33-6b32e4b4e187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:13.558918 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fbb21-0c29-4933-8f33-6b32e4b4e187 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:13.559206 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fbb21-0c29-4933-8f33-6b32e4b4e187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:13.559485 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fbb21-0c29-4933-8f33-6b32e4b4e187 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:13.560218 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264fbb21-0c29-4933-8f33-6b32e4b4e187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:13.561852 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264fbb21-0c29-4933-8f33-6b32e4b4e187 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:13.572390 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1281/2578] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:18:13.576672 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683e44c-5068-4433-8e99-cc95fa2bf47b admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:13.587469 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683e44c-5068-4433-8e99-cc95fa2bf47b admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:13.594861 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d44b00-53b9-4f2f-97bb-bcba0c9dd3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:13.596358 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d44b00-53b9-4f2f-97bb-bcba0c9dd3f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:13.596714 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d44b00-53b9-4f2f-97bb-bcba0c9dd3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:13.597075 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d44b00-53b9-4f2f-97bb-bcba0c9dd3f0 admin admin] PATH_INFO: `/v3/projects/0807a3d00d734c3eb7f895e004067553/users/826e842f692c4b82be42e347af5ab8ae/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:13.616987 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d44b00-53b9-4f2f-97bb-bcba0c9dd3f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0807a3d00d734c3eb7f895e004067553, user_id=826e842f692c4b82be42e347af5ab8ae, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:13.619756 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d44b00-53b9-4f2f-97bb-bcba0c9dd3f0 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:13.635055 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1298/2579] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:18:13 2022] PUT /identity/v3/projects/0807a3d00d734c3eb7f895e004067553/users/826e842f692c4b82be42e347af5ab8ae/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:18:13.639194 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264fbb21-0c29-4933-8f33-6b32e4b4e187 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:13.650181 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264fbb21-0c29-4933-8f33-6b32e4b4e187 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:13.710016 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78f5af-ffcb-40d9-a534-87906bf421be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:13.710751 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78f5af-ffcb-40d9-a534-87906bf421be admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:13.711033 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78f5af-ffcb-40d9-a534-87906bf421be admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:13.711334 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78f5af-ffcb-40d9-a534-87906bf421be admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:13.712068 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78f5af-ffcb-40d9-a534-87906bf421be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:13.713697 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78f5af-ffcb-40d9-a534-87906bf421be admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:13.724578 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1282/2580] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:18:13.731407 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d44b00-53b9-4f2f-97bb-bcba0c9dd3f0 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:13.742833 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d44b00-53b9-4f2f-97bb-bcba0c9dd3f0 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:13.748387 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1763ee1-140c-4af5-a4a9-11821b08ed65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:13.749286 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1763ee1-140c-4af5-a4a9-11821b08ed65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:13.749569 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1763ee1-140c-4af5-a4a9-11821b08ed65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:13.749956 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1763ee1-140c-4af5-a4a9-11821b08ed65 admin admin] PATH_INFO: `/v3/projects/0807a3d00d734c3eb7f895e004067553/users/826e842f692c4b82be42e347af5ab8ae/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:13.752254 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1763ee1-140c-4af5-a4a9-11821b08ed65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0807a3d00d734c3eb7f895e004067553, user_id=826e842f692c4b82be42e347af5ab8ae, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:13.758310 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1763ee1-140c-4af5-a4a9-11821b08ed65 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:13.769867 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1299/2581] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:18:13 2022] PUT /identity/v3/projects/0807a3d00d734c3eb7f895e004067553/users/826e842f692c4b82be42e347af5ab8ae/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:18:13.780358 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4bdf7a-cca4-4cc8-b223-b82b6f0acb95 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:13.780647 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4bdf7a-cca4-4cc8-b223-b82b6f0acb95 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:13.780954 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4bdf7a-cca4-4cc8-b223-b82b6f0acb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:13.808305 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-6e4bdf7a-cca4-4cc8-b223-b82b6f0acb95 None None] MFA Rules not processed for user `826e842f692c4b82be42e347af5ab8ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:18:13.809744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6e4bdf7a-cca4-4cc8-b223-b82b6f0acb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:18:13.845797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:18:13.884146 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1283/2582] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:18:13 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:18:13.895729 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1763ee1-140c-4af5-a4a9-11821b08ed65 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:13.897805 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c1763ee1-140c-4af5-a4a9-11821b08ed65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:18:13.932216 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:18:13.958190 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1763ee1-140c-4af5-a4a9-11821b08ed65 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:13.962441 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5424284-3a34-4c0c-955a-239a30490f8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:13.963104 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5424284-3a34-4c0c-955a-239a30490f8d service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:13.963393 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5424284-3a34-4c0c-955a-239a30490f8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:13.963673 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5424284-3a34-4c0c-955a-239a30490f8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:14.022968 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5424284-3a34-4c0c-955a-239a30490f8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:14.024551 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5424284-3a34-4c0c-955a-239a30490f8d service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:14.033951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1300/2583] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:18:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:18:15.560704 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4bdf7a-cca4-4cc8-b223-b82b6f0acb95 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:15.562539 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6e4bdf7a-cca4-4cc8-b223-b82b6f0acb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:18:15.575261 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4bdf7a-cca4-4cc8-b223-b82b6f0acb95 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:15.579289 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b29fba-00d6-44a3-9a5b-e23f1e155dfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:15.579930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b29fba-00d6-44a3-9a5b-e23f1e155dfd service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:15.580175 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b29fba-00d6-44a3-9a5b-e23f1e155dfd service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:15.580485 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b29fba-00d6-44a3-9a5b-e23f1e155dfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:15.639883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b29fba-00d6-44a3-9a5b-e23f1e155dfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:15.641479 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b29fba-00d6-44a3-9a5b-e23f1e155dfd service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:15.651104 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1284/2584] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:18:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:18:16.207877 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5424284-3a34-4c0c-955a-239a30490f8d service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:16.216580 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5424284-3a34-4c0c-955a-239a30490f8d service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:16.220405 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa5c51-dd46-4f01-b65e-2b5f68ac2ab9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:16.221164 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa5c51-dd46-4f01-b65e-2b5f68ac2ab9 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:16.221448 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa5c51-dd46-4f01-b65e-2b5f68ac2ab9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:16.221726 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa5c51-dd46-4f01-b65e-2b5f68ac2ab9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:16.231373 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa5c51-dd46-4f01-b65e-2b5f68ac2ab9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:16.232827 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa5c51-dd46-4f01-b65e-2b5f68ac2ab9 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:16.245708 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1301/2585] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:18:16 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:18:20.140845 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b29fba-00d6-44a3-9a5b-e23f1e155dfd service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:20.205694 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b29fba-00d6-44a3-9a5b-e23f1e155dfd service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:20.210881 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ec4ae-a9d9-44f3-b210-c406933b7573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:20.211771 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ec4ae-a9d9-44f3-b210-c406933b7573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:20.212062 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ec4ae-a9d9-44f3-b210-c406933b7573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:20.212343 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ec4ae-a9d9-44f3-b210-c406933b7573 admin admin] PATH_INFO: `/v3/users/672f25a52ff149169a140cce726f9ee2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:20.213575 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ec4ae-a9d9-44f3-b210-c406933b7573 admin admin] RBAC: Authorizing `identity:delete_user(user_id=672f25a52ff149169a140cce726f9ee2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:20.215567 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ec4ae-a9d9-44f3-b210-c406933b7573 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:20.266700 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-359ec4ae-a9d9-44f3-b210-c406933b7573 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '672f25a52ff149169a140cce726f9ee2'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:20.267346 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-359ec4ae-a9d9-44f3-b210-c406933b7573 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '672f25a52ff149169a140cce726f9ee2'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:20.275370 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-359ec4ae-a9d9-44f3-b210-c406933b7573 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '672f25a52ff149169a140cce726f9ee2'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:20.286596 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:18:20.287842 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-359ec4ae-a9d9-44f3-b210-c406933b7573 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '672f25a52ff149169a140cce726f9ee2'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:20.288634 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-359ec4ae-a9d9-44f3-b210-c406933b7573 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '672f25a52ff149169a140cce726f9ee2'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:20.302247 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1285/2586] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:18:20 2022] DELETE /identity/v3/users/672f25a52ff149169a140cce726f9ee2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:18:20.306982 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e0cb2-39e0-4a20-8196-de9ef35a18eb None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:20.307496 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e0cb2-39e0-4a20-8196-de9ef35a18eb None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:20.307593 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e0cb2-39e0-4a20-8196-de9ef35a18eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:20.325572 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-7b6e0cb2-39e0-4a20-8196-de9ef35a18eb None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:18:20.326812 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7b6e0cb2-39e0-4a20-8196-de9ef35a18eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:18:20.387809 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1302/2587] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:18:20.398025 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ec4ae-a9d9-44f3-b210-c406933b7573 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:20.399608 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-359ec4ae-a9d9-44f3-b210-c406933b7573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:18:20.460898 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ec4ae-a9d9-44f3-b210-c406933b7573 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:20.465097 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d190a-a9ce-4da1-8aae-1ada48c80878 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:20.465785 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d190a-a9ce-4da1-8aae-1ada48c80878 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:20.466081 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d190a-a9ce-4da1-8aae-1ada48c80878 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:20.466402 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d190a-a9ce-4da1-8aae-1ada48c80878 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:20.477883 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d190a-a9ce-4da1-8aae-1ada48c80878 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:20.479430 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d190a-a9ce-4da1-8aae-1ada48c80878 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:20.489437 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1286/2588] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:18:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:18:20.781131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e0cb2-39e0-4a20-8196-de9ef35a18eb None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:20.782809 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7b6e0cb2-39e0-4a20-8196-de9ef35a18eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:18:20.796465 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e0cb2-39e0-4a20-8196-de9ef35a18eb None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:20.801923 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75628798-610f-42ae-a90d-69e71f7cfe0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:20.802953 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75628798-610f-42ae-a90d-69e71f7cfe0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:20.803325 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75628798-610f-42ae-a90d-69e71f7cfe0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:20.803513 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75628798-610f-42ae-a90d-69e71f7cfe0f admin admin] PATH_INFO: `/v3/projects/dc5724c5b92944d4b105ac8931d5cec9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:20.805008 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75628798-610f-42ae-a90d-69e71f7cfe0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc5724c5b92944d4b105ac8931d5cec9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:20.807531 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75628798-610f-42ae-a90d-69e71f7cfe0f admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:20.859958 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-75628798-610f-42ae-a90d-69e71f7cfe0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc5724c5b92944d4b105ac8931d5cec9', 'request_id': 'req-75628798-610f-42ae-a90d-69e71f7cfe0f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:20.866214 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-75628798-610f-42ae-a90d-69e71f7cfe0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc5724c5b92944d4b105ac8931d5cec9', 'request_id': 'req-75628798-610f-42ae-a90d-69e71f7cfe0f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:20.871750 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-75628798-610f-42ae-a90d-69e71f7cfe0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc5724c5b92944d4b105ac8931d5cec9', 'request_id': 'req-75628798-610f-42ae-a90d-69e71f7cfe0f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:20.875344 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:18:20.887405 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-75628798-610f-42ae-a90d-69e71f7cfe0f admin admin] The token cache is being invalidate because project dc5724c5b92944d4b105ac8931d5cec9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:18:20.887928 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-75628798-610f-42ae-a90d-69e71f7cfe0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:20.888855 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-75628798-610f-42ae-a90d-69e71f7cfe0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:20.890868 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1303/2589] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:18:20 2022] DELETE /identity/v3/projects/dc5724c5b92944d4b105ac8931d5cec9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:18:20.894953 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d190a-a9ce-4da1-8aae-1ada48c80878 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:20.905140 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d190a-a9ce-4da1-8aae-1ada48c80878 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:20.975034 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19620b2-4938-48e5-9b45-eb9f3820b009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:20.975929 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19620b2-4938-48e5-9b45-eb9f3820b009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:20.976211 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19620b2-4938-48e5-9b45-eb9f3820b009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:20.976486 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19620b2-4938-48e5-9b45-eb9f3820b009 admin admin] PATH_INFO: `/v3/users/954b2d9a0c9f4b5787ffecba1cd3a81a` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:20.978087 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19620b2-4938-48e5-9b45-eb9f3820b009 admin admin] RBAC: Authorizing `identity:delete_user(user_id=954b2d9a0c9f4b5787ffecba1cd3a81a)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:20.980078 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19620b2-4938-48e5-9b45-eb9f3820b009 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:21.028535 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a19620b2-4938-48e5-9b45-eb9f3820b009 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '954b2d9a0c9f4b5787ffecba1cd3a81a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:21.029191 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a19620b2-4938-48e5-9b45-eb9f3820b009 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '954b2d9a0c9f4b5787ffecba1cd3a81a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:21.037624 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a19620b2-4938-48e5-9b45-eb9f3820b009 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '954b2d9a0c9f4b5787ffecba1cd3a81a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:21.050407 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a19620b2-4938-48e5-9b45-eb9f3820b009 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '954b2d9a0c9f4b5787ffecba1cd3a81a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:21.051088 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a19620b2-4938-48e5-9b45-eb9f3820b009 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '954b2d9a0c9f4b5787ffecba1cd3a81a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:21.063752 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1287/2590] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:18:20 2022] DELETE /identity/v3/users/954b2d9a0c9f4b5787ffecba1cd3a81a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:18:21.341319 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75628798-610f-42ae-a90d-69e71f7cfe0f admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:21.342965 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-75628798-610f-42ae-a90d-69e71f7cfe0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:18:21.357616 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75628798-610f-42ae-a90d-69e71f7cfe0f admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:21.420131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc0e47-0d63-4946-8837-a0ecf5ee81a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:21.421385 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc0e47-0d63-4946-8837-a0ecf5ee81a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:21.421716 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc0e47-0d63-4946-8837-a0ecf5ee81a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:21.422139 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc0e47-0d63-4946-8837-a0ecf5ee81a3 admin admin] PATH_INFO: `/v3/projects/611fc5dccea943ceaa13debf98389156` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:21.423863 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc0e47-0d63-4946-8837-a0ecf5ee81a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=611fc5dccea943ceaa13debf98389156)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:21.426616 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc0e47-0d63-4946-8837-a0ecf5ee81a3 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:21.480540 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-97bc0e47-0d63-4946-8837-a0ecf5ee81a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '611fc5dccea943ceaa13debf98389156', 'request_id': 'req-97bc0e47-0d63-4946-8837-a0ecf5ee81a3'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:21.487096 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-97bc0e47-0d63-4946-8837-a0ecf5ee81a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '611fc5dccea943ceaa13debf98389156', 'request_id': 'req-97bc0e47-0d63-4946-8837-a0ecf5ee81a3'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:21.492858 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-97bc0e47-0d63-4946-8837-a0ecf5ee81a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '611fc5dccea943ceaa13debf98389156', 'request_id': 'req-97bc0e47-0d63-4946-8837-a0ecf5ee81a3'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:21.507337 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-97bc0e47-0d63-4946-8837-a0ecf5ee81a3 admin admin] The token cache is being invalidate because project 611fc5dccea943ceaa13debf98389156 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:18:21.507626 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-97bc0e47-0d63-4946-8837-a0ecf5ee81a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:21.508256 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-97bc0e47-0d63-4946-8837-a0ecf5ee81a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:21.509832 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1304/2591] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:18:21 2022] DELETE /identity/v3/projects/611fc5dccea943ceaa13debf98389156 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:18:21.513990 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19620b2-4938-48e5-9b45-eb9f3820b009 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:21.515525 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a19620b2-4938-48e5-9b45-eb9f3820b009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:18:21.529084 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19620b2-4938-48e5-9b45-eb9f3820b009 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:21.534474 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:18:21.590627 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123ad28-f1a2-4662-aaaf-5963e59a8d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:21.591515 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123ad28-f1a2-4662-aaaf-5963e59a8d54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:21.591799 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123ad28-f1a2-4662-aaaf-5963e59a8d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:21.592083 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123ad28-f1a2-4662-aaaf-5963e59a8d54 admin admin] PATH_INFO: `/v3/users/826e842f692c4b82be42e347af5ab8ae` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:21.593344 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b123ad28-f1a2-4662-aaaf-5963e59a8d54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=826e842f692c4b82be42e347af5ab8ae)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:21.595359 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b123ad28-f1a2-4662-aaaf-5963e59a8d54 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:21.651172 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-b123ad28-f1a2-4662-aaaf-5963e59a8d54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '826e842f692c4b82be42e347af5ab8ae'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:21.652055 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-b123ad28-f1a2-4662-aaaf-5963e59a8d54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '826e842f692c4b82be42e347af5ab8ae'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:21.662517 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-b123ad28-f1a2-4662-aaaf-5963e59a8d54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '826e842f692c4b82be42e347af5ab8ae'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:21.677892 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-b123ad28-f1a2-4662-aaaf-5963e59a8d54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '826e842f692c4b82be42e347af5ab8ae'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:21.678574 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-b123ad28-f1a2-4662-aaaf-5963e59a8d54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '826e842f692c4b82be42e347af5ab8ae'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:21.695382 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1288/2592] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:18:21 2022] DELETE /identity/v3/users/826e842f692c4b82be42e347af5ab8ae => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:18:21.991694 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc0e47-0d63-4946-8837-a0ecf5ee81a3 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:21.993210 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-97bc0e47-0d63-4946-8837-a0ecf5ee81a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:18:22.006824 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc0e47-0d63-4946-8837-a0ecf5ee81a3 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:22.067261 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1982f-996a-427e-8132-f9ff74657f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:22.068142 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1982f-996a-427e-8132-f9ff74657f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:22.068425 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1982f-996a-427e-8132-f9ff74657f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:22.068712 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1982f-996a-427e-8132-f9ff74657f76 admin admin] PATH_INFO: `/v3/projects/0807a3d00d734c3eb7f895e004067553` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:22.069929 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f1982f-996a-427e-8132-f9ff74657f76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0807a3d00d734c3eb7f895e004067553)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:22.071901 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f1982f-996a-427e-8132-f9ff74657f76 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:22.104557 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:18:22.120650 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a2f1982f-996a-427e-8132-f9ff74657f76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0807a3d00d734c3eb7f895e004067553', 'request_id': 'req-a2f1982f-996a-427e-8132-f9ff74657f76'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:22.126826 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a2f1982f-996a-427e-8132-f9ff74657f76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0807a3d00d734c3eb7f895e004067553', 'request_id': 'req-a2f1982f-996a-427e-8132-f9ff74657f76'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:22.132424 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a2f1982f-996a-427e-8132-f9ff74657f76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0807a3d00d734c3eb7f895e004067553', 'request_id': 'req-a2f1982f-996a-427e-8132-f9ff74657f76'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:22.144778 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a2f1982f-996a-427e-8132-f9ff74657f76 admin admin] The token cache is being invalidate because project 0807a3d00d734c3eb7f895e004067553 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:18:22.145071 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a2f1982f-996a-427e-8132-f9ff74657f76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:22.145702 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a2f1982f-996a-427e-8132-f9ff74657f76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:22.147287 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1305/2593] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:18:21 2022] DELETE /identity/v3/projects/0807a3d00d734c3eb7f895e004067553 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:18:22.152434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd46f7-e50d-46b4-8409-74216fb5c558 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:22.152731 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd46f7-e50d-46b4-8409-74216fb5c558 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:22.153012 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd46f7-e50d-46b4-8409-74216fb5c558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:22.172259 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-81dd46f7-e50d-46b4-8409-74216fb5c558 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:18:22.173470 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-81dd46f7-e50d-46b4-8409-74216fb5c558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:18:22.235904 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1289/2594] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:18:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:18:22.246065 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e66fe-ec5b-4760-b51c-e2b6323fcc60 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:22.246493 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e66fe-ec5b-4760-b51c-e2b6323fcc60 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:22.246827 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e66fe-ec5b-4760-b51c-e2b6323fcc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:22.269484 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-403e66fe-ec5b-4760-b51c-e2b6323fcc60 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:18:22.270760 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-403e66fe-ec5b-4760-b51c-e2b6323fcc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:18:22.280560 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1306/2595] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:18:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:18:22.285377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd46f7-e50d-46b4-8409-74216fb5c558 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:22.296071 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd46f7-e50d-46b4-8409-74216fb5c558 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:22.302184 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e780b4-d016-44e3-a6ff-99bde670ce7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:22.302881 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e780b4-d016-44e3-a6ff-99bde670ce7f admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:22.303173 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e780b4-d016-44e3-a6ff-99bde670ce7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:22.303459 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e780b4-d016-44e3-a6ff-99bde670ce7f admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:22.304203 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e780b4-d016-44e3-a6ff-99bde670ce7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:18:22.304515 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e780b4-d016-44e3-a6ff-99bde670ce7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:22.306188 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e780b4-d016-44e3-a6ff-99bde670ce7f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:22.318575 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1290/2596] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:18:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:18:22.322836 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e66fe-ec5b-4760-b51c-e2b6323fcc60 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:22.332002 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e66fe-ec5b-4760-b51c-e2b6323fcc60 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:22.337120 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8865b8-4683-4086-aefc-a00e0416493e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:22.337780 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8865b8-4683-4086-aefc-a00e0416493e admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:22.338071 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8865b8-4683-4086-aefc-a00e0416493e admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:22.338389 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8865b8-4683-4086-aefc-a00e0416493e admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:22.339096 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8865b8-4683-4086-aefc-a00e0416493e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:22.341002 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8865b8-4683-4086-aefc-a00e0416493e admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:22.368132 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1307/2597] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:18:22 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 04:18:22.372712 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e780b4-d016-44e3-a6ff-99bde670ce7f admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:22.383372 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e780b4-d016-44e3-a6ff-99bde670ce7f admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:22.395553 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:18:22.442727 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5679eed-0570-4562-899a-6538f242044c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:22.443445 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5679eed-0570-4562-899a-6538f242044c admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:22.443733 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5679eed-0570-4562-899a-6538f242044c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:22.444020 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5679eed-0570-4562-899a-6538f242044c admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:22.444724 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5679eed-0570-4562-899a-6538f242044c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:22.446727 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5679eed-0570-4562-899a-6538f242044c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:22.471081 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1291/2598] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:18:22 2022] POST /identity/v3/users => generated 282 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:18:22.475436 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8865b8-4683-4086-aefc-a00e0416493e admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:22.487188 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8865b8-4683-4086-aefc-a00e0416493e admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:22.492266 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76fb4af-f6d9-4592-8bf2-034d5c9512a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:22.492932 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fb4af-f6d9-4592-8bf2-034d5c9512a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:22.493217 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fb4af-f6d9-4592-8bf2-034d5c9512a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:22.493497 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fb4af-f6d9-4592-8bf2-034d5c9512a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:22.494275 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76fb4af-f6d9-4592-8bf2-034d5c9512a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:22.495894 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76fb4af-f6d9-4592-8bf2-034d5c9512a3 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:22.506683 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1308/2599] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:18:22.510578 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5679eed-0570-4562-899a-6538f242044c admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:22.520902 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5679eed-0570-4562-899a-6538f242044c admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:22.526083 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f348b2a-eaae-46a8-8d25-3e87134e17e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:22.526789 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f348b2a-eaae-46a8-8d25-3e87134e17e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:22.527077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f348b2a-eaae-46a8-8d25-3e87134e17e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:22.527353 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f348b2a-eaae-46a8-8d25-3e87134e17e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:22.528094 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f348b2a-eaae-46a8-8d25-3e87134e17e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:22.529724 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f348b2a-eaae-46a8-8d25-3e87134e17e7 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:22.540089 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1292/2600] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:18:22.544377 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76fb4af-f6d9-4592-8bf2-034d5c9512a3 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:22.555720 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76fb4af-f6d9-4592-8bf2-034d5c9512a3 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:22.561133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a42786-77fc-4033-b368-3076c160637e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:22.562068 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a42786-77fc-4033-b368-3076c160637e admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:22.562396 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a42786-77fc-4033-b368-3076c160637e admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:22.562681 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a42786-77fc-4033-b368-3076c160637e admin admin] PATH_INFO: `/v3/projects/ab42528fbe91415489757cd4932ec5b3/users/80704c4eeae0442e875ef750f4640736/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:22.577397 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a42786-77fc-4033-b368-3076c160637e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab42528fbe91415489757cd4932ec5b3, user_id=80704c4eeae0442e875ef750f4640736, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:22.580163 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a42786-77fc-4033-b368-3076c160637e admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:22.594396 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1309/2601] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:18:22 2022] PUT /identity/v3/projects/ab42528fbe91415489757cd4932ec5b3/users/80704c4eeae0442e875ef750f4640736/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:18:22.605242 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7641c27-e9be-4eba-a2a1-b10f729bea36 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:22.605537 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7641c27-e9be-4eba-a2a1-b10f729bea36 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:22.605816 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7641c27-e9be-4eba-a2a1-b10f729bea36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:22.632797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-f7641c27-e9be-4eba-a2a1-b10f729bea36 None None] MFA Rules not processed for user `80704c4eeae0442e875ef750f4640736`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:18:22.634068 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f7641c27-e9be-4eba-a2a1-b10f729bea36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:18:22.703550 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1293/2602] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:18:22 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:18:22.715884 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a42786-77fc-4033-b368-3076c160637e admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:22.717891 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-80a42786-77fc-4033-b368-3076c160637e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:18:22.780999 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a42786-77fc-4033-b368-3076c160637e admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:22.785321 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a03446f-93d4-4925-9383-b7980ee455fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:22.785947 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03446f-93d4-4925-9383-b7980ee455fa service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:22.786283 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03446f-93d4-4925-9383-b7980ee455fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:22.786677 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03446f-93d4-4925-9383-b7980ee455fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:22.796227 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a03446f-93d4-4925-9383-b7980ee455fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:22.797650 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a03446f-93d4-4925-9383-b7980ee455fa service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:22.807079 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1310/2603] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:18:22 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:18:32.700167 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=59,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:18:32.802855 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=67,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:18:45.898104 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7641c27-e9be-4eba-a2a1-b10f729bea36 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:45.899941 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f7641c27-e9be-4eba-a2a1-b10f729bea36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:18:45.962769 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7641c27-e9be-4eba-a2a1-b10f729bea36 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:45.966969 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966f0fc-a596-4d53-b9dc-f4042a04f8f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:45.967635 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966f0fc-a596-4d53-b9dc-f4042a04f8f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:45.967925 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966f0fc-a596-4d53-b9dc-f4042a04f8f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:45.968202 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966f0fc-a596-4d53-b9dc-f4042a04f8f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:45.970563 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e966f0fc-a596-4d53-b9dc-f4042a04f8f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:18:46.038927 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966f0fc-a596-4d53-b9dc-f4042a04f8f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:46.040974 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966f0fc-a596-4d53-b9dc-f4042a04f8f1 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:46.051256 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1294/2604] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:18:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:18:52.380099 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a03446f-93d4-4925-9383-b7980ee455fa service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:52.381793 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4a03446f-93d4-4925-9383-b7980ee455fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:18:52.394270 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a03446f-93d4-4925-9383-b7980ee455fa service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:52.397888 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56a2a0-f532-4656-9e2d-3eb6b1be1521 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:52.398567 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56a2a0-f532-4656-9e2d-3eb6b1be1521 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:52.398849 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56a2a0-f532-4656-9e2d-3eb6b1be1521 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:52.399260 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56a2a0-f532-4656-9e2d-3eb6b1be1521 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:52.401409 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-bc56a2a0-f532-4656-9e2d-3eb6b1be1521 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:18:52.465539 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc56a2a0-f532-4656-9e2d-3eb6b1be1521 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:52.467032 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc56a2a0-f532-4656-9e2d-3eb6b1be1521 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:52.477396 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1311/2605] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:18:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 04:18:56.046164 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=48 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:18:58.875051 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966f0fc-a596-4d53-b9dc-f4042a04f8f1 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:58.878286 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e966f0fc-a596-4d53-b9dc-f4042a04f8f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:18:58.945325 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56a2a0-f532-4656-9e2d-3eb6b1be1521 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:58.946932 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-bc56a2a0-f532-4656-9e2d-3eb6b1be1521 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:18:58.959921 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56a2a0-f532-4656-9e2d-3eb6b1be1521 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:58.979911 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934622a-71b6-44da-8051-dcfb610d69aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:58.981048 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934622a-71b6-44da-8051-dcfb610d69aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:58.982570 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934622a-71b6-44da-8051-dcfb610d69aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:58.982858 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934622a-71b6-44da-8051-dcfb610d69aa admin admin] PATH_INFO: `/v3/users/6cc1f9526a9f4802b121530a82b63a2f` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:58.984114 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934622a-71b6-44da-8051-dcfb610d69aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cc1f9526a9f4802b121530a82b63a2f)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:58.986069 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934622a-71b6-44da-8051-dcfb610d69aa admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:58.999781 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966f0fc-a596-4d53-b9dc-f4042a04f8f1 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:59.006968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76aaff-8b20-4687-973a-a1102d385dd9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a18591461343c3a0a1b0e317734ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:59.007759 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76aaff-8b20-4687-973a-a1102d385dd9 service placement] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:59.008108 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76aaff-8b20-4687-973a-a1102d385dd9 service placement] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:59.008452 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76aaff-8b20-4687-973a-a1102d385dd9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:59.010767 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-da76aaff-8b20-4687-973a-a1102d385dd9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:18:59.033215 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76aaff-8b20-4687-973a-a1102d385dd9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:59.035020 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76aaff-8b20-4687-973a-a1102d385dd9 service placement] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:59.045770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b934622a-71b6-44da-8051-dcfb610d69aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cc1f9526a9f4802b121530a82b63a2f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:59.046888 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1295/2606] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:18:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:18:59.057690 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b934622a-71b6-44da-8051-dcfb610d69aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cc1f9526a9f4802b121530a82b63a2f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:59.058432 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b934622a-71b6-44da-8051-dcfb610d69aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cc1f9526a9f4802b121530a82b63a2f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:59.073386 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b934622a-71b6-44da-8051-dcfb610d69aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cc1f9526a9f4802b121530a82b63a2f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:59.074354 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b934622a-71b6-44da-8051-dcfb610d69aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cc1f9526a9f4802b121530a82b63a2f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:59.088178 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1312/2607] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:18:58 2022] DELETE /identity/v3/users/6cc1f9526a9f4802b121530a82b63a2f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:18:59.277259 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76aaff-8b20-4687-973a-a1102d385dd9 service placement] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:59.279068 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934622a-71b6-44da-8051-dcfb610d69aa admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:59.282373 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b934622a-71b6-44da-8051-dcfb610d69aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:18:59.290284 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76aaff-8b20-4687-973a-a1102d385dd9 service placement] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:59.357244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65b0b6-231b-4849-9161-5903c31910fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:59.358195 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65b0b6-231b-4849-9161-5903c31910fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:59.358576 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65b0b6-231b-4849-9161-5903c31910fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:59.358769 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65b0b6-231b-4849-9161-5903c31910fd admin admin] PATH_INFO: `/v3/users/80704c4eeae0442e875ef750f4640736` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:59.360094 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65b0b6-231b-4849-9161-5903c31910fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=80704c4eeae0442e875ef750f4640736)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:59.362237 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65b0b6-231b-4849-9161-5903c31910fd admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:59.371269 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934622a-71b6-44da-8051-dcfb610d69aa admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:59.378743 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a619f-81b5-48dc-a57e-f4e7f610a778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:59.380641 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a619f-81b5-48dc-a57e-f4e7f610a778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:59.381126 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a619f-81b5-48dc-a57e-f4e7f610a778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:59.381505 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a619f-81b5-48dc-a57e-f4e7f610a778 admin admin] PATH_INFO: `/v3/projects/4acc33ded4144025b9548b2e1ee46fbd` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:59.383015 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a619f-81b5-48dc-a57e-f4e7f610a778 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4acc33ded4144025b9548b2e1ee46fbd)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:59.385882 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a619f-81b5-48dc-a57e-f4e7f610a778 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:59.398538 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:18:59.423515 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ad65b0b6-231b-4849-9161-5903c31910fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80704c4eeae0442e875ef750f4640736'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:59.424508 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ad65b0b6-231b-4849-9161-5903c31910fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80704c4eeae0442e875ef750f4640736'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:59.434221 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ad65b0b6-231b-4849-9161-5903c31910fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80704c4eeae0442e875ef750f4640736'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:59.451564 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ad65b0b6-231b-4849-9161-5903c31910fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80704c4eeae0442e875ef750f4640736'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:59.452330 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ad65b0b6-231b-4849-9161-5903c31910fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80704c4eeae0442e875ef750f4640736'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:59.454414 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-bd9a619f-81b5-48dc-a57e-f4e7f610a778 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4acc33ded4144025b9548b2e1ee46fbd', 'request_id': 'req-bd9a619f-81b5-48dc-a57e-f4e7f610a778'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:59.461770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-bd9a619f-81b5-48dc-a57e-f4e7f610a778 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4acc33ded4144025b9548b2e1ee46fbd', 'request_id': 'req-bd9a619f-81b5-48dc-a57e-f4e7f610a778'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:59.469353 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1296/2608] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:18:59 2022] DELETE /identity/v3/users/80704c4eeae0442e875ef750f4640736 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:18:59.471084 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1d2b6-4a80-41bb-931a-c0a99a8e4ab7 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:59.471424 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1d2b6-4a80-41bb-931a-c0a99a8e4ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:59.471726 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1d2b6-4a80-41bb-931a-c0a99a8e4ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:59.472063 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-bd9a619f-81b5-48dc-a57e-f4e7f610a778 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4acc33ded4144025b9548b2e1ee46fbd', 'request_id': 'req-bd9a619f-81b5-48dc-a57e-f4e7f610a778'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:59.488933 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-bd9a619f-81b5-48dc-a57e-f4e7f610a778 admin admin] The token cache is being invalidate because project 4acc33ded4144025b9548b2e1ee46fbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:18:59.489235 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-bd9a619f-81b5-48dc-a57e-f4e7f610a778 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:59.489884 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-bd9a619f-81b5-48dc-a57e-f4e7f610a778 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:59.491821 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1313/2609] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:18:59 2022] DELETE /identity/v3/projects/4acc33ded4144025b9548b2e1ee46fbd => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:18:59.492536 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-1ee1d2b6-4a80-41bb-931a-c0a99a8e4ab7 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:18:59.493996 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1ee1d2b6-4a80-41bb-931a-c0a99a8e4ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:18:59.495696 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a619f-81b5-48dc-a57e-f4e7f610a778 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:59.497022 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-bd9a619f-81b5-48dc-a57e-f4e7f610a778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:18:59.499122 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:18:59.568486 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1297/2610] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:18:59.572045 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a619f-81b5-48dc-a57e-f4e7f610a778 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:59.578091 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abd9f6-3ffd-4fcd-ae1f-c8e78eb5ac29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:59.579025 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abd9f6-3ffd-4fcd-ae1f-c8e78eb5ac29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:59.579140 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1d2b6-4a80-41bb-931a-c0a99a8e4ab7 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:59.579316 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abd9f6-3ffd-4fcd-ae1f-c8e78eb5ac29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:59.579598 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abd9f6-3ffd-4fcd-ae1f-c8e78eb5ac29 admin admin] PATH_INFO: `/v3/users/75a92d937d044cd0ba94ca4404386d69` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:59.580626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1ee1d2b6-4a80-41bb-931a-c0a99a8e4ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:18:59.580946 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abd9f6-3ffd-4fcd-ae1f-c8e78eb5ac29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75a92d937d044cd0ba94ca4404386d69)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:59.583004 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abd9f6-3ffd-4fcd-ae1f-c8e78eb5ac29 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:59.641361 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-26abd9f6-3ffd-4fcd-ae1f-c8e78eb5ac29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75a92d937d044cd0ba94ca4404386d69'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:59.646027 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1d2b6-4a80-41bb-931a-c0a99a8e4ab7 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:59.650578 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570c8eb-713b-48bc-8417-5c2c66e592b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:59.650755 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-26abd9f6-3ffd-4fcd-ae1f-c8e78eb5ac29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75a92d937d044cd0ba94ca4404386d69'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:59.651251 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570c8eb-713b-48bc-8417-5c2c66e592b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:59.651618 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570c8eb-713b-48bc-8417-5c2c66e592b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:59.651784 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-26abd9f6-3ffd-4fcd-ae1f-c8e78eb5ac29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75a92d937d044cd0ba94ca4404386d69'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:59.651893 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570c8eb-713b-48bc-8417-5c2c66e592b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:59.662464 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570c8eb-713b-48bc-8417-5c2c66e592b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:59.664489 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570c8eb-713b-48bc-8417-5c2c66e592b5 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:59.667820 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-26abd9f6-3ffd-4fcd-ae1f-c8e78eb5ac29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75a92d937d044cd0ba94ca4404386d69'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:59.668621 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-26abd9f6-3ffd-4fcd-ae1f-c8e78eb5ac29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75a92d937d044cd0ba94ca4404386d69'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:18:59.676527 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1298/2611] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:18:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 04:18:59.681979 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1314/2612] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:18:59 2022] DELETE /identity/v3/users/75a92d937d044cd0ba94ca4404386d69 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 04:18:59.872315 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570c8eb-713b-48bc-8417-5c2c66e592b5 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:59.885933 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570c8eb-713b-48bc-8417-5c2c66e592b5 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:59.952105 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e80cab-c003-4fab-8c40-02f326101f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:59.953011 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e80cab-c003-4fab-8c40-02f326101f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:59.953314 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e80cab-c003-4fab-8c40-02f326101f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:59.953598 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e80cab-c003-4fab-8c40-02f326101f76 admin admin] PATH_INFO: `/v3/projects/51276352eb314e54abcb5711e2f1b627` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:59.957165 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e80cab-c003-4fab-8c40-02f326101f76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51276352eb314e54abcb5711e2f1b627)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:59.957165 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e80cab-c003-4fab-8c40-02f326101f76 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:18:59.958646 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abd9f6-3ffd-4fcd-ae1f-c8e78eb5ac29 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:18:59.960346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-26abd9f6-3ffd-4fcd-ae1f-c8e78eb5ac29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:18:59.981364 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abd9f6-3ffd-4fcd-ae1f-c8e78eb5ac29 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:18:59.986385 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1dbae7-6b43-404d-8e61-b192d87ef6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:18:59.987253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1dbae7-6b43-404d-8e61-b192d87ef6ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:18:59.987449 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1dbae7-6b43-404d-8e61-b192d87ef6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:18:59.987733 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1dbae7-6b43-404d-8e61-b192d87ef6ca admin admin] PATH_INFO: `/v3/projects/ab42528fbe91415489757cd4932ec5b3` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:18:59.989231 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1dbae7-6b43-404d-8e61-b192d87ef6ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab42528fbe91415489757cd4932ec5b3)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:18:59.991422 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1dbae7-6b43-404d-8e61-b192d87ef6ca admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:19:00.003622 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:19:00.020478 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c5e80cab-c003-4fab-8c40-02f326101f76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51276352eb314e54abcb5711e2f1b627', 'request_id': 'req-c5e80cab-c003-4fab-8c40-02f326101f76'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:19:00.024941 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:19:00.027548 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c5e80cab-c003-4fab-8c40-02f326101f76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51276352eb314e54abcb5711e2f1b627', 'request_id': 'req-c5e80cab-c003-4fab-8c40-02f326101f76'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:19:00.034987 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c5e80cab-c003-4fab-8c40-02f326101f76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51276352eb314e54abcb5711e2f1b627', 'request_id': 'req-c5e80cab-c003-4fab-8c40-02f326101f76'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:19:00.046050 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-fa1dbae7-6b43-404d-8e61-b192d87ef6ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab42528fbe91415489757cd4932ec5b3', 'request_id': 'req-fa1dbae7-6b43-404d-8e61-b192d87ef6ca'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:19:00.047770 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c5e80cab-c003-4fab-8c40-02f326101f76 admin admin] The token cache is being invalidate because project 51276352eb314e54abcb5711e2f1b627 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:19:00.047904 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c5e80cab-c003-4fab-8c40-02f326101f76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:19:00.048506 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c5e80cab-c003-4fab-8c40-02f326101f76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:19:00.050248 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1299/2613] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:18:59 2022] DELETE /identity/v3/projects/51276352eb314e54abcb5711e2f1b627 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:19:00.053130 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-fa1dbae7-6b43-404d-8e61-b192d87ef6ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab42528fbe91415489757cd4932ec5b3', 'request_id': 'req-fa1dbae7-6b43-404d-8e61-b192d87ef6ca'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:19:00.059882 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-fa1dbae7-6b43-404d-8e61-b192d87ef6ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab42528fbe91415489757cd4932ec5b3', 'request_id': 'req-fa1dbae7-6b43-404d-8e61-b192d87ef6ca'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:19:00.075269 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-fa1dbae7-6b43-404d-8e61-b192d87ef6ca admin admin] The token cache is being invalidate because project ab42528fbe91415489757cd4932ec5b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:19:00.075519 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-fa1dbae7-6b43-404d-8e61-b192d87ef6ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:19:00.076135 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-fa1dbae7-6b43-404d-8e61-b192d87ef6ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:19:00.077751 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1315/2614] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:18:59 2022] DELETE /identity/v3/projects/ab42528fbe91415489757cd4932ec5b3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:19:00.082889 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8d3e5-15b8-4be6-ad01-267e3e058b39 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:19:00.083179 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8d3e5-15b8-4be6-ad01-267e3e058b39 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:19:00.083459 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8d3e5-15b8-4be6-ad01-267e3e058b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:19:00.104738 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-eec8d3e5-15b8-4be6-ad01-267e3e058b39 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:19:00.105997 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-eec8d3e5-15b8-4be6-ad01-267e3e058b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:19:00.171391 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1300/2615] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:19:00.180465 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037eb446-2fad-443f-a5c5-f3e1af4ffa34 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:19:00.180833 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037eb446-2fad-443f-a5c5-f3e1af4ffa34 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:19:00.181103 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037eb446-2fad-443f-a5c5-f3e1af4ffa34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:19:00.203227 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-037eb446-2fad-443f-a5c5-f3e1af4ffa34 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:19:00.204500 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-037eb446-2fad-443f-a5c5-f3e1af4ffa34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:19:00.214657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1316/2616] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:19:00.219033 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8d3e5-15b8-4be6-ad01-267e3e058b39 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:19:00.230713 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8d3e5-15b8-4be6-ad01-267e3e058b39 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:19:00.236582 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d315ac9-211d-4d2f-8437-2f4c47f384d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:19:00.237283 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d315ac9-211d-4d2f-8437-2f4c47f384d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:19:00.237579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d315ac9-211d-4d2f-8437-2f4c47f384d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:19:00.237841 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d315ac9-211d-4d2f-8437-2f4c47f384d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:19:00.238649 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d315ac9-211d-4d2f-8437-2f4c47f384d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:19:00.238954 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d315ac9-211d-4d2f-8437-2f4c47f384d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:19:00.240681 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d315ac9-211d-4d2f-8437-2f4c47f384d6 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:19:00.254888 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1301/2617] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:19:00.269110 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037eb446-2fad-443f-a5c5-f3e1af4ffa34 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:19:00.280165 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037eb446-2fad-443f-a5c5-f3e1af4ffa34 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:19:00.285552 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feffba9-3d2f-4b41-9066-adb11f3d9279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:19:00.286271 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feffba9-3d2f-4b41-9066-adb11f3d9279 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:19:00.286575 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feffba9-3d2f-4b41-9066-adb11f3d9279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:19:00.286855 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feffba9-3d2f-4b41-9066-adb11f3d9279 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:19:00.287568 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feffba9-3d2f-4b41-9066-adb11f3d9279 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:19:00.289579 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feffba9-3d2f-4b41-9066-adb11f3d9279 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:19:00.318533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1317/2618] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:19:00 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:19:00.324158 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d315ac9-211d-4d2f-8437-2f4c47f384d6 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:19:00.341133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d315ac9-211d-4d2f-8437-2f4c47f384d6 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:19:00.405435 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a4a40-671c-46c9-b453-c305d5cfd8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:19:00.406134 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a4a40-671c-46c9-b453-c305d5cfd8a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:19:00.406443 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a4a40-671c-46c9-b453-c305d5cfd8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:19:00.406723 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a4a40-671c-46c9-b453-c305d5cfd8a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:19:00.407434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a4a40-671c-46c9-b453-c305d5cfd8a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:19:00.409395 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a4a40-671c-46c9-b453-c305d5cfd8a6 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:19:00.430518 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1302/2619] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:19:00 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:19:00.435222 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feffba9-3d2f-4b41-9066-adb11f3d9279 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:19:00.446345 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feffba9-3d2f-4b41-9066-adb11f3d9279 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:19:00.451058 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ddb370-fb83-43d6-91ec-a91f053df6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:19:00.451766 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddb370-fb83-43d6-91ec-a91f053df6de admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:19:00.452052 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddb370-fb83-43d6-91ec-a91f053df6de admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:19:00.452340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddb370-fb83-43d6-91ec-a91f053df6de admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:19:00.453097 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ddb370-fb83-43d6-91ec-a91f053df6de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:19:00.454818 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ddb370-fb83-43d6-91ec-a91f053df6de admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:19:00.466609 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1318/2620] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 04:19:00.470830 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a4a40-671c-46c9-b453-c305d5cfd8a6 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:19:00.481496 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a4a40-671c-46c9-b453-c305d5cfd8a6 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:19:00.486649 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897117e-9bc7-4d1b-a622-4f808e788735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:19:00.487311 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897117e-9bc7-4d1b-a622-4f808e788735 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:19:00.487596 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897117e-9bc7-4d1b-a622-4f808e788735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:19:00.487994 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897117e-9bc7-4d1b-a622-4f808e788735 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:19:00.488592 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897117e-9bc7-4d1b-a622-4f808e788735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:19:00.490317 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897117e-9bc7-4d1b-a622-4f808e788735 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:19:00.500750 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1303/2621] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 04:19:00.505411 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ddb370-fb83-43d6-91ec-a91f053df6de admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:19:00.517807 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ddb370-fb83-43d6-91ec-a91f053df6de admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:19:00.523540 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9777846-07b4-4f37-995e-2317388f0e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:19:00.524441 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9777846-07b4-4f37-995e-2317388f0e06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:19:00.524721 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9777846-07b4-4f37-995e-2317388f0e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:19:00.524979 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9777846-07b4-4f37-995e-2317388f0e06 admin admin] PATH_INFO: `/v3/projects/604103aadeff4269b1bdc3cc4da69500/users/6fbef23f1f39449eb761cdafd6ce9d65/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:19:00.540607 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9777846-07b4-4f37-995e-2317388f0e06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=604103aadeff4269b1bdc3cc4da69500, user_id=6fbef23f1f39449eb761cdafd6ce9d65, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:19:00.543370 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9777846-07b4-4f37-995e-2317388f0e06 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:19:00.560780 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1319/2622] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:19:00 2022] PUT /identity/v3/projects/604103aadeff4269b1bdc3cc4da69500/users/6fbef23f1f39449eb761cdafd6ce9d65/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:19:00.574376 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad9e1c-62ba-44a1-8b86-e15a6f597ad2 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:19:00.574674 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad9e1c-62ba-44a1-8b86-e15a6f597ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:19:00.574954 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad9e1c-62ba-44a1-8b86-e15a6f597ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:19:00.604433 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-d8ad9e1c-62ba-44a1-8b86-e15a6f597ad2 None None] MFA Rules not processed for user `6fbef23f1f39449eb761cdafd6ce9d65`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:19:00.605707 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d8ad9e1c-62ba-44a1-8b86-e15a6f597ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:19:00.654661 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:19:00.682387 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1304/2623] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:19:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:19:00.693582 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9777846-07b4-4f37-995e-2317388f0e06 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:19:00.695864 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c9777846-07b4-4f37-995e-2317388f0e06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:19:00.756999 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9777846-07b4-4f37-995e-2317388f0e06 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:19:00.760949 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aba659-0984-4ed5-9642-e8b41466b6c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:19:00.761608 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aba659-0984-4ed5-9642-e8b41466b6c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:19:00.761895 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aba659-0984-4ed5-9642-e8b41466b6c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:19:00.762184 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aba659-0984-4ed5-9642-e8b41466b6c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:19:00.771574 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aba659-0984-4ed5-9642-e8b41466b6c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:19:00.773152 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aba659-0984-4ed5-9642-e8b41466b6c5 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:19:00.782841 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1320/2624] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:19:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:19:03.771362 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd73f5-dd2f-4db9-8b02-b38116d404f9 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:19:03.771922 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd73f5-dd2f-4db9-8b02-b38116d404f9 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:19:03.772044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd73f5-dd2f-4db9-8b02-b38116d404f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:19:03.790625 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-cadd73f5-dd2f-4db9-8b02-b38116d404f9 None None] MFA Rules not processed for user `03e7f908f0a7499792e59e31d497edb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:19:03.791847 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-cadd73f5-dd2f-4db9-8b02-b38116d404f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:19:03.851280 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1305/2625] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Jul 4 04:19:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:19:03.905711 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aba659-0984-4ed5-9642-e8b41466b6c5 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:19:03.907294 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-45aba659-0984-4ed5-9642-e8b41466b6c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:19:03.952952 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:19:03.988750 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aba659-0984-4ed5-9642-e8b41466b6c5 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:19:03.994447 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667fc898-cb80-4f60-ad66-6cbd73ddaf80 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f93fdc98ff425791da3e2194b3a671', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:19:03.995099 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fc898-cb80-4f60-ad66-6cbd73ddaf80 service swift] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:19:03.995383 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fc898-cb80-4f60-ad66-6cbd73ddaf80 service swift] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:19:03.995663 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fc898-cb80-4f60-ad66-6cbd73ddaf80 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:19:04.005326 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667fc898-cb80-4f60-ad66-6cbd73ddaf80 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:19:04.006986 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667fc898-cb80-4f60-ad66-6cbd73ddaf80 service swift] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:19:04.015837 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1321/2626] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Jul 4 04:19:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 04:19:11.670441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd73f5-dd2f-4db9-8b02-b38116d404f9 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:19:11.671974 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-cadd73f5-dd2f-4db9-8b02-b38116d404f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:19:11.753283 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd73f5-dd2f-4db9-8b02-b38116d404f9 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:19:11.758603 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3abc4ab-9e62-4535-aee7-071fff3dc5c5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a18591461343c3a0a1b0e317734ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:19:11.762944 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3abc4ab-9e62-4535-aee7-071fff3dc5c5 service placement] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:19:11.762944 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3abc4ab-9e62-4535-aee7-071fff3dc5c5 service placement] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:19:11.762944 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3abc4ab-9e62-4535-aee7-071fff3dc5c5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:19:11.762944 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d3abc4ab-9e62-4535-aee7-071fff3dc5c5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:19:11.774824 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3abc4ab-9e62-4535-aee7-071fff3dc5c5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:19:11.776533 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3abc4ab-9e62-4535-aee7-071fff3dc5c5 service placement] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:19:11.788667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1306/2627] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:19:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:19:11.939417 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667fc898-cb80-4f60-ad66-6cbd73ddaf80 service swift] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:19:12.013475 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667fc898-cb80-4f60-ad66-6cbd73ddaf80 service swift] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:19:12.018134 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed344478-3393-4609-a451-3521b65eca54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:19:12.019085 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed344478-3393-4609-a451-3521b65eca54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:19:12.019654 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed344478-3393-4609-a451-3521b65eca54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:19:12.019935 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed344478-3393-4609-a451-3521b65eca54 admin admin] PATH_INFO: `/v3/users/6fbef23f1f39449eb761cdafd6ce9d65` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:19:12.021171 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed344478-3393-4609-a451-3521b65eca54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fbef23f1f39449eb761cdafd6ce9d65)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:19:12.023350 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed344478-3393-4609-a451-3521b65eca54 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:19:12.080874 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ed344478-3393-4609-a451-3521b65eca54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fbef23f1f39449eb761cdafd6ce9d65'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:19:12.089408 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ed344478-3393-4609-a451-3521b65eca54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fbef23f1f39449eb761cdafd6ce9d65'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:19:12.090083 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ed344478-3393-4609-a451-3521b65eca54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fbef23f1f39449eb761cdafd6ce9d65'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:19:12.107045 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ed344478-3393-4609-a451-3521b65eca54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fbef23f1f39449eb761cdafd6ce9d65'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:19:12.107791 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ed344478-3393-4609-a451-3521b65eca54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fbef23f1f39449eb761cdafd6ce9d65'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:19:12.129495 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1322/2628] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:19:11 2022] DELETE /identity/v3/users/6fbef23f1f39449eb761cdafd6ce9d65 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:19:12.132456 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bd52b-6bd0-4e0f-bb58-9f58fbbba61f None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:19:12.132765 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bd52b-6bd0-4e0f-bb58-9f58fbbba61f None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:19:12.133055 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bd52b-6bd0-4e0f-bb58-9f58fbbba61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:19:12.155010 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-7f0bd52b-6bd0-4e0f-bb58-9f58fbbba61f None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:19:12.156248 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-7f0bd52b-6bd0-4e0f-bb58-9f58fbbba61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:19:12.223129 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1307/2629] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:19:12.233455 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed344478-3393-4609-a451-3521b65eca54 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:19:12.234993 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ed344478-3393-4609-a451-3521b65eca54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:19:12.295927 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:19:12.300332 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed344478-3393-4609-a451-3521b65eca54 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:19:12.305656 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad262b-3bf8-4161-91b8-496e158f3f68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:19:12.306404 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad262b-3bf8-4161-91b8-496e158f3f68 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:19:12.306851 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad262b-3bf8-4161-91b8-496e158f3f68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:19:12.307299 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad262b-3bf8-4161-91b8-496e158f3f68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:19:12.320822 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ad262b-3bf8-4161-91b8-496e158f3f68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:19:12.322972 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ad262b-3bf8-4161-91b8-496e158f3f68 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:19:12.335390 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1323/2630] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:19:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 04:19:12.680346 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0bd52b-6bd0-4e0f-bb58-9f58fbbba61f None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:19:12.681835 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-7f0bd52b-6bd0-4e0f-bb58-9f58fbbba61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:19:12.697526 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0bd52b-6bd0-4e0f-bb58-9f58fbbba61f None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:19:12.717030 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8d3bb-45b1-473d-a83b-75980ab77402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:19:12.718213 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8d3bb-45b1-473d-a83b-75980ab77402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:19:12.719354 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8d3bb-45b1-473d-a83b-75980ab77402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:19:12.720094 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8d3bb-45b1-473d-a83b-75980ab77402 admin admin] PATH_INFO: `/v3/projects/604103aadeff4269b1bdc3cc4da69500` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:19:12.721698 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c8d3bb-45b1-473d-a83b-75980ab77402 admin admin] RBAC: Authorizing `identity:delete_project(project_id=604103aadeff4269b1bdc3cc4da69500)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:19:12.723744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c8d3bb-45b1-473d-a83b-75980ab77402 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:19:12.734494 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:19:12.805820 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-46c8d3bb-45b1-473d-a83b-75980ab77402 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '604103aadeff4269b1bdc3cc4da69500', 'request_id': 'req-46c8d3bb-45b1-473d-a83b-75980ab77402'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:19:12.813522 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-46c8d3bb-45b1-473d-a83b-75980ab77402 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '604103aadeff4269b1bdc3cc4da69500', 'request_id': 'req-46c8d3bb-45b1-473d-a83b-75980ab77402'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:19:12.824576 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-46c8d3bb-45b1-473d-a83b-75980ab77402 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '604103aadeff4269b1bdc3cc4da69500', 'request_id': 'req-46c8d3bb-45b1-473d-a83b-75980ab77402'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:19:12.849949 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-46c8d3bb-45b1-473d-a83b-75980ab77402 admin admin] The token cache is being invalidate because project 604103aadeff4269b1bdc3cc4da69500 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:19:12.850766 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-46c8d3bb-45b1-473d-a83b-75980ab77402 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:19:12.851600 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-46c8d3bb-45b1-473d-a83b-75980ab77402 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:19:12.853347 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1308/2631] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:19:12 2022] DELETE /identity/v3/projects/604103aadeff4269b1bdc3cc4da69500 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 04:19:18.652096 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ebbba-a7f2-41fa-b5aa-deddaf94b81d None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:19:18.652928 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ebbba-a7f2-41fa-b5aa-deddaf94b81d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:19:18.652928 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ebbba-a7f2-41fa-b5aa-deddaf94b81d None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:19:18.654137 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1324/2632] 10.222.0.49 () {54 vars in 921 bytes} [Mon Jul 4 04:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:19:18.661101 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62eb01b-2cd2-436d-8e6c-795422c4bd41 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:19:18.661630 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62eb01b-2cd2-436d-8e6c-795422c4bd41 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:19:18.661962 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62eb01b-2cd2-436d-8e6c-795422c4bd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:19:18.682653 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-b62eb01b-2cd2-436d-8e6c-795422c4bd41 None None] MFA Rules not processed for user `8334e75253f843a980b01c6f0cda6015`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:19:18.683818 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b62eb01b-2cd2-436d-8e6c-795422c4bd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:19:18.756745 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1309/2633] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Jul 4 04:19:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:19:18.768632 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ebbba-a7f2-41fa-b5aa-deddaf94b81d None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:19:18.770413 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-420ebbba-a7f2-41fa-b5aa-deddaf94b81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:19:18.829608 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ebbba-a7f2-41fa-b5aa-deddaf94b81d None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:19:18.835350 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5f6203-778c-4840-ac29-255f0ddb7707 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e29ce1e3d64431bc7aa80d55787ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:19:18.836008 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f6203-778c-4840-ac29-255f0ddb7707 service glance] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:19:18.836298 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f6203-778c-4840-ac29-255f0ddb7707 service glance] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:19:18.836579 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f6203-778c-4840-ac29-255f0ddb7707 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:19:18.848028 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5f6203-778c-4840-ac29-255f0ddb7707 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:19:18.849487 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5f6203-778c-4840-ac29-255f0ddb7707 service glance] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:19:18.861196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1325/2634] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:19:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:19:18.932147 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f451b95-d01d-457d-9218-a81addc90e6e None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:19:18.932417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f451b95-d01d-457d-9218-a81addc90e6e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:19:18.932768 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f451b95-d01d-457d-9218-a81addc90e6e None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:19:18.934208 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1310/2635] 10.222.0.49 () {54 vars in 921 bytes} [Mon Jul 4 04:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:19:18.939409 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ca373-77c9-434a-b1f1-2f8557da07e4 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:19:18.939911 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ca373-77c9-434a-b1f1-2f8557da07e4 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:19:18.940009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ca373-77c9-434a-b1f1-2f8557da07e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:19:18.960284 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-0e6ca373-77c9-434a-b1f1-2f8557da07e4 None None] MFA Rules not processed for user `b36a8402144c458fa98f80d7e3516127`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:19:18.962500 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0e6ca373-77c9-434a-b1f1-2f8557da07e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:19:19.026464 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1326/2636] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Jul 4 04:19:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:19:19.038252 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f451b95-d01d-457d-9218-a81addc90e6e None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:19:19.040180 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5f451b95-d01d-457d-9218-a81addc90e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:19:19.054194 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f451b95-d01d-457d-9218-a81addc90e6e None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:19:19.058516 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacce193-765d-4869-aebd-ee11e8c8b826 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:19:19.059152 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacce193-765d-4869-aebd-ee11e8c8b826 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:19:19.059438 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacce193-765d-4869-aebd-ee11e8c8b826 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:19:19.059716 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacce193-765d-4869-aebd-ee11e8c8b826 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:19:19.071770 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacce193-765d-4869-aebd-ee11e8c8b826 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:19:19.074806 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacce193-765d-4869-aebd-ee11e8c8b826 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:19:19.086431 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1311/2637] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:19:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:19:19.173363 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ed6ad-3803-4d21-9173-97d6f6521e18 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:19:19.173757 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ed6ad-3803-4d21-9173-97d6f6521e18 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:19:19.174043 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ed6ad-3803-4d21-9173-97d6f6521e18 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:19:19.175518 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1327/2638] 10.222.0.49 () {54 vars in 921 bytes} [Mon Jul 4 04:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 04 04:19:19.181350 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07655f-79bf-4b50-87e1-8fa8d416e01a None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:19:19.181650 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07655f-79bf-4b50-87e1-8fa8d416e01a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:19:19.181932 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07655f-79bf-4b50-87e1-8fa8d416e01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:19:19.200931 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-1c07655f-79bf-4b50-87e1-8fa8d416e01a None None] MFA Rules not processed for user `8334e75253f843a980b01c6f0cda6015`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:19:19.202069 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1c07655f-79bf-4b50-87e1-8fa8d416e01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:19:19.212053 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1312/2639] 10.222.0.49 () {58 vars in 1018 bytes} [Mon Jul 4 04:19:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:19:19.222628 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ed6ad-3803-4d21-9173-97d6f6521e18 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:19:19.224799 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c51ed6ad-3803-4d21-9173-97d6f6521e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:19:19.240289 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ed6ad-3803-4d21-9173-97d6f6521e18 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:19:19.244247 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a24024e-cfa0-4049-a8a9-5c8624450d16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:19:19.244890 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24024e-cfa0-4049-a8a9-5c8624450d16 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:19:19.245182 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24024e-cfa0-4049-a8a9-5c8624450d16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:19:19.245466 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24024e-cfa0-4049-a8a9-5c8624450d16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:19:19.256419 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a24024e-cfa0-4049-a8a9-5c8624450d16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:19:19.257941 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a24024e-cfa0-4049-a8a9-5c8624450d16 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:19:19.270498 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1328/2640] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:19:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:19:21.236723 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055651a0-9385-4275-9738-08157e9a30c8 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:19:21.237209 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055651a0-9385-4275-9738-08157e9a30c8 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:19:21.237321 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055651a0-9385-4275-9738-08157e9a30c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:19:21.263558 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-055651a0-9385-4275-9738-08157e9a30c8 None None] MFA Rules not processed for user `03e7f908f0a7499792e59e31d497edb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:19:21.265361 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-055651a0-9385-4275-9738-08157e9a30c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:19:21.328157 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1313/2641] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Jul 4 04:19:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:19:21.340708 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a24024e-cfa0-4049-a8a9-5c8624450d16 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:19:21.342275 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4a24024e-cfa0-4049-a8a9-5c8624450d16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:19:21.415581 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a24024e-cfa0-4049-a8a9-5c8624450d16 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:19:21.421780 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033dced5-e2dd-42c8-abbc-ff327e2c67c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f93fdc98ff425791da3e2194b3a671', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:19:21.422466 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033dced5-e2dd-42c8-abbc-ff327e2c67c9 service swift] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:19:21.422750 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033dced5-e2dd-42c8-abbc-ff327e2c67c9 service swift] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:19:21.423031 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033dced5-e2dd-42c8-abbc-ff327e2c67c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:19:21.431949 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033dced5-e2dd-42c8-abbc-ff327e2c67c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:19:21.433564 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033dced5-e2dd-42c8-abbc-ff327e2c67c9 service swift] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:19:21.442060 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1329/2642] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Jul 4 04:19:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 04:19:31.319876 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:19:31.438717 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:19:41.427410 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3959be0-7322-4f0a-9675-7f5cc74f20f8 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:19:41.427923 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3959be0-7322-4f0a-9675-7f5cc74f20f8 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:19:41.428021 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3959be0-7322-4f0a-9675-7f5cc74f20f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:19:41.447802 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-d3959be0-7322-4f0a-9675-7f5cc74f20f8 None None] MFA Rules not processed for user `03e7f908f0a7499792e59e31d497edb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:19:41.449477 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d3959be0-7322-4f0a-9675-7f5cc74f20f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:19:41.459041 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1314/2643] 10.222.0.49 () {58 vars in 967 bytes} [Mon Jul 4 04:19:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:19:41.474558 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033dced5-e2dd-42c8-abbc-ff327e2c67c9 service swift] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:19:41.489110 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033dced5-e2dd-42c8-abbc-ff327e2c67c9 service swift] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:19:41.496304 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b0625-9402-4ca5-aaed-b589a247e7a3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f93fdc98ff425791da3e2194b3a671', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:19:41.497017 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b0625-9402-4ca5-aaed-b589a247e7a3 service swift] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:19:41.497275 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b0625-9402-4ca5-aaed-b589a247e7a3 service swift] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:19:41.497547 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b0625-9402-4ca5-aaed-b589a247e7a3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:19:41.506636 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b0625-9402-4ca5-aaed-b589a247e7a3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:19:41.508196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b0625-9402-4ca5-aaed-b589a247e7a3 service swift] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:19:41.516483 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1330/2644] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Jul 4 04:19:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 04:19:51.441781 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:19:51.513274 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=6 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:20:03.035655 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3959be0-7322-4f0a-9675-7f5cc74f20f8 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:03.045792 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3959be0-7322-4f0a-9675-7f5cc74f20f8 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:03.049877 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769cf49d-f6fd-482d-8d05-a75de5c3fcbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:03.050569 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cf49d-f6fd-482d-8d05-a75de5c3fcbc service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:03.050852 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cf49d-f6fd-482d-8d05-a75de5c3fcbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:03.051130 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cf49d-f6fd-482d-8d05-a75de5c3fcbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:03.053153 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-769cf49d-f6fd-482d-8d05-a75de5c3fcbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:03.119701 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769cf49d-f6fd-482d-8d05-a75de5c3fcbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:03.121214 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769cf49d-f6fd-482d-8d05-a75de5c3fcbc service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:03.131180 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1315/2645] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:20:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:20:06.645301 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b0625-9402-4ca5-aaed-b589a247e7a3 service swift] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:06.646952 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6c2b0625-9402-4ca5-aaed-b589a247e7a3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:06.663337 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b0625-9402-4ca5-aaed-b589a247e7a3 service swift] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:06.673252 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe5d8b-4945-4c13-ad84-6df3f0aa268f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:06.674172 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe5d8b-4945-4c13-ad84-6df3f0aa268f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:06.674468 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe5d8b-4945-4c13-ad84-6df3f0aa268f admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:06.674749 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe5d8b-4945-4c13-ad84-6df3f0aa268f admin admin] PATH_INFO: `/v3/users/c8ada8b86e2f4ad18c8af021def1a30e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:06.676115 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe5d8b-4945-4c13-ad84-6df3f0aa268f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8ada8b86e2f4ad18c8af021def1a30e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:06.678140 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe5d8b-4945-4c13-ad84-6df3f0aa268f admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:06.728690 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-affe5d8b-4945-4c13-ad84-6df3f0aa268f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8ada8b86e2f4ad18c8af021def1a30e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:06.737912 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-affe5d8b-4945-4c13-ad84-6df3f0aa268f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8ada8b86e2f4ad18c8af021def1a30e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:06.738725 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-affe5d8b-4945-4c13-ad84-6df3f0aa268f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8ada8b86e2f4ad18c8af021def1a30e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:06.751436 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-affe5d8b-4945-4c13-ad84-6df3f0aa268f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8ada8b86e2f4ad18c8af021def1a30e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:06.752131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-affe5d8b-4945-4c13-ad84-6df3f0aa268f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8ada8b86e2f4ad18c8af021def1a30e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:06.764606 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1331/2646] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:20:06 2022] DELETE /identity/v3/users/c8ada8b86e2f4ad18c8af021def1a30e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:20:06.949691 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769cf49d-f6fd-482d-8d05-a75de5c3fcbc service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:06.960381 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769cf49d-f6fd-482d-8d05-a75de5c3fcbc service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:07.030477 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b12aa-aa27-4964-8822-7c278fa030a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:07.031405 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b12aa-aa27-4964-8822-7c278fa030a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:07.031691 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b12aa-aa27-4964-8822-7c278fa030a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:07.031975 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b12aa-aa27-4964-8822-7c278fa030a7 admin admin] PATH_INFO: `/v3/projects/1ebc2cb9ec154a33940044a5853a2404` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:07.033256 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065b12aa-aa27-4964-8822-7c278fa030a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ebc2cb9ec154a33940044a5853a2404)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:07.035251 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065b12aa-aa27-4964-8822-7c278fa030a7 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:07.087690 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-065b12aa-aa27-4964-8822-7c278fa030a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ebc2cb9ec154a33940044a5853a2404', 'request_id': 'req-065b12aa-aa27-4964-8822-7c278fa030a7'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:07.096069 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-065b12aa-aa27-4964-8822-7c278fa030a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ebc2cb9ec154a33940044a5853a2404', 'request_id': 'req-065b12aa-aa27-4964-8822-7c278fa030a7'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:07.104880 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-065b12aa-aa27-4964-8822-7c278fa030a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ebc2cb9ec154a33940044a5853a2404', 'request_id': 'req-065b12aa-aa27-4964-8822-7c278fa030a7'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:07.119755 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-065b12aa-aa27-4964-8822-7c278fa030a7 admin admin] The token cache is being invalidate because project 1ebc2cb9ec154a33940044a5853a2404 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:20:07.120100 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-065b12aa-aa27-4964-8822-7c278fa030a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:07.120928 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-065b12aa-aa27-4964-8822-7c278fa030a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:07.122762 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1316/2647] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:20:06 2022] DELETE /identity/v3/projects/1ebc2cb9ec154a33940044a5853a2404 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:20:07.130853 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ae05e-8667-40d5-bf6e-056458bf52eb None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:07.131230 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ae05e-8667-40d5-bf6e-056458bf52eb None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:07.131668 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ae05e-8667-40d5-bf6e-056458bf52eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:07.153571 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-4d1ae05e-8667-40d5-bf6e-056458bf52eb None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:20:07.154809 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4d1ae05e-8667-40d5-bf6e-056458bf52eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:07.226006 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1332/2648] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:20:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:20:07.234297 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0e7fb-8ac7-4c94-843c-94426895381d None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:07.234593 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0e7fb-8ac7-4c94-843c-94426895381d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:07.234900 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0e7fb-8ac7-4c94-843c-94426895381d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:07.254644 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e6e0e7fb-8ac7-4c94-843c-94426895381d None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:20:07.255867 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e6e0e7fb-8ac7-4c94-843c-94426895381d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:07.265290 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1317/2649] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:20:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:20:07.269637 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ae05e-8667-40d5-bf6e-056458bf52eb None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:07.279548 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ae05e-8667-40d5-bf6e-056458bf52eb None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:07.284586 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952874b6-e13c-4edb-a3fa-cef7f9b46be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:07.285236 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952874b6-e13c-4edb-a3fa-cef7f9b46be4 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:07.285518 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952874b6-e13c-4edb-a3fa-cef7f9b46be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:07.285798 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952874b6-e13c-4edb-a3fa-cef7f9b46be4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:07.286581 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952874b6-e13c-4edb-a3fa-cef7f9b46be4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:20:07.286890 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952874b6-e13c-4edb-a3fa-cef7f9b46be4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:07.288509 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952874b6-e13c-4edb-a3fa-cef7f9b46be4 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:07.300856 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1333/2650] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:20:07.305236 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0e7fb-8ac7-4c94-843c-94426895381d None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:07.314696 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0e7fb-8ac7-4c94-843c-94426895381d None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:07.319662 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4ea38-1de7-4e8b-b1fc-92aaec03c58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:07.320326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4ea38-1de7-4e8b-b1fc-92aaec03c58f admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:07.320593 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4ea38-1de7-4e8b-b1fc-92aaec03c58f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:07.320860 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4ea38-1de7-4e8b-b1fc-92aaec03c58f admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:07.321578 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4ea38-1de7-4e8b-b1fc-92aaec03c58f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:07.323542 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4ea38-1de7-4e8b-b1fc-92aaec03c58f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:07.338508 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:20:07.355529 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1318/2651] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:20:07 2022] POST /identity/v3/projects => generated 361 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:20:07.359644 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952874b6-e13c-4edb-a3fa-cef7f9b46be4 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:07.370721 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952874b6-e13c-4edb-a3fa-cef7f9b46be4 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:07.439017 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7c9d2-e832-4296-bd12-5f42fb6e181e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:07.439710 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7c9d2-e832-4296-bd12-5f42fb6e181e admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:07.439956 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7c9d2-e832-4296-bd12-5f42fb6e181e admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:07.440236 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7c9d2-e832-4296-bd12-5f42fb6e181e admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:07.441386 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7c9d2-e832-4296-bd12-5f42fb6e181e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:07.443022 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7c9d2-e832-4296-bd12-5f42fb6e181e admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:07.449952 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:20:07.474984 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1334/2652] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:20:07 2022] POST /identity/v3/users => generated 281 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:20:07.478905 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4ea38-1de7-4e8b-b1fc-92aaec03c58f admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:07.491014 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4ea38-1de7-4e8b-b1fc-92aaec03c58f admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:07.496744 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802bb70-1568-4371-a7d0-ab7a0e81fb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:07.497566 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802bb70-1568-4371-a7d0-ab7a0e81fb3d admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:07.497856 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802bb70-1568-4371-a7d0-ab7a0e81fb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:07.498185 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802bb70-1568-4371-a7d0-ab7a0e81fb3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:07.498905 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802bb70-1568-4371-a7d0-ab7a0e81fb3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:07.500545 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802bb70-1568-4371-a7d0-ab7a0e81fb3d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:07.512612 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1319/2653] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:20:07.516783 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7c9d2-e832-4296-bd12-5f42fb6e181e admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:07.528414 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7c9d2-e832-4296-bd12-5f42fb6e181e admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:07.533974 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9a9c0-8890-4f43-b9c1-6659fb88867d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:07.534691 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9a9c0-8890-4f43-b9c1-6659fb88867d admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:07.534986 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9a9c0-8890-4f43-b9c1-6659fb88867d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:07.535267 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9a9c0-8890-4f43-b9c1-6659fb88867d admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:07.536007 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9a9c0-8890-4f43-b9c1-6659fb88867d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:07.537629 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9a9c0-8890-4f43-b9c1-6659fb88867d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:07.548008 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1335/2654] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:20:07.552230 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802bb70-1568-4371-a7d0-ab7a0e81fb3d admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:07.562702 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802bb70-1568-4371-a7d0-ab7a0e81fb3d admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:07.567422 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc83d36-96cf-4647-90ea-40b5872f6fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:07.568317 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc83d36-96cf-4647-90ea-40b5872f6fd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:07.568601 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc83d36-96cf-4647-90ea-40b5872f6fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:07.568881 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc83d36-96cf-4647-90ea-40b5872f6fd8 admin admin] PATH_INFO: `/v3/projects/c3c7da77f91a48b4824275352f7d6bf5/users/e4edfb5b3eac4c169626e51d470faf9e/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:07.584272 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc83d36-96cf-4647-90ea-40b5872f6fd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3c7da77f91a48b4824275352f7d6bf5, user_id=e4edfb5b3eac4c169626e51d470faf9e, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:07.586992 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc83d36-96cf-4647-90ea-40b5872f6fd8 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:07.601398 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1320/2655] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:20:07 2022] PUT /identity/v3/projects/c3c7da77f91a48b4824275352f7d6bf5/users/e4edfb5b3eac4c169626e51d470faf9e/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:20:07.613153 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5288119-6c3a-4efd-bcab-462c9431767b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:07.613452 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5288119-6c3a-4efd-bcab-462c9431767b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:07.613759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5288119-6c3a-4efd-bcab-462c9431767b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:07.641245 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-b5288119-6c3a-4efd-bcab-462c9431767b None None] MFA Rules not processed for user `e4edfb5b3eac4c169626e51d470faf9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:20:07.642619 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b5288119-6c3a-4efd-bcab-462c9431767b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:07.715308 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1336/2656] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:20:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:20:07.719840 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc83d36-96cf-4647-90ea-40b5872f6fd8 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:07.784443 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc83d36-96cf-4647-90ea-40b5872f6fd8 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:07.789540 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9fac02-d026-4d12-8e5c-36fbe9ed50b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:07.790242 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9fac02-d026-4d12-8e5c-36fbe9ed50b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:07.790533 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9fac02-d026-4d12-8e5c-36fbe9ed50b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:07.790816 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9fac02-d026-4d12-8e5c-36fbe9ed50b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:07.791537 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9fac02-d026-4d12-8e5c-36fbe9ed50b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:07.793484 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9fac02-d026-4d12-8e5c-36fbe9ed50b8 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:07.822814 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1321/2657] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:20:07 2022] POST /identity/v3/projects => generated 363 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:20:07.825651 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5288119-6c3a-4efd-bcab-462c9431767b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:07.838991 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5288119-6c3a-4efd-bcab-462c9431767b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:07.898896 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed78e4-101c-4286-a5d1-c96e960d539e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:07.899467 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed78e4-101c-4286-a5d1-c96e960d539e admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:07.899750 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed78e4-101c-4286-a5d1-c96e960d539e admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:07.900026 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed78e4-101c-4286-a5d1-c96e960d539e admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:07.900736 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed78e4-101c-4286-a5d1-c96e960d539e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:07.902684 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed78e4-101c-4286-a5d1-c96e960d539e admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:07.930735 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1337/2658] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:20:07 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:20:07.932116 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9fac02-d026-4d12-8e5c-36fbe9ed50b8 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:07.942933 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9fac02-d026-4d12-8e5c-36fbe9ed50b8 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:07.947657 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637c5ff-d289-4696-8c15-0eaf64466b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:07.948325 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637c5ff-d289-4696-8c15-0eaf64466b58 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:07.948610 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637c5ff-d289-4696-8c15-0eaf64466b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:07.948921 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637c5ff-d289-4696-8c15-0eaf64466b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:07.949652 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637c5ff-d289-4696-8c15-0eaf64466b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:07.951376 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637c5ff-d289-4696-8c15-0eaf64466b58 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:07.962567 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1322/2659] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:20:07.969576 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed78e4-101c-4286-a5d1-c96e960d539e admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:07.980777 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed78e4-101c-4286-a5d1-c96e960d539e admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:07.985898 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80d4ae-b6b9-495d-a79a-c22ea65a5f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:07.986845 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80d4ae-b6b9-495d-a79a-c22ea65a5f76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:07.987120 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80d4ae-b6b9-495d-a79a-c22ea65a5f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:07.987402 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80d4ae-b6b9-495d-a79a-c22ea65a5f76 admin admin] PATH_INFO: `/v3/projects/4a811024b87a42b498427b8475801411/users/975ccc0da6a64de8a7439fa5613c3c4e/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:08.003189 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb80d4ae-b6b9-495d-a79a-c22ea65a5f76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a811024b87a42b498427b8475801411, user_id=975ccc0da6a64de8a7439fa5613c3c4e, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:08.005847 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb80d4ae-b6b9-495d-a79a-c22ea65a5f76 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:08.021327 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1338/2660] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:20:07 2022] PUT /identity/v3/projects/4a811024b87a42b498427b8475801411/users/975ccc0da6a64de8a7439fa5613c3c4e/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 04:20:08.025423 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637c5ff-d289-4696-8c15-0eaf64466b58 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:08.035817 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637c5ff-d289-4696-8c15-0eaf64466b58 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:08.095164 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b913bb2-4379-496b-ba88-398d32a12abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:08.095846 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b913bb2-4379-496b-ba88-398d32a12abb admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:08.096134 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b913bb2-4379-496b-ba88-398d32a12abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:08.096416 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b913bb2-4379-496b-ba88-398d32a12abb admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:08.097158 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b913bb2-4379-496b-ba88-398d32a12abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:08.099207 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b913bb2-4379-496b-ba88-398d32a12abb admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:08.109219 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1323/2661] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 04:20:08.113603 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80d4ae-b6b9-495d-a79a-c22ea65a5f76 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:08.124188 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80d4ae-b6b9-495d-a79a-c22ea65a5f76 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:08.129473 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7d87a-1ee5-4e3c-9d40-fba13e083e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:08.130401 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7d87a-1ee5-4e3c-9d40-fba13e083e41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:08.130692 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7d87a-1ee5-4e3c-9d40-fba13e083e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:08.130983 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7d87a-1ee5-4e3c-9d40-fba13e083e41 admin admin] PATH_INFO: `/v3/projects/4a811024b87a42b498427b8475801411/users/975ccc0da6a64de8a7439fa5613c3c4e/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:08.133106 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c7d87a-1ee5-4e3c-9d40-fba13e083e41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a811024b87a42b498427b8475801411, user_id=975ccc0da6a64de8a7439fa5613c3c4e, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:08.135822 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c7d87a-1ee5-4e3c-9d40-fba13e083e41 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:08.146499 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1339/2662] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:20:08 2022] PUT /identity/v3/projects/4a811024b87a42b498427b8475801411/users/975ccc0da6a64de8a7439fa5613c3c4e/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:20:08.156858 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54de99c-e8dd-4ea2-9582-29fae1928292 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:08.157035 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54de99c-e8dd-4ea2-9582-29fae1928292 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:08.157361 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54de99c-e8dd-4ea2-9582-29fae1928292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:08.185216 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e54de99c-e8dd-4ea2-9582-29fae1928292 None None] MFA Rules not processed for user `975ccc0da6a64de8a7439fa5613c3c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:20:08.186491 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e54de99c-e8dd-4ea2-9582-29fae1928292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:08.205416 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:20:08.258757 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1324/2663] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:20:08 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:20:08.271110 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7d87a-1ee5-4e3c-9d40-fba13e083e41 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:08.273282 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-31c7d87a-1ee5-4e3c-9d40-fba13e083e41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:08.296995 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:20:08.334179 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7d87a-1ee5-4e3c-9d40-fba13e083e41 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:08.338194 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e59e1-b48c-46c3-9fa1-c3f66e8270fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:08.338887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e59e1-b48c-46c3-9fa1-c3f66e8270fd service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:08.339173 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e59e1-b48c-46c3-9fa1-c3f66e8270fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:08.339453 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e59e1-b48c-46c3-9fa1-c3f66e8270fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:08.349299 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328e59e1-b48c-46c3-9fa1-c3f66e8270fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:08.350834 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328e59e1-b48c-46c3-9fa1-c3f66e8270fd service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:08.360445 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1340/2664] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:20:08 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:20:08.434495 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54de99c-e8dd-4ea2-9582-29fae1928292 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:08.444717 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54de99c-e8dd-4ea2-9582-29fae1928292 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:08.448848 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5677b-eb88-435a-be14-fab759743a48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:08.449525 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5677b-eb88-435a-be14-fab759743a48 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:08.449788 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5677b-eb88-435a-be14-fab759743a48 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:08.450072 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5677b-eb88-435a-be14-fab759743a48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:08.508321 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5677b-eb88-435a-be14-fab759743a48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:08.509826 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5677b-eb88-435a-be14-fab759743a48 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:08.518885 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1325/2665] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:20:08 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:20:11.267930 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e59e1-b48c-46c3-9fa1-c3f66e8270fd service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:11.345687 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e59e1-b48c-46c3-9fa1-c3f66e8270fd service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:11.350943 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fffd7e0-115e-497a-b0c5-47ac4a3a6a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:11.351837 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffd7e0-115e-497a-b0c5-47ac4a3a6a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:11.352125 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffd7e0-115e-497a-b0c5-47ac4a3a6a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:11.352407 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffd7e0-115e-497a-b0c5-47ac4a3a6a0d admin admin] PATH_INFO: `/v3/users/e4edfb5b3eac4c169626e51d470faf9e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:11.353628 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fffd7e0-115e-497a-b0c5-47ac4a3a6a0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4edfb5b3eac4c169626e51d470faf9e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:11.355628 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fffd7e0-115e-497a-b0c5-47ac4a3a6a0d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:11.407040 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6fffd7e0-115e-497a-b0c5-47ac4a3a6a0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4edfb5b3eac4c169626e51d470faf9e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:11.415607 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6fffd7e0-115e-497a-b0c5-47ac4a3a6a0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4edfb5b3eac4c169626e51d470faf9e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:11.416239 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6fffd7e0-115e-497a-b0c5-47ac4a3a6a0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4edfb5b3eac4c169626e51d470faf9e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:11.428461 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6fffd7e0-115e-497a-b0c5-47ac4a3a6a0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4edfb5b3eac4c169626e51d470faf9e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:11.429075 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6fffd7e0-115e-497a-b0c5-47ac4a3a6a0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4edfb5b3eac4c169626e51d470faf9e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:11.442293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1341/2666] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:20:11 2022] DELETE /identity/v3/users/e4edfb5b3eac4c169626e51d470faf9e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:20:11.447001 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2751d6-2ec6-4ca1-b4a1-3bbac2466f41 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:11.447487 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2751d6-2ec6-4ca1-b4a1-3bbac2466f41 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:11.447606 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2751d6-2ec6-4ca1-b4a1-3bbac2466f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:11.466100 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-0d2751d6-2ec6-4ca1-b4a1-3bbac2466f41 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:20:11.467368 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0d2751d6-2ec6-4ca1-b4a1-3bbac2466f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:11.531990 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1326/2667] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:20:11.543595 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fffd7e0-115e-497a-b0c5-47ac4a3a6a0d admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:11.545682 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6fffd7e0-115e-497a-b0c5-47ac4a3a6a0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:11.593237 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:20:11.608860 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fffd7e0-115e-497a-b0c5-47ac4a3a6a0d admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:11.613179 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4eb568-83e8-4761-8e69-2a5bf5c37463 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:11.613939 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4eb568-83e8-4761-8e69-2a5bf5c37463 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:11.614287 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4eb568-83e8-4761-8e69-2a5bf5c37463 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:11.614571 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4eb568-83e8-4761-8e69-2a5bf5c37463 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:11.625575 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4eb568-83e8-4761-8e69-2a5bf5c37463 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:11.627075 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4eb568-83e8-4761-8e69-2a5bf5c37463 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:11.637346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1342/2668] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:20:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:20:11.919272 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2751d6-2ec6-4ca1-b4a1-3bbac2466f41 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:11.921056 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0d2751d6-2ec6-4ca1-b4a1-3bbac2466f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:11.934048 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2751d6-2ec6-4ca1-b4a1-3bbac2466f41 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:11.939558 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3fc34-adbe-45e2-b364-a3cbd8ab5341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:11.940445 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3fc34-adbe-45e2-b364-a3cbd8ab5341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:11.940731 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3fc34-adbe-45e2-b364-a3cbd8ab5341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:11.941023 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3fc34-adbe-45e2-b364-a3cbd8ab5341 admin admin] PATH_INFO: `/v3/projects/c3c7da77f91a48b4824275352f7d6bf5` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:11.942293 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3fc34-adbe-45e2-b364-a3cbd8ab5341 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3c7da77f91a48b4824275352f7d6bf5)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:11.944400 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3fc34-adbe-45e2-b364-a3cbd8ab5341 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:12.001568 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-58d3fc34-adbe-45e2-b364-a3cbd8ab5341 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3c7da77f91a48b4824275352f7d6bf5', 'request_id': 'req-58d3fc34-adbe-45e2-b364-a3cbd8ab5341'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:12.003140 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:20:12.009316 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-58d3fc34-adbe-45e2-b364-a3cbd8ab5341 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3c7da77f91a48b4824275352f7d6bf5', 'request_id': 'req-58d3fc34-adbe-45e2-b364-a3cbd8ab5341'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:12.016538 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-58d3fc34-adbe-45e2-b364-a3cbd8ab5341 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3c7da77f91a48b4824275352f7d6bf5', 'request_id': 'req-58d3fc34-adbe-45e2-b364-a3cbd8ab5341'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:12.034577 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-58d3fc34-adbe-45e2-b364-a3cbd8ab5341 admin admin] The token cache is being invalidate because project c3c7da77f91a48b4824275352f7d6bf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:20:12.034900 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-58d3fc34-adbe-45e2-b364-a3cbd8ab5341 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:12.035873 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-58d3fc34-adbe-45e2-b364-a3cbd8ab5341 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:12.038005 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1327/2669] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:20:11 2022] DELETE /identity/v3/projects/c3c7da77f91a48b4824275352f7d6bf5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:20:12.043504 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4eb568-83e8-4761-8e69-2a5bf5c37463 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:12.053975 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4eb568-83e8-4761-8e69-2a5bf5c37463 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:12.124863 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95cedb1-785d-48d5-8f84-f62acf45b735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:12.125748 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95cedb1-785d-48d5-8f84-f62acf45b735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:12.126037 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95cedb1-785d-48d5-8f84-f62acf45b735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:12.126347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95cedb1-785d-48d5-8f84-f62acf45b735 admin admin] PATH_INFO: `/v3/users/975ccc0da6a64de8a7439fa5613c3c4e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:12.127583 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95cedb1-785d-48d5-8f84-f62acf45b735 admin admin] RBAC: Authorizing `identity:delete_user(user_id=975ccc0da6a64de8a7439fa5613c3c4e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:12.129526 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95cedb1-785d-48d5-8f84-f62acf45b735 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:12.182591 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c95cedb1-785d-48d5-8f84-f62acf45b735 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '975ccc0da6a64de8a7439fa5613c3c4e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:12.190913 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c95cedb1-785d-48d5-8f84-f62acf45b735 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '975ccc0da6a64de8a7439fa5613c3c4e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:12.191528 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c95cedb1-785d-48d5-8f84-f62acf45b735 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '975ccc0da6a64de8a7439fa5613c3c4e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:12.203531 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c95cedb1-785d-48d5-8f84-f62acf45b735 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '975ccc0da6a64de8a7439fa5613c3c4e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:12.204162 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c95cedb1-785d-48d5-8f84-f62acf45b735 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '975ccc0da6a64de8a7439fa5613c3c4e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:12.216106 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1343/2670] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:20:12 2022] DELETE /identity/v3/users/975ccc0da6a64de8a7439fa5613c3c4e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:20:12.503132 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3fc34-adbe-45e2-b364-a3cbd8ab5341 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:12.504630 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-58d3fc34-adbe-45e2-b364-a3cbd8ab5341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:12.525714 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3fc34-adbe-45e2-b364-a3cbd8ab5341 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:12.585564 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9bbeab-3d19-4cbc-a9d3-9214e4eaa4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:12.586408 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9bbeab-3d19-4cbc-a9d3-9214e4eaa4f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:12.586688 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9bbeab-3d19-4cbc-a9d3-9214e4eaa4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:12.586967 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9bbeab-3d19-4cbc-a9d3-9214e4eaa4f8 admin admin] PATH_INFO: `/v3/projects/4a811024b87a42b498427b8475801411` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:12.588309 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9bbeab-3d19-4cbc-a9d3-9214e4eaa4f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a811024b87a42b498427b8475801411)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:12.590294 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9bbeab-3d19-4cbc-a9d3-9214e4eaa4f8 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:12.639483 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-7d9bbeab-3d19-4cbc-a9d3-9214e4eaa4f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a811024b87a42b498427b8475801411', 'request_id': 'req-7d9bbeab-3d19-4cbc-a9d3-9214e4eaa4f8'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:12.645375 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-7d9bbeab-3d19-4cbc-a9d3-9214e4eaa4f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a811024b87a42b498427b8475801411', 'request_id': 'req-7d9bbeab-3d19-4cbc-a9d3-9214e4eaa4f8'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:12.651878 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-7d9bbeab-3d19-4cbc-a9d3-9214e4eaa4f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a811024b87a42b498427b8475801411', 'request_id': 'req-7d9bbeab-3d19-4cbc-a9d3-9214e4eaa4f8'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:12.666870 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-7d9bbeab-3d19-4cbc-a9d3-9214e4eaa4f8 admin admin] The token cache is being invalidate because project 4a811024b87a42b498427b8475801411 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:20:12.667161 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-7d9bbeab-3d19-4cbc-a9d3-9214e4eaa4f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:12.667792 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-7d9bbeab-3d19-4cbc-a9d3-9214e4eaa4f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:12.669348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1328/2671] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:20:12 2022] DELETE /identity/v3/projects/4a811024b87a42b498427b8475801411 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:20:12.674522 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b4166-331b-4394-88a2-223dd56b9a75 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:12.674995 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b4166-331b-4394-88a2-223dd56b9a75 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:12.675110 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b4166-331b-4394-88a2-223dd56b9a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:12.694693 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-d69b4166-331b-4394-88a2-223dd56b9a75 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:20:12.695917 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d69b4166-331b-4394-88a2-223dd56b9a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:12.758387 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1344/2672] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:20:12.766521 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2c7db-43cf-48eb-b63c-df9338a4df35 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:12.766826 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2c7db-43cf-48eb-b63c-df9338a4df35 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:12.767081 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2c7db-43cf-48eb-b63c-df9338a4df35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:12.787503 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-afd2c7db-43cf-48eb-b63c-df9338a4df35 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:20:12.788783 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-afd2c7db-43cf-48eb-b63c-df9338a4df35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:12.797994 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1329/2673] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:20:12.802725 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b4166-331b-4394-88a2-223dd56b9a75 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:12.809086 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:20:12.813214 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b4166-331b-4394-88a2-223dd56b9a75 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:12.819947 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375fb15-0f33-49e6-878f-23a0b7f10510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:12.820670 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375fb15-0f33-49e6-878f-23a0b7f10510 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:12.821211 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375fb15-0f33-49e6-878f-23a0b7f10510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:12.821510 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375fb15-0f33-49e6-878f-23a0b7f10510 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:12.822474 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375fb15-0f33-49e6-878f-23a0b7f10510 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:20:12.822802 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375fb15-0f33-49e6-878f-23a0b7f10510 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:12.824599 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375fb15-0f33-49e6-878f-23a0b7f10510 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:12.836720 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1345/2674] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:20:12.841262 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2c7db-43cf-48eb-b63c-df9338a4df35 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:12.851599 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2c7db-43cf-48eb-b63c-df9338a4df35 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:12.857351 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78586ca-2e87-405e-974f-0349a0cf9988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:12.858115 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78586ca-2e87-405e-974f-0349a0cf9988 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:12.858438 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78586ca-2e87-405e-974f-0349a0cf9988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:12.858713 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78586ca-2e87-405e-974f-0349a0cf9988 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:12.859440 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78586ca-2e87-405e-974f-0349a0cf9988 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:12.861387 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78586ca-2e87-405e-974f-0349a0cf9988 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:12.891794 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1330/2675] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:20:12 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:20:12.896240 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375fb15-0f33-49e6-878f-23a0b7f10510 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:12.906628 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375fb15-0f33-49e6-878f-23a0b7f10510 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:12.975469 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4214949-3e34-4a06-8d9f-10fca4ee5289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:12.976170 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4214949-3e34-4a06-8d9f-10fca4ee5289 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:12.976454 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4214949-3e34-4a06-8d9f-10fca4ee5289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:12.976732 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4214949-3e34-4a06-8d9f-10fca4ee5289 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:12.977463 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4214949-3e34-4a06-8d9f-10fca4ee5289 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:12.979495 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4214949-3e34-4a06-8d9f-10fca4ee5289 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:13.001941 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1346/2676] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:20:12 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:20:13.006350 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78586ca-2e87-405e-974f-0349a0cf9988 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:13.017273 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78586ca-2e87-405e-974f-0349a0cf9988 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:13.023133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93650c-bdf5-4109-8453-756e458d38f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:13.023803 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93650c-bdf5-4109-8453-756e458d38f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:13.024088 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93650c-bdf5-4109-8453-756e458d38f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:13.024361 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93650c-bdf5-4109-8453-756e458d38f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:13.025104 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e93650c-bdf5-4109-8453-756e458d38f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:13.026775 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e93650c-bdf5-4109-8453-756e458d38f2 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:13.037862 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1331/2677] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:20:13.042020 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4214949-3e34-4a06-8d9f-10fca4ee5289 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:13.052920 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4214949-3e34-4a06-8d9f-10fca4ee5289 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:13.058657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a851d-e4ea-45ef-9706-1deb6b093a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:13.059360 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a851d-e4ea-45ef-9706-1deb6b093a92 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:13.059650 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a851d-e4ea-45ef-9706-1deb6b093a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:13.059931 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a851d-e4ea-45ef-9706-1deb6b093a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:13.060707 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a851d-e4ea-45ef-9706-1deb6b093a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:13.062361 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a851d-e4ea-45ef-9706-1deb6b093a92 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:13.072340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1347/2678] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:20:13.076390 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93650c-bdf5-4109-8453-756e458d38f2 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:13.087361 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93650c-bdf5-4109-8453-756e458d38f2 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:13.093833 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad761f-ac8a-437d-9f16-2cc4d036f94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:13.094787 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad761f-ac8a-437d-9f16-2cc4d036f94f admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:13.095074 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad761f-ac8a-437d-9f16-2cc4d036f94f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:13.095356 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad761f-ac8a-437d-9f16-2cc4d036f94f admin admin] PATH_INFO: `/v3/projects/b12503429995442291e2ff7c21add1ff/users/5e620bb074b241c6b942ac085f26e395/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:13.113000 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad761f-ac8a-437d-9f16-2cc4d036f94f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b12503429995442291e2ff7c21add1ff, user_id=5e620bb074b241c6b942ac085f26e395, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:13.115785 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad761f-ac8a-437d-9f16-2cc4d036f94f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:13.131985 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1332/2679] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:20:13 2022] PUT /identity/v3/projects/b12503429995442291e2ff7c21add1ff/users/5e620bb074b241c6b942ac085f26e395/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:20:13.144550 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c168c-c82f-4746-bbb1-3a13736aa19f None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:13.145061 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c168c-c82f-4746-bbb1-3a13736aa19f None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:13.145436 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c168c-c82f-4746-bbb1-3a13736aa19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:13.179112 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ea9c168c-c82f-4746-bbb1-3a13736aa19f None None] MFA Rules not processed for user `5e620bb074b241c6b942ac085f26e395`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:20:13.180359 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ea9c168c-c82f-4746-bbb1-3a13736aa19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:13.243631 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1348/2680] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:20:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:20:13.248116 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad761f-ac8a-437d-9f16-2cc4d036f94f admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:13.254014 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:20:13.315938 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad761f-ac8a-437d-9f16-2cc4d036f94f admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:13.320837 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ffeb04-48a3-4149-b25a-5624c9db8532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:13.321509 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffeb04-48a3-4149-b25a-5624c9db8532 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:13.321798 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffeb04-48a3-4149-b25a-5624c9db8532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:13.322081 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ffeb04-48a3-4149-b25a-5624c9db8532 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:13.322812 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ffeb04-48a3-4149-b25a-5624c9db8532 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:13.324757 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ffeb04-48a3-4149-b25a-5624c9db8532 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:13.351684 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1333/2681] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:20:13 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:20:13.355778 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c168c-c82f-4746-bbb1-3a13736aa19f None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:13.366621 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c168c-c82f-4746-bbb1-3a13736aa19f None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:13.428063 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f97da6-ec2e-411a-a45d-2d5b9ca1a8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:13.429017 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f97da6-ec2e-411a-a45d-2d5b9ca1a8e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:13.429354 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f97da6-ec2e-411a-a45d-2d5b9ca1a8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:13.429732 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f97da6-ec2e-411a-a45d-2d5b9ca1a8e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:13.430763 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f97da6-ec2e-411a-a45d-2d5b9ca1a8e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:13.433449 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f97da6-ec2e-411a-a45d-2d5b9ca1a8e0 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:13.441078 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:20:13.456356 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1349/2682] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:20:13 2022] POST /identity/v3/users => generated 298 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:20:13.460346 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ffeb04-48a3-4149-b25a-5624c9db8532 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:13.470712 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ffeb04-48a3-4149-b25a-5624c9db8532 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:13.475818 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd258bec-9763-4ad8-b72a-c38cd881f1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:13.476478 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd258bec-9763-4ad8-b72a-c38cd881f1ce admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:13.476765 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd258bec-9763-4ad8-b72a-c38cd881f1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:13.477046 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd258bec-9763-4ad8-b72a-c38cd881f1ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:13.477784 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd258bec-9763-4ad8-b72a-c38cd881f1ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:13.479442 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd258bec-9763-4ad8-b72a-c38cd881f1ce admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:13.489967 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1334/2683] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 04:20:13.494338 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f97da6-ec2e-411a-a45d-2d5b9ca1a8e0 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:13.505153 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f97da6-ec2e-411a-a45d-2d5b9ca1a8e0 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:13.510814 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903df1b1-669b-4ec1-88b0-221bc71c1fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:13.511818 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903df1b1-669b-4ec1-88b0-221bc71c1fef admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:13.512107 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903df1b1-669b-4ec1-88b0-221bc71c1fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:13.512386 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903df1b1-669b-4ec1-88b0-221bc71c1fef admin admin] PATH_INFO: `/v3/projects/a3cc24da3982435488024b97d48ba90d/users/f268358343e4408daf0c382ceefec268/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:13.530875 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903df1b1-669b-4ec1-88b0-221bc71c1fef admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3cc24da3982435488024b97d48ba90d, user_id=f268358343e4408daf0c382ceefec268, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:13.533701 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903df1b1-669b-4ec1-88b0-221bc71c1fef admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:13.548364 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1350/2684] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:20:13 2022] PUT /identity/v3/projects/a3cc24da3982435488024b97d48ba90d/users/f268358343e4408daf0c382ceefec268/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:20:13.552632 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd258bec-9763-4ad8-b72a-c38cd881f1ce admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:13.563161 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd258bec-9763-4ad8-b72a-c38cd881f1ce admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:13.625376 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f26643-8164-46a2-beb7-3481abb0e7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:13.625996 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f26643-8164-46a2-beb7-3481abb0e7b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:13.626322 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f26643-8164-46a2-beb7-3481abb0e7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:13.626613 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f26643-8164-46a2-beb7-3481abb0e7b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:13.627352 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f26643-8164-46a2-beb7-3481abb0e7b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:13.629010 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f26643-8164-46a2-beb7-3481abb0e7b5 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:13.639237 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1335/2685] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:20:13.643592 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903df1b1-669b-4ec1-88b0-221bc71c1fef admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:13.655445 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903df1b1-669b-4ec1-88b0-221bc71c1fef admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:13.661377 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147b631-a1b2-4f00-830f-b95b24c5d8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:13.662321 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147b631-a1b2-4f00-830f-b95b24c5d8cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:13.662606 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147b631-a1b2-4f00-830f-b95b24c5d8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:13.662883 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147b631-a1b2-4f00-830f-b95b24c5d8cb admin admin] PATH_INFO: `/v3/projects/a3cc24da3982435488024b97d48ba90d/users/f268358343e4408daf0c382ceefec268/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:13.665357 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e147b631-a1b2-4f00-830f-b95b24c5d8cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3cc24da3982435488024b97d48ba90d, user_id=f268358343e4408daf0c382ceefec268, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:13.668274 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e147b631-a1b2-4f00-830f-b95b24c5d8cb admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:13.680041 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1351/2686] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:20:13 2022] PUT /identity/v3/projects/a3cc24da3982435488024b97d48ba90d/users/f268358343e4408daf0c382ceefec268/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:20:13.690646 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657d024-666e-46eb-82a8-5a46df9fdecd None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:13.690944 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657d024-666e-46eb-82a8-5a46df9fdecd None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:13.691225 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657d024-666e-46eb-82a8-5a46df9fdecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:13.719018 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-1657d024-666e-46eb-82a8-5a46df9fdecd None None] MFA Rules not processed for user `f268358343e4408daf0c382ceefec268`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:20:13.720264 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1657d024-666e-46eb-82a8-5a46df9fdecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:13.787187 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:20:13.791560 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1336/2687] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:20:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:20:13.803171 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147b631-a1b2-4f00-830f-b95b24c5d8cb admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:13.805057 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e147b631-a1b2-4f00-830f-b95b24c5d8cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:13.866119 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147b631-a1b2-4f00-830f-b95b24c5d8cb admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:13.870452 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24cc95-fce0-4fe6-9f5f-1d566c78d709 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:13.871117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24cc95-fce0-4fe6-9f5f-1d566c78d709 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:13.871394 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24cc95-fce0-4fe6-9f5f-1d566c78d709 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:13.871668 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24cc95-fce0-4fe6-9f5f-1d566c78d709 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:13.881517 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24cc95-fce0-4fe6-9f5f-1d566c78d709 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:13.882969 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24cc95-fce0-4fe6-9f5f-1d566c78d709 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:13.893024 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1352/2688] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:20:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:20:13.958689 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657d024-666e-46eb-82a8-5a46df9fdecd None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:14.021984 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657d024-666e-46eb-82a8-5a46df9fdecd None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:14.026710 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ad42b-c75c-4a91-a02d-bf0d5d0a91a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:14.027634 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ad42b-c75c-4a91-a02d-bf0d5d0a91a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:14.027955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ad42b-c75c-4a91-a02d-bf0d5d0a91a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:14.028266 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ad42b-c75c-4a91-a02d-bf0d5d0a91a3 admin admin] PATH_INFO: `/v3/users/5e620bb074b241c6b942ac085f26e395` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:14.029713 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ad42b-c75c-4a91-a02d-bf0d5d0a91a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e620bb074b241c6b942ac085f26e395)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:14.031795 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ad42b-c75c-4a91-a02d-bf0d5d0a91a3 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:14.081355 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-264ad42b-c75c-4a91-a02d-bf0d5d0a91a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e620bb074b241c6b942ac085f26e395'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:14.082036 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-264ad42b-c75c-4a91-a02d-bf0d5d0a91a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e620bb074b241c6b942ac085f26e395'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:14.089831 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-264ad42b-c75c-4a91-a02d-bf0d5d0a91a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e620bb074b241c6b942ac085f26e395'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:14.103056 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-264ad42b-c75c-4a91-a02d-bf0d5d0a91a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e620bb074b241c6b942ac085f26e395'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:14.103721 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-264ad42b-c75c-4a91-a02d-bf0d5d0a91a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e620bb074b241c6b942ac085f26e395'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:14.116038 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1337/2689] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:20:13 2022] DELETE /identity/v3/users/5e620bb074b241c6b942ac085f26e395 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:20:14.120655 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64240715-f0a5-4786-9b12-c47c631951b6 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:14.120951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64240715-f0a5-4786-9b12-c47c631951b6 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:14.121239 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64240715-f0a5-4786-9b12-c47c631951b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:14.138777 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-64240715-f0a5-4786-9b12-c47c631951b6 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:20:14.139967 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-64240715-f0a5-4786-9b12-c47c631951b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:14.201458 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1353/2690] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:20:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:20:14.212381 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ad42b-c75c-4a91-a02d-bf0d5d0a91a3 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:14.213961 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-264ad42b-c75c-4a91-a02d-bf0d5d0a91a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:14.283172 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ad42b-c75c-4a91-a02d-bf0d5d0a91a3 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:14.287864 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bff880-de37-491e-835e-b157a89e480d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:14.288538 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bff880-de37-491e-835e-b157a89e480d service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:14.288822 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bff880-de37-491e-835e-b157a89e480d service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:14.289080 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bff880-de37-491e-835e-b157a89e480d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:14.299618 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bff880-de37-491e-835e-b157a89e480d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:14.301091 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bff880-de37-491e-835e-b157a89e480d service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:14.311213 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1338/2691] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:20:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:20:14.600060 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64240715-f0a5-4786-9b12-c47c631951b6 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:14.601710 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-64240715-f0a5-4786-9b12-c47c631951b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:14.614518 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64240715-f0a5-4786-9b12-c47c631951b6 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:14.619856 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4aa3e7-05bb-456d-b49e-2fffe4cc1106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:14.620735 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4aa3e7-05bb-456d-b49e-2fffe4cc1106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:14.621096 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4aa3e7-05bb-456d-b49e-2fffe4cc1106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:14.621288 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4aa3e7-05bb-456d-b49e-2fffe4cc1106 admin admin] PATH_INFO: `/v3/projects/b12503429995442291e2ff7c21add1ff` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:14.622623 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4aa3e7-05bb-456d-b49e-2fffe4cc1106 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b12503429995442291e2ff7c21add1ff)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:14.629453 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4aa3e7-05bb-456d-b49e-2fffe4cc1106 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:14.679769 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7a4aa3e7-05bb-456d-b49e-2fffe4cc1106 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b12503429995442291e2ff7c21add1ff', 'request_id': 'req-7a4aa3e7-05bb-456d-b49e-2fffe4cc1106'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:14.680581 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:20:14.687405 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7a4aa3e7-05bb-456d-b49e-2fffe4cc1106 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b12503429995442291e2ff7c21add1ff', 'request_id': 'req-7a4aa3e7-05bb-456d-b49e-2fffe4cc1106'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:14.694538 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7a4aa3e7-05bb-456d-b49e-2fffe4cc1106 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b12503429995442291e2ff7c21add1ff', 'request_id': 'req-7a4aa3e7-05bb-456d-b49e-2fffe4cc1106'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:14.710903 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7a4aa3e7-05bb-456d-b49e-2fffe4cc1106 admin admin] The token cache is being invalidate because project b12503429995442291e2ff7c21add1ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:20:14.711197 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7a4aa3e7-05bb-456d-b49e-2fffe4cc1106 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:14.711845 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7a4aa3e7-05bb-456d-b49e-2fffe4cc1106 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:14.713473 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1354/2692] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:20:14 2022] DELETE /identity/v3/projects/b12503429995442291e2ff7c21add1ff => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:20:14.717813 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bff880-de37-491e-835e-b157a89e480d service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:14.728080 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bff880-de37-491e-835e-b157a89e480d service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:14.748263 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:20:14.790198 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee60a26-7cbb-464b-8760-0faf1ef01314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:14.791455 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee60a26-7cbb-464b-8760-0faf1ef01314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:14.791708 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee60a26-7cbb-464b-8760-0faf1ef01314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:14.792023 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee60a26-7cbb-464b-8760-0faf1ef01314 admin admin] PATH_INFO: `/v3/users/f268358343e4408daf0c382ceefec268` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:14.793322 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee60a26-7cbb-464b-8760-0faf1ef01314 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f268358343e4408daf0c382ceefec268)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:14.795347 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee60a26-7cbb-464b-8760-0faf1ef01314 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:14.845522 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-cee60a26-7cbb-464b-8760-0faf1ef01314 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f268358343e4408daf0c382ceefec268'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:14.846204 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-cee60a26-7cbb-464b-8760-0faf1ef01314 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f268358343e4408daf0c382ceefec268'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:14.854921 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-cee60a26-7cbb-464b-8760-0faf1ef01314 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f268358343e4408daf0c382ceefec268'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:14.866690 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-cee60a26-7cbb-464b-8760-0faf1ef01314 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f268358343e4408daf0c382ceefec268'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:14.867319 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-cee60a26-7cbb-464b-8760-0faf1ef01314 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f268358343e4408daf0c382ceefec268'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:14.879485 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1339/2693] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:20:14 2022] DELETE /identity/v3/users/f268358343e4408daf0c382ceefec268 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:20:15.173422 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4aa3e7-05bb-456d-b49e-2fffe4cc1106 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:15.174923 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7a4aa3e7-05bb-456d-b49e-2fffe4cc1106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:15.188590 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4aa3e7-05bb-456d-b49e-2fffe4cc1106 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:15.249399 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9cadb0-deb1-4b6d-9a4a-b3e991ea4498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:15.250225 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9cadb0-deb1-4b6d-9a4a-b3e991ea4498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:15.250513 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9cadb0-deb1-4b6d-9a4a-b3e991ea4498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:15.250793 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9cadb0-deb1-4b6d-9a4a-b3e991ea4498 admin admin] PATH_INFO: `/v3/projects/a3cc24da3982435488024b97d48ba90d` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:15.251980 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9cadb0-deb1-4b6d-9a4a-b3e991ea4498 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3cc24da3982435488024b97d48ba90d)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:15.253910 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9cadb0-deb1-4b6d-9a4a-b3e991ea4498 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:15.304366 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-dd9cadb0-deb1-4b6d-9a4a-b3e991ea4498 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3cc24da3982435488024b97d48ba90d', 'request_id': 'req-dd9cadb0-deb1-4b6d-9a4a-b3e991ea4498'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:15.310507 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-dd9cadb0-deb1-4b6d-9a4a-b3e991ea4498 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3cc24da3982435488024b97d48ba90d', 'request_id': 'req-dd9cadb0-deb1-4b6d-9a4a-b3e991ea4498'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:15.316066 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-dd9cadb0-deb1-4b6d-9a4a-b3e991ea4498 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3cc24da3982435488024b97d48ba90d', 'request_id': 'req-dd9cadb0-deb1-4b6d-9a4a-b3e991ea4498'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:15.331199 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-dd9cadb0-deb1-4b6d-9a4a-b3e991ea4498 admin admin] The token cache is being invalidate because project a3cc24da3982435488024b97d48ba90d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:20:15.331564 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-dd9cadb0-deb1-4b6d-9a4a-b3e991ea4498 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:15.332202 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-dd9cadb0-deb1-4b6d-9a4a-b3e991ea4498 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:15.333749 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1355/2694] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:20:15 2022] DELETE /identity/v3/projects/a3cc24da3982435488024b97d48ba90d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:20:15.339057 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe8cc3-c1a6-40d3-8500-c4c6a038e08c None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:15.339403 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe8cc3-c1a6-40d3-8500-c4c6a038e08c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:15.339713 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe8cc3-c1a6-40d3-8500-c4c6a038e08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:15.358557 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-9bbe8cc3-c1a6-40d3-8500-c4c6a038e08c None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:20:15.359790 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9bbe8cc3-c1a6-40d3-8500-c4c6a038e08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:15.429669 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1340/2695] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:20:15.441049 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdae0a-0fed-48fd-b669-b1e53925071d None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:15.441346 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdae0a-0fed-48fd-b669-b1e53925071d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:15.441630 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdae0a-0fed-48fd-b669-b1e53925071d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:15.468462 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-b5cdae0a-0fed-48fd-b669-b1e53925071d None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:20:15.469716 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b5cdae0a-0fed-48fd-b669-b1e53925071d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:15.480273 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1356/2696] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:20:15.484932 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe8cc3-c1a6-40d3-8500-c4c6a038e08c None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:15.495850 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe8cc3-c1a6-40d3-8500-c4c6a038e08c None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:15.501723 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750463ab-8f6d-4f97-945a-1db4d768bbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:15.502325 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750463ab-8f6d-4f97-945a-1db4d768bbcc admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:15.502618 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750463ab-8f6d-4f97-945a-1db4d768bbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:15.502909 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750463ab-8f6d-4f97-945a-1db4d768bbcc admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:15.503621 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750463ab-8f6d-4f97-945a-1db4d768bbcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:20:15.503938 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750463ab-8f6d-4f97-945a-1db4d768bbcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:15.505572 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750463ab-8f6d-4f97-945a-1db4d768bbcc admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:15.518367 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1341/2697] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:20:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:20:15.522915 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cdae0a-0fed-48fd-b669-b1e53925071d None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:15.532650 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cdae0a-0fed-48fd-b669-b1e53925071d None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:15.539311 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7285536-b202-41c3-8509-a454c3489c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:15.540300 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7285536-b202-41c3-8509-a454c3489c88 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:15.540688 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7285536-b202-41c3-8509-a454c3489c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:15.540977 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7285536-b202-41c3-8509-a454c3489c88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:15.541681 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7285536-b202-41c3-8509-a454c3489c88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:15.544302 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7285536-b202-41c3-8509-a454c3489c88 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:15.572520 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1357/2698] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:20:15 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:20:15.576881 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750463ab-8f6d-4f97-945a-1db4d768bbcc admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:15.587212 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750463ab-8f6d-4f97-945a-1db4d768bbcc admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:15.614344 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:20:15.647705 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c7f1e-9a6e-4692-bf78-4f9f142bcb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:15.648388 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c7f1e-9a6e-4692-bf78-4f9f142bcb4b admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:15.648675 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c7f1e-9a6e-4692-bf78-4f9f142bcb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:15.648956 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c7f1e-9a6e-4692-bf78-4f9f142bcb4b admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:15.649654 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6c7f1e-9a6e-4692-bf78-4f9f142bcb4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:15.651633 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6c7f1e-9a6e-4692-bf78-4f9f142bcb4b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:15.674059 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1342/2699] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:20:15 2022] POST /identity/v3/users => generated 283 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:20:15.678353 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7285536-b202-41c3-8509-a454c3489c88 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:15.689434 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7285536-b202-41c3-8509-a454c3489c88 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:15.694650 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe95fa-db48-4e60-8d73-de927107342a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:15.695220 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe95fa-db48-4e60-8d73-de927107342a admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:15.695513 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe95fa-db48-4e60-8d73-de927107342a admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:15.695785 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe95fa-db48-4e60-8d73-de927107342a admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:15.696526 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe95fa-db48-4e60-8d73-de927107342a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:15.698188 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe95fa-db48-4e60-8d73-de927107342a admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:15.709332 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1358/2700] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:20:15.713502 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c7f1e-9a6e-4692-bf78-4f9f142bcb4b admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:15.724313 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c7f1e-9a6e-4692-bf78-4f9f142bcb4b admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:15.729450 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ace515-56ad-46e2-9af6-2c837d70a264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:15.730221 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ace515-56ad-46e2-9af6-2c837d70a264 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:15.730489 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ace515-56ad-46e2-9af6-2c837d70a264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:15.730779 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ace515-56ad-46e2-9af6-2c837d70a264 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:15.731525 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ace515-56ad-46e2-9af6-2c837d70a264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:15.733195 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ace515-56ad-46e2-9af6-2c837d70a264 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:15.744308 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1343/2701] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:20:15.748695 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe95fa-db48-4e60-8d73-de927107342a admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:15.759149 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe95fa-db48-4e60-8d73-de927107342a admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:15.764375 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d672835-c7fb-4c2e-8ca5-6ad5283552d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:15.765262 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d672835-c7fb-4c2e-8ca5-6ad5283552d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:15.765556 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d672835-c7fb-4c2e-8ca5-6ad5283552d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:15.765840 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d672835-c7fb-4c2e-8ca5-6ad5283552d6 admin admin] PATH_INFO: `/v3/projects/839ef8b00f3742599e4945e5042b2f6a/users/d5c16ba0e0d1443b97c0b64a3b7857a6/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:15.782592 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d672835-c7fb-4c2e-8ca5-6ad5283552d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=839ef8b00f3742599e4945e5042b2f6a, user_id=d5c16ba0e0d1443b97c0b64a3b7857a6, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:15.785265 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d672835-c7fb-4c2e-8ca5-6ad5283552d6 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:15.802685 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1359/2702] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:20:15 2022] PUT /identity/v3/projects/839ef8b00f3742599e4945e5042b2f6a/users/d5c16ba0e0d1443b97c0b64a3b7857a6/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:20:15.816930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903c3c7-ab5b-45d0-a7c8-73b089895889 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:15.817223 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903c3c7-ab5b-45d0-a7c8-73b089895889 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:15.817503 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903c3c7-ab5b-45d0-a7c8-73b089895889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:15.843860 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-8903c3c7-ab5b-45d0-a7c8-73b089895889 None None] MFA Rules not processed for user `d5c16ba0e0d1443b97c0b64a3b7857a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:20:15.845079 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-8903c3c7-ab5b-45d0-a7c8-73b089895889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:15.928975 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1344/2703] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:20:15 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:20:15.933738 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d672835-c7fb-4c2e-8ca5-6ad5283552d6 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:15.939915 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:20:15.999480 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d672835-c7fb-4c2e-8ca5-6ad5283552d6 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:16.004537 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699ec4a-33cb-4107-815e-501b24c28725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:16.005199 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699ec4a-33cb-4107-815e-501b24c28725 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:16.005481 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699ec4a-33cb-4107-815e-501b24c28725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:16.005760 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699ec4a-33cb-4107-815e-501b24c28725 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:16.006483 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699ec4a-33cb-4107-815e-501b24c28725 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:16.008373 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699ec4a-33cb-4107-815e-501b24c28725 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:16.041536 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1360/2704] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:20:15 2022] POST /identity/v3/projects => generated 367 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:20:16.045684 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903c3c7-ab5b-45d0-a7c8-73b089895889 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:16.056866 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903c3c7-ab5b-45d0-a7c8-73b089895889 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:16.120674 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221d00e-0be1-4de3-90fb-5542f45111fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:16.121800 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221d00e-0be1-4de3-90fb-5542f45111fe admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:16.122336 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221d00e-0be1-4de3-90fb-5542f45111fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:16.122844 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221d00e-0be1-4de3-90fb-5542f45111fe admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:16.124131 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221d00e-0be1-4de3-90fb-5542f45111fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:16.127012 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221d00e-0be1-4de3-90fb-5542f45111fe admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:16.151434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1345/2705] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:20:16 2022] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 04:20:16.157064 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699ec4a-33cb-4107-815e-501b24c28725 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:16.171172 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699ec4a-33cb-4107-815e-501b24c28725 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:16.177158 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6bdbe-37e5-43f4-9e48-c16e4b2a67f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:16.177830 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6bdbe-37e5-43f4-9e48-c16e4b2a67f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:16.178118 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6bdbe-37e5-43f4-9e48-c16e4b2a67f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:16.178430 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6bdbe-37e5-43f4-9e48-c16e4b2a67f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:16.179175 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db6bdbe-37e5-43f4-9e48-c16e4b2a67f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:16.180788 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db6bdbe-37e5-43f4-9e48-c16e4b2a67f8 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:16.191951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1361/2706] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:20:16.196175 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221d00e-0be1-4de3-90fb-5542f45111fe admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:16.208490 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221d00e-0be1-4de3-90fb-5542f45111fe admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:16.217201 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b112589-fef3-4990-9549-e3397831e9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:16.218090 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b112589-fef3-4990-9549-e3397831e9f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:16.218402 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b112589-fef3-4990-9549-e3397831e9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:16.218680 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b112589-fef3-4990-9549-e3397831e9f3 admin admin] PATH_INFO: `/v3/projects/7dfb6903193e4c0bb90f876e64468ae8/users/99f70468d3f84198a99802109ca1ce36/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:16.234383 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b112589-fef3-4990-9549-e3397831e9f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dfb6903193e4c0bb90f876e64468ae8, user_id=99f70468d3f84198a99802109ca1ce36, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:16.237044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b112589-fef3-4990-9549-e3397831e9f3 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:16.251023 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1346/2707] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:20:16 2022] PUT /identity/v3/projects/7dfb6903193e4c0bb90f876e64468ae8/users/99f70468d3f84198a99802109ca1ce36/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:20:16.255186 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6bdbe-37e5-43f4-9e48-c16e4b2a67f8 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:16.266207 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6bdbe-37e5-43f4-9e48-c16e4b2a67f8 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:16.324940 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae6398-e0e8-4f3d-839b-8772ff272aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:16.325522 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae6398-e0e8-4f3d-839b-8772ff272aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:16.325807 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae6398-e0e8-4f3d-839b-8772ff272aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:16.326093 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae6398-e0e8-4f3d-839b-8772ff272aa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:16.326918 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dae6398-e0e8-4f3d-839b-8772ff272aa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:16.328544 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dae6398-e0e8-4f3d-839b-8772ff272aa4 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:16.338362 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1362/2708] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:20:16.344212 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b112589-fef3-4990-9549-e3397831e9f3 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:16.350119 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:20:16.357237 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b112589-fef3-4990-9549-e3397831e9f3 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:16.362884 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6db8db-8474-4b4c-8417-b7dd172dca66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:16.363772 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6db8db-8474-4b4c-8417-b7dd172dca66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:16.364064 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6db8db-8474-4b4c-8417-b7dd172dca66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:16.364339 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6db8db-8474-4b4c-8417-b7dd172dca66 admin admin] PATH_INFO: `/v3/projects/7dfb6903193e4c0bb90f876e64468ae8/users/99f70468d3f84198a99802109ca1ce36/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:16.366525 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6db8db-8474-4b4c-8417-b7dd172dca66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dfb6903193e4c0bb90f876e64468ae8, user_id=99f70468d3f84198a99802109ca1ce36, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:16.369198 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6db8db-8474-4b4c-8417-b7dd172dca66 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:16.379796 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1347/2709] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:20:16 2022] PUT /identity/v3/projects/7dfb6903193e4c0bb90f876e64468ae8/users/99f70468d3f84198a99802109ca1ce36/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 04:20:16.389865 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffff5ad-2b19-49fe-bd44-397d63ab5b4c None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:16.390197 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffff5ad-2b19-49fe-bd44-397d63ab5b4c None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:16.390508 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffff5ad-2b19-49fe-bd44-397d63ab5b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:16.417041 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-4ffff5ad-2b19-49fe-bd44-397d63ab5b4c None None] MFA Rules not processed for user `99f70468d3f84198a99802109ca1ce36`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:20:16.418292 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4ffff5ad-2b19-49fe-bd44-397d63ab5b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:16.488647 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:20:16.493102 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1363/2710] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:20:16 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:20:16.505081 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6db8db-8474-4b4c-8417-b7dd172dca66 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:16.506965 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0d6db8db-8474-4b4c-8417-b7dd172dca66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:16.566100 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6db8db-8474-4b4c-8417-b7dd172dca66 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:16.570357 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd419120-6979-4706-93fa-b3fdf312dee9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:16.571014 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd419120-6979-4706-93fa-b3fdf312dee9 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:16.571297 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd419120-6979-4706-93fa-b3fdf312dee9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:16.571579 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd419120-6979-4706-93fa-b3fdf312dee9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:16.581083 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd419120-6979-4706-93fa-b3fdf312dee9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:16.582523 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd419120-6979-4706-93fa-b3fdf312dee9 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:16.592014 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1348/2711] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:20:16 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:20:16.672809 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffff5ad-2b19-49fe-bd44-397d63ab5b4c None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:16.683178 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffff5ad-2b19-49fe-bd44-397d63ab5b4c None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:16.687636 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b729ae6-ab4e-48b3-adf8-ad723e72b7af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:16.688293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b729ae6-ab4e-48b3-adf8-ad723e72b7af service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:16.688582 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b729ae6-ab4e-48b3-adf8-ad723e72b7af service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:16.688862 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b729ae6-ab4e-48b3-adf8-ad723e72b7af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:16.750229 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b729ae6-ab4e-48b3-adf8-ad723e72b7af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:16.751686 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b729ae6-ab4e-48b3-adf8-ad723e72b7af service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:16.760699 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1364/2712] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:20:16 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:20:21.561382 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd419120-6979-4706-93fa-b3fdf312dee9 service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:21.633531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd419120-6979-4706-93fa-b3fdf312dee9 service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:21.638705 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d3ea9-d2f8-4482-8728-7c164b60f320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:21.639559 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d3ea9-d2f8-4482-8728-7c164b60f320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:21.639897 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d3ea9-d2f8-4482-8728-7c164b60f320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:21.640213 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d3ea9-d2f8-4482-8728-7c164b60f320 admin admin] PATH_INFO: `/v3/users/d5c16ba0e0d1443b97c0b64a3b7857a6` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:21.641435 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d3ea9-d2f8-4482-8728-7c164b60f320 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5c16ba0e0d1443b97c0b64a3b7857a6)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:21.643543 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d3ea9-d2f8-4482-8728-7c164b60f320 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:21.693428 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-961d3ea9-d2f8-4482-8728-7c164b60f320 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5c16ba0e0d1443b97c0b64a3b7857a6'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:21.694210 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-961d3ea9-d2f8-4482-8728-7c164b60f320 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5c16ba0e0d1443b97c0b64a3b7857a6'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:21.703489 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-961d3ea9-d2f8-4482-8728-7c164b60f320 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5c16ba0e0d1443b97c0b64a3b7857a6'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:21.716296 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-961d3ea9-d2f8-4482-8728-7c164b60f320 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5c16ba0e0d1443b97c0b64a3b7857a6'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:21.716976 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-961d3ea9-d2f8-4482-8728-7c164b60f320 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5c16ba0e0d1443b97c0b64a3b7857a6'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:21.730167 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1349/2713] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:20:21 2022] DELETE /identity/v3/users/d5c16ba0e0d1443b97c0b64a3b7857a6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:20:21.734861 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa40e2e-9853-4907-804c-fad67517340b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:21.735321 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa40e2e-9853-4907-804c-fad67517340b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:21.735422 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa40e2e-9853-4907-804c-fad67517340b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:21.759625 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-9aa40e2e-9853-4907-804c-fad67517340b None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:20:21.760853 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9aa40e2e-9853-4907-804c-fad67517340b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:21.827935 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1365/2714] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:20:21.837898 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d3ea9-d2f8-4482-8728-7c164b60f320 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:21.839527 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-961d3ea9-d2f8-4482-8728-7c164b60f320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:21.854652 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:20:21.909837 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d3ea9-d2f8-4482-8728-7c164b60f320 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:21.914549 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4407cb6-23a1-4c77-9833-c8b07926f637 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:21.915545 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4407cb6-23a1-4c77-9833-c8b07926f637 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:21.915835 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4407cb6-23a1-4c77-9833-c8b07926f637 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:21.916116 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4407cb6-23a1-4c77-9833-c8b07926f637 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:21.925845 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4407cb6-23a1-4c77-9833-c8b07926f637 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:21.927353 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4407cb6-23a1-4c77-9833-c8b07926f637 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:21.937494 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1350/2715] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:20:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:20:22.214289 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa40e2e-9853-4907-804c-fad67517340b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:22.215995 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9aa40e2e-9853-4907-804c-fad67517340b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:22.229005 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa40e2e-9853-4907-804c-fad67517340b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:22.234414 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054d94e-55ce-4e74-aecf-a9da7b239038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:22.235391 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054d94e-55ce-4e74-aecf-a9da7b239038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:22.235667 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054d94e-55ce-4e74-aecf-a9da7b239038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:22.235951 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054d94e-55ce-4e74-aecf-a9da7b239038 admin admin] PATH_INFO: `/v3/projects/839ef8b00f3742599e4945e5042b2f6a` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:22.237653 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3054d94e-55ce-4e74-aecf-a9da7b239038 admin admin] RBAC: Authorizing `identity:delete_project(project_id=839ef8b00f3742599e4945e5042b2f6a)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:22.239708 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3054d94e-55ce-4e74-aecf-a9da7b239038 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:22.291016 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3054d94e-55ce-4e74-aecf-a9da7b239038 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '839ef8b00f3742599e4945e5042b2f6a', 'request_id': 'req-3054d94e-55ce-4e74-aecf-a9da7b239038'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:22.297343 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3054d94e-55ce-4e74-aecf-a9da7b239038 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '839ef8b00f3742599e4945e5042b2f6a', 'request_id': 'req-3054d94e-55ce-4e74-aecf-a9da7b239038'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:22.303095 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3054d94e-55ce-4e74-aecf-a9da7b239038 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '839ef8b00f3742599e4945e5042b2f6a', 'request_id': 'req-3054d94e-55ce-4e74-aecf-a9da7b239038'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:22.318717 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3054d94e-55ce-4e74-aecf-a9da7b239038 admin admin] The token cache is being invalidate because project 839ef8b00f3742599e4945e5042b2f6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:20:22.319011 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3054d94e-55ce-4e74-aecf-a9da7b239038 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:22.319721 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3054d94e-55ce-4e74-aecf-a9da7b239038 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:22.321341 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1366/2716] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:20:22 2022] DELETE /identity/v3/projects/839ef8b00f3742599e4945e5042b2f6a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:20:22.325555 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4407cb6-23a1-4c77-9833-c8b07926f637 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:22.335295 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4407cb6-23a1-4c77-9833-c8b07926f637 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:22.392022 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66eadf2-f530-4c08-8cbb-17d7aa247930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:22.392945 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66eadf2-f530-4c08-8cbb-17d7aa247930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:22.393226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66eadf2-f530-4c08-8cbb-17d7aa247930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:22.393504 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66eadf2-f530-4c08-8cbb-17d7aa247930 admin admin] PATH_INFO: `/v3/users/99f70468d3f84198a99802109ca1ce36` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:22.394823 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66eadf2-f530-4c08-8cbb-17d7aa247930 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99f70468d3f84198a99802109ca1ce36)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:22.396783 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66eadf2-f530-4c08-8cbb-17d7aa247930 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:22.447505 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e66eadf2-f530-4c08-8cbb-17d7aa247930 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99f70468d3f84198a99802109ca1ce36'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:22.448223 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e66eadf2-f530-4c08-8cbb-17d7aa247930 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99f70468d3f84198a99802109ca1ce36'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:22.456778 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e66eadf2-f530-4c08-8cbb-17d7aa247930 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99f70468d3f84198a99802109ca1ce36'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:22.468741 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e66eadf2-f530-4c08-8cbb-17d7aa247930 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99f70468d3f84198a99802109ca1ce36'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:22.469443 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e66eadf2-f530-4c08-8cbb-17d7aa247930 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99f70468d3f84198a99802109ca1ce36'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:22.482440 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1351/2717] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:20:22 2022] DELETE /identity/v3/users/99f70468d3f84198a99802109ca1ce36 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:20:22.765171 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054d94e-55ce-4e74-aecf-a9da7b239038 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:22.767135 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3054d94e-55ce-4e74-aecf-a9da7b239038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:22.781338 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054d94e-55ce-4e74-aecf-a9da7b239038 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:22.801190 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:20:22.844492 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398eed9-37fd-4fd9-9b67-bccebbbf0c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:22.845403 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398eed9-37fd-4fd9-9b67-bccebbbf0c8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:22.845692 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398eed9-37fd-4fd9-9b67-bccebbbf0c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:22.845970 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398eed9-37fd-4fd9-9b67-bccebbbf0c8b admin admin] PATH_INFO: `/v3/projects/7dfb6903193e4c0bb90f876e64468ae8` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:22.847309 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398eed9-37fd-4fd9-9b67-bccebbbf0c8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dfb6903193e4c0bb90f876e64468ae8)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:22.849544 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398eed9-37fd-4fd9-9b67-bccebbbf0c8b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:22.898637 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8398eed9-37fd-4fd9-9b67-bccebbbf0c8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dfb6903193e4c0bb90f876e64468ae8', 'request_id': 'req-8398eed9-37fd-4fd9-9b67-bccebbbf0c8b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:22.904715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8398eed9-37fd-4fd9-9b67-bccebbbf0c8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dfb6903193e4c0bb90f876e64468ae8', 'request_id': 'req-8398eed9-37fd-4fd9-9b67-bccebbbf0c8b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:22.910436 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8398eed9-37fd-4fd9-9b67-bccebbbf0c8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dfb6903193e4c0bb90f876e64468ae8', 'request_id': 'req-8398eed9-37fd-4fd9-9b67-bccebbbf0c8b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:22.925462 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8398eed9-37fd-4fd9-9b67-bccebbbf0c8b admin admin] The token cache is being invalidate because project 7dfb6903193e4c0bb90f876e64468ae8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:20:22.925759 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8398eed9-37fd-4fd9-9b67-bccebbbf0c8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:22.926441 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8398eed9-37fd-4fd9-9b67-bccebbbf0c8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:22.928034 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1367/2718] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:20:22 2022] DELETE /identity/v3/projects/7dfb6903193e4c0bb90f876e64468ae8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:20:22.933009 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86d322-c36b-487d-939e-ad04d0e2047e None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:22.933513 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86d322-c36b-487d-939e-ad04d0e2047e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:22.933612 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86d322-c36b-487d-939e-ad04d0e2047e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:22.955939 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-6b86d322-c36b-487d-939e-ad04d0e2047e None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:20:22.957174 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6b86d322-c36b-487d-939e-ad04d0e2047e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:22.990581 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:20:23.025342 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1352/2719] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:20:23.034621 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7f305-eaf6-4f15-9e23-cc3de22ac0f5 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:23.034913 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7f305-eaf6-4f15-9e23-cc3de22ac0f5 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:23.035199 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7f305-eaf6-4f15-9e23-cc3de22ac0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:23.060870 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-87e7f305-eaf6-4f15-9e23-cc3de22ac0f5 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:20:23.062815 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-87e7f305-eaf6-4f15-9e23-cc3de22ac0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:23.071196 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1368/2720] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:20:23.075661 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b86d322-c36b-487d-939e-ad04d0e2047e None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:23.085739 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b86d322-c36b-487d-939e-ad04d0e2047e None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:23.090886 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782cb1c2-dd9f-4d82-9d2b-40dbde7715ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:23.091554 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cb1c2-dd9f-4d82-9d2b-40dbde7715ac admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:23.091842 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cb1c2-dd9f-4d82-9d2b-40dbde7715ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:23.092127 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cb1c2-dd9f-4d82-9d2b-40dbde7715ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:23.092867 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782cb1c2-dd9f-4d82-9d2b-40dbde7715ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:20:23.093183 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782cb1c2-dd9f-4d82-9d2b-40dbde7715ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:23.094946 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782cb1c2-dd9f-4d82-9d2b-40dbde7715ac admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:23.108307 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1353/2721] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:20:23.114345 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7f305-eaf6-4f15-9e23-cc3de22ac0f5 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:23.124382 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7f305-eaf6-4f15-9e23-cc3de22ac0f5 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:23.129823 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de9fe8-ea50-4396-8d1c-fc1f5add2265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:23.130507 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de9fe8-ea50-4396-8d1c-fc1f5add2265 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:23.130798 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de9fe8-ea50-4396-8d1c-fc1f5add2265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:23.131083 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de9fe8-ea50-4396-8d1c-fc1f5add2265 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:23.131781 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5de9fe8-ea50-4396-8d1c-fc1f5add2265 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:23.133697 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5de9fe8-ea50-4396-8d1c-fc1f5add2265 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:23.162370 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1369/2722] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:20:23 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:20:23.166654 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782cb1c2-dd9f-4d82-9d2b-40dbde7715ac admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:23.177203 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782cb1c2-dd9f-4d82-9d2b-40dbde7715ac admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:23.236642 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d0704-c820-4cc7-91ea-e5ffb921a51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:23.237316 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d0704-c820-4cc7-91ea-e5ffb921a51d admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:23.237611 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d0704-c820-4cc7-91ea-e5ffb921a51d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:23.237885 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d0704-c820-4cc7-91ea-e5ffb921a51d admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:23.238636 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d0704-c820-4cc7-91ea-e5ffb921a51d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:23.240613 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d0704-c820-4cc7-91ea-e5ffb921a51d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:23.262377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1354/2723] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:20:23 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:20:23.266520 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de9fe8-ea50-4396-8d1c-fc1f5add2265 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:23.277344 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de9fe8-ea50-4396-8d1c-fc1f5add2265 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:23.283268 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c8cf2-f479-4877-a4ae-e0f5e0fabe17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:23.283938 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c8cf2-f479-4877-a4ae-e0f5e0fabe17 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:23.284227 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c8cf2-f479-4877-a4ae-e0f5e0fabe17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:23.284506 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c8cf2-f479-4877-a4ae-e0f5e0fabe17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:23.285245 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c8cf2-f479-4877-a4ae-e0f5e0fabe17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:23.286920 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c8cf2-f479-4877-a4ae-e0f5e0fabe17 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:23.297896 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1370/2724] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:20:23.302073 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d0704-c820-4cc7-91ea-e5ffb921a51d admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:23.313458 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d0704-c820-4cc7-91ea-e5ffb921a51d admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:23.318447 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7fb301-bafe-4f88-bcbe-cd71ff956cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:23.319118 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fb301-bafe-4f88-bcbe-cd71ff956cee admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:23.319407 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fb301-bafe-4f88-bcbe-cd71ff956cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:23.319688 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fb301-bafe-4f88-bcbe-cd71ff956cee admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:23.320422 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7fb301-bafe-4f88-bcbe-cd71ff956cee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:23.322052 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7fb301-bafe-4f88-bcbe-cd71ff956cee admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:23.332181 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1355/2725] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:20:23.336257 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c8cf2-f479-4877-a4ae-e0f5e0fabe17 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:23.346599 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c8cf2-f479-4877-a4ae-e0f5e0fabe17 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:23.351607 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06995d7c-14ee-47bd-8381-375360d56803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:23.352496 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06995d7c-14ee-47bd-8381-375360d56803 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:23.352789 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06995d7c-14ee-47bd-8381-375360d56803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:23.353119 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06995d7c-14ee-47bd-8381-375360d56803 admin admin] PATH_INFO: `/v3/projects/786efd37557746aa82784306e1651427/users/9caf183f8eb54e0aa7c1e09781c9a948/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:23.368708 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06995d7c-14ee-47bd-8381-375360d56803 admin admin] RBAC: Authorizing `identity:create_grant(project_id=786efd37557746aa82784306e1651427, user_id=9caf183f8eb54e0aa7c1e09781c9a948, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:23.371489 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06995d7c-14ee-47bd-8381-375360d56803 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:23.386361 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1371/2726] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:20:23 2022] PUT /identity/v3/projects/786efd37557746aa82784306e1651427/users/9caf183f8eb54e0aa7c1e09781c9a948/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:20:23.396825 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d8584-4fda-4070-b174-e1834c0e779e None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:23.397119 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d8584-4fda-4070-b174-e1834c0e779e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:23.397430 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d8584-4fda-4070-b174-e1834c0e779e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:23.425687 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-537d8584-4fda-4070-b174-e1834c0e779e None None] MFA Rules not processed for user `9caf183f8eb54e0aa7c1e09781c9a948`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:20:23.426946 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-537d8584-4fda-4070-b174-e1834c0e779e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:23.495219 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1356/2727] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:20:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:20:23.508552 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06995d7c-14ee-47bd-8381-375360d56803 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:23.510687 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-06995d7c-14ee-47bd-8381-375360d56803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:23.568165 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:20:23.574499 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06995d7c-14ee-47bd-8381-375360d56803 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:23.581802 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4e542-4fd7-46c6-801d-5dc143e66fdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:23.582521 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4e542-4fd7-46c6-801d-5dc143e66fdc service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:23.582811 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4e542-4fd7-46c6-801d-5dc143e66fdc service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:23.583098 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4e542-4fd7-46c6-801d-5dc143e66fdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:23.592023 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4e542-4fd7-46c6-801d-5dc143e66fdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:23.593482 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4e542-4fd7-46c6-801d-5dc143e66fdc service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:23.602813 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1372/2728] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:20:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:20:23.623322 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d8584-4fda-4070-b174-e1834c0e779e None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:23.654616 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:20:23.688379 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d8584-4fda-4070-b174-e1834c0e779e None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:23.693489 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1fe35c-ffb9-472e-ae18-f16aeb9d19e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:23.694413 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fe35c-ffb9-472e-ae18-f16aeb9d19e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:23.694686 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fe35c-ffb9-472e-ae18-f16aeb9d19e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:23.694964 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fe35c-ffb9-472e-ae18-f16aeb9d19e1 admin admin] PATH_INFO: `/v3/users/9caf183f8eb54e0aa7c1e09781c9a948` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:23.696244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1fe35c-ffb9-472e-ae18-f16aeb9d19e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9caf183f8eb54e0aa7c1e09781c9a948)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:23.698186 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1fe35c-ffb9-472e-ae18-f16aeb9d19e1 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:23.748366 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3e1fe35c-ffb9-472e-ae18-f16aeb9d19e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9caf183f8eb54e0aa7c1e09781c9a948'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:23.749006 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3e1fe35c-ffb9-472e-ae18-f16aeb9d19e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9caf183f8eb54e0aa7c1e09781c9a948'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:23.756978 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3e1fe35c-ffb9-472e-ae18-f16aeb9d19e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9caf183f8eb54e0aa7c1e09781c9a948'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:23.768820 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3e1fe35c-ffb9-472e-ae18-f16aeb9d19e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9caf183f8eb54e0aa7c1e09781c9a948'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:23.769438 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3e1fe35c-ffb9-472e-ae18-f16aeb9d19e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9caf183f8eb54e0aa7c1e09781c9a948'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:23.782164 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1357/2729] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:20:23 2022] DELETE /identity/v3/users/9caf183f8eb54e0aa7c1e09781c9a948 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:20:23.787009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a31f1f-d36b-4752-abd1-1fd3d937086e None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:23.787499 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a31f1f-d36b-4752-abd1-1fd3d937086e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:23.787597 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a31f1f-d36b-4752-abd1-1fd3d937086e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:23.808001 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-37a31f1f-d36b-4752-abd1-1fd3d937086e None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:20:23.809281 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-37a31f1f-d36b-4752-abd1-1fd3d937086e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:23.871400 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1373/2730] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:20:23.881519 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1fe35c-ffb9-472e-ae18-f16aeb9d19e1 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:23.883090 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3e1fe35c-ffb9-472e-ae18-f16aeb9d19e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:23.945736 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1fe35c-ffb9-472e-ae18-f16aeb9d19e1 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:23.950471 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb2d54-4594-4a1d-8465-e2008c0ee97f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:23.951137 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb2d54-4594-4a1d-8465-e2008c0ee97f service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:23.951430 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb2d54-4594-4a1d-8465-e2008c0ee97f service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:23.951711 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb2d54-4594-4a1d-8465-e2008c0ee97f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:23.962084 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb2d54-4594-4a1d-8465-e2008c0ee97f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:23.963613 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb2d54-4594-4a1d-8465-e2008c0ee97f service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:23.975140 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1358/2731] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:20:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:20:24.255165 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a31f1f-d36b-4752-abd1-1fd3d937086e None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:24.256737 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-37a31f1f-d36b-4752-abd1-1fd3d937086e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:24.269739 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a31f1f-d36b-4752-abd1-1fd3d937086e None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:24.275116 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce27eb-ba43-4dee-9e34-41b8e8acb2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:24.275890 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce27eb-ba43-4dee-9e34-41b8e8acb2c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:24.276149 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce27eb-ba43-4dee-9e34-41b8e8acb2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:24.276492 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce27eb-ba43-4dee-9e34-41b8e8acb2c4 admin admin] PATH_INFO: `/v3/projects/786efd37557746aa82784306e1651427` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:24.277678 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce27eb-ba43-4dee-9e34-41b8e8acb2c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=786efd37557746aa82784306e1651427)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:24.279657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce27eb-ba43-4dee-9e34-41b8e8acb2c4 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:24.326985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-01ce27eb-ba43-4dee-9e34-41b8e8acb2c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '786efd37557746aa82784306e1651427', 'request_id': 'req-01ce27eb-ba43-4dee-9e34-41b8e8acb2c4'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:24.333094 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-01ce27eb-ba43-4dee-9e34-41b8e8acb2c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '786efd37557746aa82784306e1651427', 'request_id': 'req-01ce27eb-ba43-4dee-9e34-41b8e8acb2c4'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:24.339069 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-01ce27eb-ba43-4dee-9e34-41b8e8acb2c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '786efd37557746aa82784306e1651427', 'request_id': 'req-01ce27eb-ba43-4dee-9e34-41b8e8acb2c4'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:24.351956 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-01ce27eb-ba43-4dee-9e34-41b8e8acb2c4 admin admin] The token cache is being invalidate because project 786efd37557746aa82784306e1651427 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:20:24.352241 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-01ce27eb-ba43-4dee-9e34-41b8e8acb2c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:24.352847 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-01ce27eb-ba43-4dee-9e34-41b8e8acb2c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:24.354449 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1374/2732] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:20:24 2022] DELETE /identity/v3/projects/786efd37557746aa82784306e1651427 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:20:24.359378 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce75892-55e1-40ba-b8f7-0c4486269199 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:24.359671 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce75892-55e1-40ba-b8f7-0c4486269199 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:24.359949 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce75892-55e1-40ba-b8f7-0c4486269199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:24.377354 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-1ce75892-55e1-40ba-b8f7-0c4486269199 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:20:24.378491 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1ce75892-55e1-40ba-b8f7-0c4486269199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:24.425160 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:20:24.442037 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1359/2733] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:20:24.449863 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e779b4d-0bae-4ca5-82bd-9e92fb460d14 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:24.450172 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e779b4d-0bae-4ca5-82bd-9e92fb460d14 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:24.450477 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e779b4d-0bae-4ca5-82bd-9e92fb460d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:24.469186 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-5e779b4d-0bae-4ca5-82bd-9e92fb460d14 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:20:24.470508 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-5e779b4d-0bae-4ca5-82bd-9e92fb460d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:24.479811 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1375/2734] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:20:24.484192 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce75892-55e1-40ba-b8f7-0c4486269199 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:24.493957 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce75892-55e1-40ba-b8f7-0c4486269199 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:24.499286 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756f725-1744-4663-8ad9-b4ef9d090033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:24.500015 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756f725-1744-4663-8ad9-b4ef9d090033 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:24.500310 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756f725-1744-4663-8ad9-b4ef9d090033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:24.500593 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756f725-1744-4663-8ad9-b4ef9d090033 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:24.501335 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b756f725-1744-4663-8ad9-b4ef9d090033 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:20:24.501652 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b756f725-1744-4663-8ad9-b4ef9d090033 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:24.503333 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b756f725-1744-4663-8ad9-b4ef9d090033 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:24.520478 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1360/2735] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:20:24.524882 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e779b4d-0bae-4ca5-82bd-9e92fb460d14 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:24.534820 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e779b4d-0bae-4ca5-82bd-9e92fb460d14 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:24.540649 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0207292-7d21-4930-84e1-90f9b09b6de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:24.541300 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0207292-7d21-4930-84e1-90f9b09b6de1 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:24.541584 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0207292-7d21-4930-84e1-90f9b09b6de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:24.541867 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0207292-7d21-4930-84e1-90f9b09b6de1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:24.542605 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0207292-7d21-4930-84e1-90f9b09b6de1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:24.544547 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0207292-7d21-4930-84e1-90f9b09b6de1 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:24.573010 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1376/2736] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:20:24 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:20:24.577272 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756f725-1744-4663-8ad9-b4ef9d090033 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:24.587536 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756f725-1744-4663-8ad9-b4ef9d090033 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:24.646970 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce870c-c65b-4a33-9f64-41b75130a352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:24.647584 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce870c-c65b-4a33-9f64-41b75130a352 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:24.647882 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce870c-c65b-4a33-9f64-41b75130a352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:24.648166 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce870c-c65b-4a33-9f64-41b75130a352 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:24.648877 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce870c-c65b-4a33-9f64-41b75130a352 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:24.650936 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce870c-c65b-4a33-9f64-41b75130a352 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:24.672274 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1361/2737] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:20:24 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 04:20:24.676619 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0207292-7d21-4930-84e1-90f9b09b6de1 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:24.687321 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0207292-7d21-4930-84e1-90f9b09b6de1 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:24.692718 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79823cee-8bb2-4773-98fa-863788ff880c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:24.693430 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79823cee-8bb2-4773-98fa-863788ff880c admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:24.693733 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79823cee-8bb2-4773-98fa-863788ff880c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:24.694015 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79823cee-8bb2-4773-98fa-863788ff880c admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:24.694876 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79823cee-8bb2-4773-98fa-863788ff880c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:24.696514 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79823cee-8bb2-4773-98fa-863788ff880c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:24.707221 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1377/2738] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:20:24.711218 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce870c-c65b-4a33-9f64-41b75130a352 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:24.722192 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce870c-c65b-4a33-9f64-41b75130a352 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:24.727479 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d8106-7141-4b67-b18a-1458ac328a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:24.728144 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d8106-7141-4b67-b18a-1458ac328a45 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:24.728456 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d8106-7141-4b67-b18a-1458ac328a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:24.728709 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d8106-7141-4b67-b18a-1458ac328a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:24.729446 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d8106-7141-4b67-b18a-1458ac328a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:24.731130 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d8106-7141-4b67-b18a-1458ac328a45 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:24.741196 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1362/2739] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 04:20:24.745309 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79823cee-8bb2-4773-98fa-863788ff880c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:24.755502 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79823cee-8bb2-4773-98fa-863788ff880c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:24.760340 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b97f6d-32e5-493c-b809-c12c76098348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:24.761226 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b97f6d-32e5-493c-b809-c12c76098348 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:24.761514 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b97f6d-32e5-493c-b809-c12c76098348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:24.761791 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b97f6d-32e5-493c-b809-c12c76098348 admin admin] PATH_INFO: `/v3/projects/8ca9aaaada2444b4b1283be590cce96e/users/34b65623c81b4853b7ac5f3bc42e3ce2/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:24.776619 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b97f6d-32e5-493c-b809-c12c76098348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ca9aaaada2444b4b1283be590cce96e, user_id=34b65623c81b4853b7ac5f3bc42e3ce2, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:24.779321 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b97f6d-32e5-493c-b809-c12c76098348 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:24.798747 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1378/2740] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:20:24 2022] PUT /identity/v3/projects/8ca9aaaada2444b4b1283be590cce96e/users/34b65623c81b4853b7ac5f3bc42e3ce2/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:20:24.804188 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a15871-66d7-49f8-83cc-03b6d72b4331 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:24.804508 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a15871-66d7-49f8-83cc-03b6d72b4331 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:24.804791 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a15871-66d7-49f8-83cc-03b6d72b4331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:24.824044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-01a15871-66d7-49f8-83cc-03b6d72b4331 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:20:24.825274 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-01a15871-66d7-49f8-83cc-03b6d72b4331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:24.892004 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1363/2741] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:20:24.902093 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b97f6d-32e5-493c-b809-c12c76098348 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:24.904195 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-67b97f6d-32e5-493c-b809-c12c76098348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:24.919248 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:20:24.968279 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b97f6d-32e5-493c-b809-c12c76098348 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:24.972160 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959eab05-0a1a-4286-b53c-383417df8ee9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:24.973129 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959eab05-0a1a-4286-b53c-383417df8ee9 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:24.973415 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959eab05-0a1a-4286-b53c-383417df8ee9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:24.973695 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959eab05-0a1a-4286-b53c-383417df8ee9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:24.983492 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959eab05-0a1a-4286-b53c-383417df8ee9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:24.984998 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959eab05-0a1a-4286-b53c-383417df8ee9 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:24.994854 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1379/2742] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:20:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:20:25.621328 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a2992-639e-440b-a57f-93fbf6150e31 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:25.621858 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a2992-639e-440b-a57f-93fbf6150e31 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:25.621858 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a2992-639e-440b-a57f-93fbf6150e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:25.649687 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-d66a2992-639e-440b-a57f-93fbf6150e31 None None] MFA Rules not processed for user `34b65623c81b4853b7ac5f3bc42e3ce2`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:20:25.650976 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d66a2992-639e-440b-a57f-93fbf6150e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:25.700462 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:20:25.725267 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1364/2743] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:20:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:20:25.737296 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959eab05-0a1a-4286-b53c-383417df8ee9 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:25.738842 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-959eab05-0a1a-4286-b53c-383417df8ee9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:25.797507 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959eab05-0a1a-4286-b53c-383417df8ee9 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:25.801822 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615348c-557f-49b4-b67e-c4191aa08207 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:25.802514 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615348c-557f-49b4-b67e-c4191aa08207 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:25.802807 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615348c-557f-49b4-b67e-c4191aa08207 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:25.803202 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615348c-557f-49b4-b67e-c4191aa08207 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:25.812072 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615348c-557f-49b4-b67e-c4191aa08207 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:25.813625 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615348c-557f-49b4-b67e-c4191aa08207 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:25.822823 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1380/2744] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:20:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:20:27.187261 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ccb56-c64b-47bf-93cb-36127d7d5a82 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:27.187806 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ccb56-c64b-47bf-93cb-36127d7d5a82 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:27.187806 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ccb56-c64b-47bf-93cb-36127d7d5a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:27.206506 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-f70ccb56-c64b-47bf-93cb-36127d7d5a82 None None] MFA Rules not processed for user `34b65623c81b4853b7ac5f3bc42e3ce2`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:20:27.207745 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f70ccb56-c64b-47bf-93cb-36127d7d5a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:27.215995 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1365/2745] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:20:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:20:35.818829 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=47 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:20:37.200924 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=9 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:20:42.753831 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50869951-de6c-49cf-8a9c-3a607b3d255a None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:42.754378 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50869951-de6c-49cf-8a9c-3a607b3d255a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:42.754468 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50869951-de6c-49cf-8a9c-3a607b3d255a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:42.773854 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-50869951-de6c-49cf-8a9c-3a607b3d255a None None] MFA Rules not processed for user `34b65623c81b4853b7ac5f3bc42e3ce2`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:20:42.775376 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-50869951-de6c-49cf-8a9c-3a607b3d255a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:42.783311 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1381/2746] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:20:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:20:47.018469 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ccb56-c64b-47bf-93cb-36127d7d5a82 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:47.019955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f70ccb56-c64b-47bf-93cb-36127d7d5a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:47.033272 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ccb56-c64b-47bf-93cb-36127d7d5a82 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:47.038063 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b168af3-28e6-410b-b7c3-455fa003a973 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:47.038754 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b168af3-28e6-410b-b7c3-455fa003a973 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:47.039044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b168af3-28e6-410b-b7c3-455fa003a973 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:47.039326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b168af3-28e6-410b-b7c3-455fa003a973 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:47.042303 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1b168af3-28e6-410b-b7c3-455fa003a973 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:47.062890 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b168af3-28e6-410b-b7c3-455fa003a973 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:47.065054 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b168af3-28e6-410b-b7c3-455fa003a973 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:47.075973 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1366/2747] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:20:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:20:50.370069 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50869951-de6c-49cf-8a9c-3a607b3d255a None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:50.371941 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-50869951-de6c-49cf-8a9c-3a607b3d255a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:50.397302 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50869951-de6c-49cf-8a9c-3a607b3d255a None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:50.402392 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8398085-e134-4232-9360-76743bc1799d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:50.403709 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8398085-e134-4232-9360-76743bc1799d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:50.404241 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8398085-e134-4232-9360-76743bc1799d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:50.404577 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8398085-e134-4232-9360-76743bc1799d admin admin] PATH_INFO: `/v3/users/0be198ad83014acfab897498c2d68d7d` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:50.406017 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8398085-e134-4232-9360-76743bc1799d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0be198ad83014acfab897498c2d68d7d)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:50.408579 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8398085-e134-4232-9360-76743bc1799d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:50.466607 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a8398085-e134-4232-9360-76743bc1799d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0be198ad83014acfab897498c2d68d7d'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:50.479757 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a8398085-e134-4232-9360-76743bc1799d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0be198ad83014acfab897498c2d68d7d'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:50.481108 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a8398085-e134-4232-9360-76743bc1799d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0be198ad83014acfab897498c2d68d7d'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:50.494710 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a8398085-e134-4232-9360-76743bc1799d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0be198ad83014acfab897498c2d68d7d'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:50.495377 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a8398085-e134-4232-9360-76743bc1799d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0be198ad83014acfab897498c2d68d7d'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:50.508310 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1382/2748] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:20:50 2022] DELETE /identity/v3/users/0be198ad83014acfab897498c2d68d7d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:20:50.684869 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b168af3-28e6-410b-b7c3-455fa003a973 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:50.695922 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b168af3-28e6-410b-b7c3-455fa003a973 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:50.759603 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf5783-615e-432b-80fe-770c3ad9f4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:50.760382 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf5783-615e-432b-80fe-770c3ad9f4f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:50.760699 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf5783-615e-432b-80fe-770c3ad9f4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:50.760981 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf5783-615e-432b-80fe-770c3ad9f4f9 admin admin] PATH_INFO: `/v3/projects/1d265f050b0648df974919918e607fb4` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:50.762250 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cf5783-615e-432b-80fe-770c3ad9f4f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d265f050b0648df974919918e607fb4)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:50.764196 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cf5783-615e-432b-80fe-770c3ad9f4f9 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:50.813833 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-07cf5783-615e-432b-80fe-770c3ad9f4f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d265f050b0648df974919918e607fb4', 'request_id': 'req-07cf5783-615e-432b-80fe-770c3ad9f4f9'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:50.819464 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-07cf5783-615e-432b-80fe-770c3ad9f4f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d265f050b0648df974919918e607fb4', 'request_id': 'req-07cf5783-615e-432b-80fe-770c3ad9f4f9'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:50.825626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-07cf5783-615e-432b-80fe-770c3ad9f4f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d265f050b0648df974919918e607fb4', 'request_id': 'req-07cf5783-615e-432b-80fe-770c3ad9f4f9'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:50.840265 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-07cf5783-615e-432b-80fe-770c3ad9f4f9 admin admin] The token cache is being invalidate because project 1d265f050b0648df974919918e607fb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:20:50.840557 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-07cf5783-615e-432b-80fe-770c3ad9f4f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:50.841184 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-07cf5783-615e-432b-80fe-770c3ad9f4f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:20:50.842814 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1367/2749] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:20:50 2022] DELETE /identity/v3/projects/1d265f050b0648df974919918e607fb4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:20:50.848457 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821c4d5-d70d-4635-b071-06808f90f322 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:50.848865 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821c4d5-d70d-4635-b071-06808f90f322 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:50.849155 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821c4d5-d70d-4635-b071-06808f90f322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:50.868439 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-0821c4d5-d70d-4635-b071-06808f90f322 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:20:50.869648 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0821c4d5-d70d-4635-b071-06808f90f322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:50.930679 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1383/2750] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:20:50.938850 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7798fd4-058e-4088-8835-2b98a9b7b660 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:50.939144 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7798fd4-058e-4088-8835-2b98a9b7b660 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:50.939425 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7798fd4-058e-4088-8835-2b98a9b7b660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:50.959704 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-b7798fd4-058e-4088-8835-2b98a9b7b660 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:20:50.960888 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b7798fd4-058e-4088-8835-2b98a9b7b660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:50.970625 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1368/2751] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:20:50.975690 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821c4d5-d70d-4635-b071-06808f90f322 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:50.989939 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821c4d5-d70d-4635-b071-06808f90f322 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:50.995987 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991338f-f18f-4912-9229-58e3a0b91810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:50.996677 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991338f-f18f-4912-9229-58e3a0b91810 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:50.996962 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991338f-f18f-4912-9229-58e3a0b91810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:50.997236 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991338f-f18f-4912-9229-58e3a0b91810 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:50.997972 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6991338f-f18f-4912-9229-58e3a0b91810 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:20:50.998320 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6991338f-f18f-4912-9229-58e3a0b91810 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:50.999994 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6991338f-f18f-4912-9229-58e3a0b91810 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:51.012074 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1384/2752] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:20:51.016685 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7798fd4-058e-4088-8835-2b98a9b7b660 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:51.026665 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7798fd4-058e-4088-8835-2b98a9b7b660 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:51.032238 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fdcf6a-f137-43cf-bed6-42c7e3f81edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:51.032894 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fdcf6a-f137-43cf-bed6-42c7e3f81edd admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:51.033183 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fdcf6a-f137-43cf-bed6-42c7e3f81edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:51.033469 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fdcf6a-f137-43cf-bed6-42c7e3f81edd admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:51.034187 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fdcf6a-f137-43cf-bed6-42c7e3f81edd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:51.036094 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fdcf6a-f137-43cf-bed6-42c7e3f81edd admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:51.069292 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1369/2753] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:20:51 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:20:51.074048 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991338f-f18f-4912-9229-58e3a0b91810 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:51.086769 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991338f-f18f-4912-9229-58e3a0b91810 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:51.143009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:20:51.155575 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce0bc2-ebf6-41a4-9328-a77241994ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:51.156258 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce0bc2-ebf6-41a4-9328-a77241994ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:51.156550 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce0bc2-ebf6-41a4-9328-a77241994ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:51.156831 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce0bc2-ebf6-41a4-9328-a77241994ee5 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:51.157533 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce0bc2-ebf6-41a4-9328-a77241994ee5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:51.159579 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce0bc2-ebf6-41a4-9328-a77241994ee5 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:51.180380 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1385/2754] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:20:51 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:20:51.184690 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fdcf6a-f137-43cf-bed6-42c7e3f81edd admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:51.195863 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fdcf6a-f137-43cf-bed6-42c7e3f81edd admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:51.201779 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb73ae9-1c65-4546-bc17-217ebef835ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:51.202496 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb73ae9-1c65-4546-bc17-217ebef835ce admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:51.202783 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb73ae9-1c65-4546-bc17-217ebef835ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:51.203063 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb73ae9-1c65-4546-bc17-217ebef835ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:51.203805 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb73ae9-1c65-4546-bc17-217ebef835ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:51.205438 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb73ae9-1c65-4546-bc17-217ebef835ce admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:51.216410 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1370/2755] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:20:51.221022 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce0bc2-ebf6-41a4-9328-a77241994ee5 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:51.237440 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce0bc2-ebf6-41a4-9328-a77241994ee5 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:51.243027 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d188631-4892-4be5-8811-4bf520df3184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:51.243689 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d188631-4892-4be5-8811-4bf520df3184 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:51.243977 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d188631-4892-4be5-8811-4bf520df3184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:51.244259 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d188631-4892-4be5-8811-4bf520df3184 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:51.244992 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d188631-4892-4be5-8811-4bf520df3184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:51.246646 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d188631-4892-4be5-8811-4bf520df3184 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:51.257807 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1386/2756] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:20:51.261906 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb73ae9-1c65-4546-bc17-217ebef835ce admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:51.272318 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb73ae9-1c65-4546-bc17-217ebef835ce admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:51.277673 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be32af-0396-4b54-8fde-35e9a4f0828a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:51.278585 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be32af-0396-4b54-8fde-35e9a4f0828a admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:51.278870 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be32af-0396-4b54-8fde-35e9a4f0828a admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:51.279146 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be32af-0396-4b54-8fde-35e9a4f0828a admin admin] PATH_INFO: `/v3/projects/bf13398674c9433188e62926fb0bfd61/users/f0f79d337737404ead7a1417afaad862/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:51.295086 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be32af-0396-4b54-8fde-35e9a4f0828a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf13398674c9433188e62926fb0bfd61, user_id=f0f79d337737404ead7a1417afaad862, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:51.297815 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be32af-0396-4b54-8fde-35e9a4f0828a admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:51.313236 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1371/2757] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:20:51 2022] PUT /identity/v3/projects/bf13398674c9433188e62926fb0bfd61/users/f0f79d337737404ead7a1417afaad862/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:20:51.319870 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72698267-7385-46d2-a8d9-b2f891440c40 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:51.320148 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72698267-7385-46d2-a8d9-b2f891440c40 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:51.320456 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72698267-7385-46d2-a8d9-b2f891440c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:51.339480 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-72698267-7385-46d2-a8d9-b2f891440c40 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:20:51.340726 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-72698267-7385-46d2-a8d9-b2f891440c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:51.402597 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1387/2758] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:20:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:20:51.412354 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be32af-0396-4b54-8fde-35e9a4f0828a admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:51.414133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f0be32af-0396-4b54-8fde-35e9a4f0828a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:51.435753 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:20:51.486547 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be32af-0396-4b54-8fde-35e9a4f0828a admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:51.491210 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15381f72-fb00-446d-aef8-10628b4b2f9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:51.491933 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15381f72-fb00-446d-aef8-10628b4b2f9e service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:51.492284 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15381f72-fb00-446d-aef8-10628b4b2f9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:51.492570 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15381f72-fb00-446d-aef8-10628b4b2f9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:51.502341 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15381f72-fb00-446d-aef8-10628b4b2f9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:51.504617 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15381f72-fb00-446d-aef8-10628b4b2f9e service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:51.519286 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1372/2759] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:20:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:20:55.734418 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02d956-6ca6-40bb-a670-f7229218ee0a None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:55.735269 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02d956-6ca6-40bb-a670-f7229218ee0a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:55.735790 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02d956-6ca6-40bb-a670-f7229218ee0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:55.766638 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-3b02d956-6ca6-40bb-a670-f7229218ee0a None None] MFA Rules not processed for user `f0f79d337737404ead7a1417afaad862`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:20:55.767865 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3b02d956-6ca6-40bb-a670-f7229218ee0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:55.835431 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1388/2760] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:20:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:20:55.850694 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15381f72-fb00-446d-aef8-10628b4b2f9e service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:20:55.852181 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-15381f72-fb00-446d-aef8-10628b4b2f9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:55.929417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15381f72-fb00-446d-aef8-10628b4b2f9e service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:20:55.935271 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b2808-821e-4dfc-af0f-40c28014cd6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:20:55.935943 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b2808-821e-4dfc-af0f-40c28014cd6a service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:55.936233 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b2808-821e-4dfc-af0f-40c28014cd6a service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:55.936498 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b2808-821e-4dfc-af0f-40c28014cd6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:55.945543 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0b2808-821e-4dfc-af0f-40c28014cd6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:20:55.947213 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0b2808-821e-4dfc-af0f-40c28014cd6a service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:20:55.957121 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1373/2761] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:20:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:20:57.659326 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487af97b-3ccc-4871-b6ee-b826c0fcfef8 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:20:57.659909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487af97b-3ccc-4871-b6ee-b826c0fcfef8 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:20:57.660010 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487af97b-3ccc-4871-b6ee-b826c0fcfef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:20:57.691095 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-487af97b-3ccc-4871-b6ee-b826c0fcfef8 None None] MFA Rules not processed for user `f0f79d337737404ead7a1417afaad862`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:20:57.706137 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-487af97b-3ccc-4871-b6ee-b826c0fcfef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:20:57.716842 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1389/2762] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:20:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:21:00.235608 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab0552-a8de-4f3a-a755-daccd1ad75c5 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:00.236245 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab0552-a8de-4f3a-a755-daccd1ad75c5 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:00.236559 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab0552-a8de-4f3a-a755-daccd1ad75c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:00.254529 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-28ab0552-a8de-4f3a-a755-daccd1ad75c5 None None] MFA Rules not processed for user `03e7f908f0a7499792e59e31d497edb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:21:00.255983 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-28ab0552-a8de-4f3a-a755-daccd1ad75c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:21:00.315493 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1374/2763] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Jul 4 04:21:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:21:00.369199 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487af97b-3ccc-4871-b6ee-b826c0fcfef8 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:21:00.370989 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-487af97b-3ccc-4871-b6ee-b826c0fcfef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:21:00.426960 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:21:00.443399 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487af97b-3ccc-4871-b6ee-b826c0fcfef8 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:21:00.448981 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a43e5-dba3-49cd-99e1-7cdc75645ef1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f93fdc98ff425791da3e2194b3a671', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:21:00.449641 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a43e5-dba3-49cd-99e1-7cdc75645ef1 service swift] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:00.449928 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a43e5-dba3-49cd-99e1-7cdc75645ef1 service swift] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:00.450246 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a43e5-dba3-49cd-99e1-7cdc75645ef1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:00.459065 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a43e5-dba3-49cd-99e1-7cdc75645ef1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:21:00.461486 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a43e5-dba3-49cd-99e1-7cdc75645ef1 service swift] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:21:00.470275 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1390/2764] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Jul 4 04:21:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 04 04:21:09.363829 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab0552-a8de-4f3a-a755-daccd1ad75c5 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:21:09.374178 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab0552-a8de-4f3a-a755-daccd1ad75c5 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:21:09.377974 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2a4c3-2196-4be5-b991-a61d80252421 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:21:09.378666 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2a4c3-2196-4be5-b991-a61d80252421 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:09.378970 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2a4c3-2196-4be5-b991-a61d80252421 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:09.379257 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2a4c3-2196-4be5-b991-a61d80252421 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:09.381252 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b8d2a4c3-2196-4be5-b991-a61d80252421 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:21:09.397815 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2a4c3-2196-4be5-b991-a61d80252421 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:21:09.399444 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2a4c3-2196-4be5-b991-a61d80252421 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:21:09.411942 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1375/2765] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:21:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:21:10.467255 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=7 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:21:10.663645 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a43e5-dba3-49cd-99e1-7cdc75645ef1 service swift] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:21:10.665372 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4f1a43e5-dba3-49cd-99e1-7cdc75645ef1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:21:10.684080 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a43e5-dba3-49cd-99e1-7cdc75645ef1 service swift] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:21:10.689452 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac275779-3ced-403e-9f2e-5d666aa0e7c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:21:10.690552 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac275779-3ced-403e-9f2e-5d666aa0e7c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:10.690846 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac275779-3ced-403e-9f2e-5d666aa0e7c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:10.691316 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac275779-3ced-403e-9f2e-5d666aa0e7c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:10.694211 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ac275779-3ced-403e-9f2e-5d666aa0e7c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:21:10.718835 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac275779-3ced-403e-9f2e-5d666aa0e7c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:21:10.721430 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac275779-3ced-403e-9f2e-5d666aa0e7c9 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:21:10.740733 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1391/2766] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:21:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:21:15.910937 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d5aef-5a39-42f4-8634-0928e98f5605 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:15.911414 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d5aef-5a39-42f4-8634-0928e98f5605 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:15.911510 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d5aef-5a39-42f4-8634-0928e98f5605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:15.930686 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-148d5aef-5a39-42f4-8634-0928e98f5605 None None] MFA Rules not processed for user `03e7f908f0a7499792e59e31d497edb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:21:15.931890 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-148d5aef-5a39-42f4-8634-0928e98f5605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:21:15.940804 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1376/2767] 10.222.0.49 () {58 vars in 967 bytes} [Mon Jul 4 04:21:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:21:15.953017 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac275779-3ced-403e-9f2e-5d666aa0e7c9 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:21:15.964955 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac275779-3ced-403e-9f2e-5d666aa0e7c9 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:21:15.971529 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e589f-0ce8-4159-99fc-c33db8dac6f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f93fdc98ff425791da3e2194b3a671', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:21:15.972175 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e589f-0ce8-4159-99fc-c33db8dac6f4 service swift] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:15.972457 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e589f-0ce8-4159-99fc-c33db8dac6f4 service swift] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:15.973145 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e589f-0ce8-4159-99fc-c33db8dac6f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:15.981425 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863e589f-0ce8-4159-99fc-c33db8dac6f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:21:15.983063 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863e589f-0ce8-4159-99fc-c33db8dac6f4 service swift] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:21:15.991143 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1392/2768] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Jul 4 04:21:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 04:21:17.935148 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d5aef-5a39-42f4-8634-0928e98f5605 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:21:17.936712 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-148d5aef-5a39-42f4-8634-0928e98f5605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:21:17.952635 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d5aef-5a39-42f4-8634-0928e98f5605 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:21:17.958451 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced95f4a-a943-4883-980a-c0dcc27c51dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:21:17.959372 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced95f4a-a943-4883-980a-c0dcc27c51dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:17.959662 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced95f4a-a943-4883-980a-c0dcc27c51dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:17.959943 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced95f4a-a943-4883-980a-c0dcc27c51dd admin admin] PATH_INFO: `/v3/users/34b65623c81b4853b7ac5f3bc42e3ce2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:17.961347 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced95f4a-a943-4883-980a-c0dcc27c51dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=34b65623c81b4853b7ac5f3bc42e3ce2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:21:17.963552 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced95f4a-a943-4883-980a-c0dcc27c51dd admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:21:17.996059 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:21:18.028878 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ced95f4a-a943-4883-980a-c0dcc27c51dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34b65623c81b4853b7ac5f3bc42e3ce2'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:21:18.029717 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ced95f4a-a943-4883-980a-c0dcc27c51dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34b65623c81b4853b7ac5f3bc42e3ce2'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:21:18.041795 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ced95f4a-a943-4883-980a-c0dcc27c51dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34b65623c81b4853b7ac5f3bc42e3ce2'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:21:18.060093 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ced95f4a-a943-4883-980a-c0dcc27c51dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34b65623c81b4853b7ac5f3bc42e3ce2'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:21:18.060761 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ced95f4a-a943-4883-980a-c0dcc27c51dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34b65623c81b4853b7ac5f3bc42e3ce2'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:21:18.073477 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1377/2769] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:21:17 2022] DELETE /identity/v3/users/34b65623c81b4853b7ac5f3bc42e3ce2 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:21:18.258803 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e589f-0ce8-4159-99fc-c33db8dac6f4 service swift] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:21:18.270099 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e589f-0ce8-4159-99fc-c33db8dac6f4 service swift] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:21:18.338502 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5a9f4-c1a6-4be9-82bf-bba2c3db0b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:21:18.339385 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5a9f4-c1a6-4be9-82bf-bba2c3db0b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:18.339671 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5a9f4-c1a6-4be9-82bf-bba2c3db0b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:18.339931 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5a9f4-c1a6-4be9-82bf-bba2c3db0b9c admin admin] PATH_INFO: `/v3/projects/8ca9aaaada2444b4b1283be590cce96e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:18.341277 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b5a9f4-c1a6-4be9-82bf-bba2c3db0b9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ca9aaaada2444b4b1283be590cce96e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:21:18.343274 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b5a9f4-c1a6-4be9-82bf-bba2c3db0b9c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:21:18.400987 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-61b5a9f4-c1a6-4be9-82bf-bba2c3db0b9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ca9aaaada2444b4b1283be590cce96e', 'request_id': 'req-61b5a9f4-c1a6-4be9-82bf-bba2c3db0b9c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:21:18.407531 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-61b5a9f4-c1a6-4be9-82bf-bba2c3db0b9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ca9aaaada2444b4b1283be590cce96e', 'request_id': 'req-61b5a9f4-c1a6-4be9-82bf-bba2c3db0b9c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:21:18.414416 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-61b5a9f4-c1a6-4be9-82bf-bba2c3db0b9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ca9aaaada2444b4b1283be590cce96e', 'request_id': 'req-61b5a9f4-c1a6-4be9-82bf-bba2c3db0b9c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:21:18.428030 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-61b5a9f4-c1a6-4be9-82bf-bba2c3db0b9c admin admin] The token cache is being invalidate because project 8ca9aaaada2444b4b1283be590cce96e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:21:18.428251 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-61b5a9f4-c1a6-4be9-82bf-bba2c3db0b9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:21:18.428871 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-61b5a9f4-c1a6-4be9-82bf-bba2c3db0b9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:21:18.430515 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1393/2770] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:21:18 2022] DELETE /identity/v3/projects/8ca9aaaada2444b4b1283be590cce96e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:21:18.436481 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4de45-ce1e-4947-83e7-cba151bcb5cc None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:18.436780 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4de45-ce1e-4947-83e7-cba151bcb5cc None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:18.437062 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4de45-ce1e-4947-83e7-cba151bcb5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:18.456498 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-a5d4de45-ce1e-4947-83e7-cba151bcb5cc None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:21:18.457715 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a5d4de45-ce1e-4947-83e7-cba151bcb5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:21:18.518368 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1378/2771] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:21:18.585946 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead5f01-00fe-4f1a-9359-386cab68b051 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:18.586229 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead5f01-00fe-4f1a-9359-386cab68b051 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:18.586545 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead5f01-00fe-4f1a-9359-386cab68b051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:18.608285 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-3ead5f01-00fe-4f1a-9359-386cab68b051 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:21:18.609539 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3ead5f01-00fe-4f1a-9359-386cab68b051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:21:18.618872 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1394/2772] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:21:18.623922 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4de45-ce1e-4947-83e7-cba151bcb5cc None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:21:18.636096 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4de45-ce1e-4947-83e7-cba151bcb5cc None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:21:18.642543 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4cad8-1c88-4f36-80a2-e710f53da849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:21:18.643202 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4cad8-1c88-4f36-80a2-e710f53da849 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:18.643488 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4cad8-1c88-4f36-80a2-e710f53da849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:18.643808 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4cad8-1c88-4f36-80a2-e710f53da849 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:18.644552 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca4cad8-1c88-4f36-80a2-e710f53da849 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:21:18.644865 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca4cad8-1c88-4f36-80a2-e710f53da849 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:21:18.646552 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca4cad8-1c88-4f36-80a2-e710f53da849 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:21:18.659084 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1379/2773] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:21:18.663660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead5f01-00fe-4f1a-9359-386cab68b051 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:21:18.673703 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead5f01-00fe-4f1a-9359-386cab68b051 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:21:18.679538 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f5c33-231a-4284-99f4-7c6cf77ad370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:21:18.680149 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f5c33-231a-4284-99f4-7c6cf77ad370 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:18.680436 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f5c33-231a-4284-99f4-7c6cf77ad370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:18.680727 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f5c33-231a-4284-99f4-7c6cf77ad370 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:18.681447 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f5c33-231a-4284-99f4-7c6cf77ad370 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:21:18.683412 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f5c33-231a-4284-99f4-7c6cf77ad370 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:21:18.713268 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1395/2774] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:21:18 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:21:18.717923 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4cad8-1c88-4f36-80a2-e710f53da849 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:21:18.730646 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4cad8-1c88-4f36-80a2-e710f53da849 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:21:18.804163 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff610c36-0b11-471f-84dd-0da93d7dd8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:21:18.804863 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff610c36-0b11-471f-84dd-0da93d7dd8ca admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:18.805149 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff610c36-0b11-471f-84dd-0da93d7dd8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:18.805415 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff610c36-0b11-471f-84dd-0da93d7dd8ca admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:18.806141 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff610c36-0b11-471f-84dd-0da93d7dd8ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:21:18.808111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff610c36-0b11-471f-84dd-0da93d7dd8ca admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:21:18.829775 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1380/2775] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:21:18 2022] POST /identity/v3/users => generated 285 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 04:21:18.834286 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f5c33-231a-4284-99f4-7c6cf77ad370 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:21:18.845682 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f5c33-231a-4284-99f4-7c6cf77ad370 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:21:18.851563 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a20f3b-3e4e-46ad-938c-3b1799e7bf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:21:18.852218 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a20f3b-3e4e-46ad-938c-3b1799e7bf71 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:18.852501 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a20f3b-3e4e-46ad-938c-3b1799e7bf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:18.852766 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a20f3b-3e4e-46ad-938c-3b1799e7bf71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:18.853501 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a20f3b-3e4e-46ad-938c-3b1799e7bf71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:21:18.855210 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a20f3b-3e4e-46ad-938c-3b1799e7bf71 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:21:18.866657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1396/2776] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:21:18.870905 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff610c36-0b11-471f-84dd-0da93d7dd8ca admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:21:18.881631 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff610c36-0b11-471f-84dd-0da93d7dd8ca admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:21:18.887800 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1ee59-f2ea-419f-838e-6bd9b7c18fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:21:18.888746 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1ee59-f2ea-419f-838e-6bd9b7c18fac admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:18.889096 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1ee59-f2ea-419f-838e-6bd9b7c18fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:18.889375 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1ee59-f2ea-419f-838e-6bd9b7c18fac admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:18.890523 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f1ee59-f2ea-419f-838e-6bd9b7c18fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:21:18.892854 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f1ee59-f2ea-419f-838e-6bd9b7c18fac admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:21:18.904427 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1381/2777] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:21:18.908453 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a20f3b-3e4e-46ad-938c-3b1799e7bf71 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:21:18.919021 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a20f3b-3e4e-46ad-938c-3b1799e7bf71 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:21:18.924309 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8495d-18e6-4694-8d27-476e6606ecc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:21:18.925297 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8495d-18e6-4694-8d27-476e6606ecc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:18.925585 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8495d-18e6-4694-8d27-476e6606ecc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:18.925867 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8495d-18e6-4694-8d27-476e6606ecc7 admin admin] PATH_INFO: `/v3/projects/ac89e063c6314144904d8f94c66f4d27/users/b7e14fe574904cb9a5e86ecf9ee1e336/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:18.941161 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8495d-18e6-4694-8d27-476e6606ecc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac89e063c6314144904d8f94c66f4d27, user_id=b7e14fe574904cb9a5e86ecf9ee1e336, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:21:18.943804 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8495d-18e6-4694-8d27-476e6606ecc7 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:21:18.955084 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:21:18.964843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1397/2778] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:21:18 2022] PUT /identity/v3/projects/ac89e063c6314144904d8f94c66f4d27/users/b7e14fe574904cb9a5e86ecf9ee1e336/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:21:18.972937 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5948ca2-fc54-453f-9bf9-49e8453923ab None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:18.972937 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5948ca2-fc54-453f-9bf9-49e8453923ab None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:18.973426 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5948ca2-fc54-453f-9bf9-49e8453923ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:18.980124 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:21:19.003961 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-d5948ca2-fc54-453f-9bf9-49e8453923ab None None] MFA Rules not processed for user `b7e14fe574904cb9a5e86ecf9ee1e336`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:21:19.005172 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d5948ca2-fc54-453f-9bf9-49e8453923ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:21:19.073630 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1382/2779] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:21:18 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:21:19.085527 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8495d-18e6-4694-8d27-476e6606ecc7 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:21:19.087796 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-05d8495d-18e6-4694-8d27-476e6606ecc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:21:19.149339 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8495d-18e6-4694-8d27-476e6606ecc7 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:21:19.153686 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b63fb-238e-4da6-83e5-967eb203b94a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e29ce1e3d64431bc7aa80d55787ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:21:19.154370 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b63fb-238e-4da6-83e5-967eb203b94a service glance] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:19.154662 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b63fb-238e-4da6-83e5-967eb203b94a service glance] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:19.154946 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b63fb-238e-4da6-83e5-967eb203b94a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:19.164425 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b63fb-238e-4da6-83e5-967eb203b94a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:21:19.165900 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b63fb-238e-4da6-83e5-967eb203b94a service glance] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:21:19.175581 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1398/2780] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:21:19 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:21:29.070627 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=30 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:21:29.171140 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=26 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:21:48.434754 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5948ca2-fc54-453f-9bf9-49e8453923ab None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:21:48.501073 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5948ca2-fc54-453f-9bf9-49e8453923ab None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:21:48.506873 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891bd3e5-b242-4eef-a040-8409ebe4d077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:21:48.507749 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bd3e5-b242-4eef-a040-8409ebe4d077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:48.508042 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bd3e5-b242-4eef-a040-8409ebe4d077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:48.508321 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bd3e5-b242-4eef-a040-8409ebe4d077 admin admin] PATH_INFO: `/v3/users/b7e14fe574904cb9a5e86ecf9ee1e336` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:48.509674 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891bd3e5-b242-4eef-a040-8409ebe4d077 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7e14fe574904cb9a5e86ecf9ee1e336)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:21:48.511919 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891bd3e5-b242-4eef-a040-8409ebe4d077 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:21:48.564971 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-891bd3e5-b242-4eef-a040-8409ebe4d077 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7e14fe574904cb9a5e86ecf9ee1e336'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:21:48.565525 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-891bd3e5-b242-4eef-a040-8409ebe4d077 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7e14fe574904cb9a5e86ecf9ee1e336'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:21:48.573998 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-891bd3e5-b242-4eef-a040-8409ebe4d077 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7e14fe574904cb9a5e86ecf9ee1e336'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:21:48.586553 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-891bd3e5-b242-4eef-a040-8409ebe4d077 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7e14fe574904cb9a5e86ecf9ee1e336'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:21:48.587212 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-891bd3e5-b242-4eef-a040-8409ebe4d077 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7e14fe574904cb9a5e86ecf9ee1e336'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:21:48.599703 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1383/2781] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:21:48 2022] DELETE /identity/v3/users/b7e14fe574904cb9a5e86ecf9ee1e336 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:21:48.604457 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70c19e-0f5f-4f7a-8ea1-70cc92af4e3b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:48.604981 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70c19e-0f5f-4f7a-8ea1-70cc92af4e3b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:48.604981 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70c19e-0f5f-4f7a-8ea1-70cc92af4e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:48.624617 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ce70c19e-0f5f-4f7a-8ea1-70cc92af4e3b None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:21:48.625820 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ce70c19e-0f5f-4f7a-8ea1-70cc92af4e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:21:48.684862 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1399/2782] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:21:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:21:48.694887 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891bd3e5-b242-4eef-a040-8409ebe4d077 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:21:48.696445 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-891bd3e5-b242-4eef-a040-8409ebe4d077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:21:48.761393 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891bd3e5-b242-4eef-a040-8409ebe4d077 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:21:48.768231 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990a4dc-31bb-48fe-a847-f7e114848a8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:21:48.769171 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990a4dc-31bb-48fe-a847-f7e114848a8a service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:48.769499 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990a4dc-31bb-48fe-a847-f7e114848a8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:48.769856 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990a4dc-31bb-48fe-a847-f7e114848a8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:48.784443 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a990a4dc-31bb-48fe-a847-f7e114848a8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:21:48.785910 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a990a4dc-31bb-48fe-a847-f7e114848a8a service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:21:48.796111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1384/2783] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:21:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:21:49.084689 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70c19e-0f5f-4f7a-8ea1-70cc92af4e3b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:21:49.086282 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ce70c19e-0f5f-4f7a-8ea1-70cc92af4e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:21:49.099304 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70c19e-0f5f-4f7a-8ea1-70cc92af4e3b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:21:49.104839 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924637f-a24b-4fa3-a394-da084051d7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:21:49.105789 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924637f-a24b-4fa3-a394-da084051d7cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:49.106056 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924637f-a24b-4fa3-a394-da084051d7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:49.106407 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924637f-a24b-4fa3-a394-da084051d7cd admin admin] PATH_INFO: `/v3/projects/ac89e063c6314144904d8f94c66f4d27` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:49.107734 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924637f-a24b-4fa3-a394-da084051d7cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac89e063c6314144904d8f94c66f4d27)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:21:49.109684 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924637f-a24b-4fa3-a394-da084051d7cd admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:21:49.158607 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-d924637f-a24b-4fa3-a394-da084051d7cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac89e063c6314144904d8f94c66f4d27', 'request_id': 'req-d924637f-a24b-4fa3-a394-da084051d7cd'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:21:49.164603 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-d924637f-a24b-4fa3-a394-da084051d7cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac89e063c6314144904d8f94c66f4d27', 'request_id': 'req-d924637f-a24b-4fa3-a394-da084051d7cd'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:21:49.170006 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-d924637f-a24b-4fa3-a394-da084051d7cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac89e063c6314144904d8f94c66f4d27', 'request_id': 'req-d924637f-a24b-4fa3-a394-da084051d7cd'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:21:49.188708 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-d924637f-a24b-4fa3-a394-da084051d7cd admin admin] The token cache is being invalidate because project ac89e063c6314144904d8f94c66f4d27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:21:49.189118 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-d924637f-a24b-4fa3-a394-da084051d7cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:21:49.190203 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-d924637f-a24b-4fa3-a394-da084051d7cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:21:49.192668 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1400/2784] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:21:49 2022] DELETE /identity/v3/projects/ac89e063c6314144904d8f94c66f4d27 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:21:49.199399 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf927a-ccf9-4670-b5c9-4ff19a40688b None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:49.199697 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf927a-ccf9-4670-b5c9-4ff19a40688b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:49.199982 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf927a-ccf9-4670-b5c9-4ff19a40688b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:49.219382 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-9bdf927a-ccf9-4670-b5c9-4ff19a40688b None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:21:49.220605 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9bdf927a-ccf9-4670-b5c9-4ff19a40688b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:21:49.239335 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:21:49.285885 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1385/2785] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:21:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:21:49.295180 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555033d-0043-4733-a1f2-1b5f5cf5ad2e None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:49.295481 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555033d-0043-4733-a1f2-1b5f5cf5ad2e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:49.295776 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555033d-0043-4733-a1f2-1b5f5cf5ad2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:49.316170 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-6555033d-0043-4733-a1f2-1b5f5cf5ad2e None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:21:49.318720 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6555033d-0043-4733-a1f2-1b5f5cf5ad2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:21:49.333309 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1401/2786] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:21:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:21:49.338088 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf927a-ccf9-4670-b5c9-4ff19a40688b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:21:49.349816 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf927a-ccf9-4670-b5c9-4ff19a40688b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:21:49.356213 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8798b-e8b2-4fbc-950a-a401ab096fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:21:49.356875 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8798b-e8b2-4fbc-950a-a401ab096fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:49.357162 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8798b-e8b2-4fbc-950a-a401ab096fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:49.357439 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8798b-e8b2-4fbc-950a-a401ab096fe8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:49.358182 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede8798b-e8b2-4fbc-950a-a401ab096fe8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:21:49.358506 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede8798b-e8b2-4fbc-950a-a401ab096fe8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:21:49.360196 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede8798b-e8b2-4fbc-950a-a401ab096fe8 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:21:49.373033 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1386/2787] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:21:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:21:49.377722 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555033d-0043-4733-a1f2-1b5f5cf5ad2e None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:21:49.388266 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555033d-0043-4733-a1f2-1b5f5cf5ad2e None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:21:49.394525 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428d0a5-9998-4bb4-9962-09c08f0557a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:21:49.395213 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428d0a5-9998-4bb4-9962-09c08f0557a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:49.395501 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428d0a5-9998-4bb4-9962-09c08f0557a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:49.395783 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428d0a5-9998-4bb4-9962-09c08f0557a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:49.396484 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8428d0a5-9998-4bb4-9962-09c08f0557a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:21:49.398567 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8428d0a5-9998-4bb4-9962-09c08f0557a9 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:21:49.429626 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1402/2788] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:21:49 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:21:49.434642 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8798b-e8b2-4fbc-950a-a401ab096fe8 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:21:49.446174 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8798b-e8b2-4fbc-950a-a401ab096fe8 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:21:49.504069 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f158e9-9d9c-42f0-8842-9601480ece6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:21:49.504739 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f158e9-9d9c-42f0-8842-9601480ece6a admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:49.505091 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f158e9-9d9c-42f0-8842-9601480ece6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:49.505378 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f158e9-9d9c-42f0-8842-9601480ece6a admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:49.506077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f158e9-9d9c-42f0-8842-9601480ece6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:21:49.508054 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f158e9-9d9c-42f0-8842-9601480ece6a admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:21:49.532319 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1387/2789] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:21:49 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:21:49.536627 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428d0a5-9998-4bb4-9962-09c08f0557a9 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:21:49.547613 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428d0a5-9998-4bb4-9962-09c08f0557a9 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:21:49.553563 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814958b-7673-48a9-af33-f5ab53e3e6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:21:49.554294 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814958b-7673-48a9-af33-f5ab53e3e6ac admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:49.554574 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814958b-7673-48a9-af33-f5ab53e3e6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:49.554851 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814958b-7673-48a9-af33-f5ab53e3e6ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:49.555593 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b814958b-7673-48a9-af33-f5ab53e3e6ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:21:49.557217 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b814958b-7673-48a9-af33-f5ab53e3e6ac admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:21:49.568449 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1403/2790] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:21:49.572414 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f158e9-9d9c-42f0-8842-9601480ece6a admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:21:49.583027 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f158e9-9d9c-42f0-8842-9601480ece6a admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:21:49.588950 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068194e-9fa1-47c0-9f57-d77e4ad06c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:21:49.589613 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068194e-9fa1-47c0-9f57-d77e4ad06c1e admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:49.589903 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068194e-9fa1-47c0-9f57-d77e4ad06c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:49.590189 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068194e-9fa1-47c0-9f57-d77e4ad06c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:49.590945 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068194e-9fa1-47c0-9f57-d77e4ad06c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:21:49.592584 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068194e-9fa1-47c0-9f57-d77e4ad06c1e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:21:49.603292 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1388/2791] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:21:49.607282 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814958b-7673-48a9-af33-f5ab53e3e6ac admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:21:49.617671 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814958b-7673-48a9-af33-f5ab53e3e6ac admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:21:49.623683 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61baa15-e8c8-42ab-aa24-0017673ae405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:21:49.624613 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61baa15-e8c8-42ab-aa24-0017673ae405 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:49.624902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61baa15-e8c8-42ab-aa24-0017673ae405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:49.625285 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61baa15-e8c8-42ab-aa24-0017673ae405 admin admin] PATH_INFO: `/v3/projects/df78f39513b645829427b1ae7aea03ba/users/4de286b5650e4fa696ed7ee351ce5b27/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:49.641135 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61baa15-e8c8-42ab-aa24-0017673ae405 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df78f39513b645829427b1ae7aea03ba, user_id=4de286b5650e4fa696ed7ee351ce5b27, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:21:49.643821 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61baa15-e8c8-42ab-aa24-0017673ae405 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:21:49.660054 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1404/2792] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:21:49 2022] PUT /identity/v3/projects/df78f39513b645829427b1ae7aea03ba/users/4de286b5650e4fa696ed7ee351ce5b27/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:21:49.666003 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00973296-e538-4bb9-9d85-4d51c1c63170 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:49.666434 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00973296-e538-4bb9-9d85-4d51c1c63170 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:49.666723 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00973296-e538-4bb9-9d85-4d51c1c63170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:49.690201 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-00973296-e538-4bb9-9d85-4d51c1c63170 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:21:49.691334 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-00973296-e538-4bb9-9d85-4d51c1c63170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:21:49.759729 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1389/2793] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:21:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:21:49.769523 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61baa15-e8c8-42ab-aa24-0017673ae405 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:21:49.771499 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c61baa15-e8c8-42ab-aa24-0017673ae405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:21:49.794411 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:21:49.831879 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61baa15-e8c8-42ab-aa24-0017673ae405 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:21:49.836279 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd6bb8-5713-4e87-9eb9-deda350e6a47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:21:49.836932 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd6bb8-5713-4e87-9eb9-deda350e6a47 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:49.837199 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd6bb8-5713-4e87-9eb9-deda350e6a47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:49.837481 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd6bb8-5713-4e87-9eb9-deda350e6a47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:49.847862 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd6bb8-5713-4e87-9eb9-deda350e6a47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:21:49.849339 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd6bb8-5713-4e87-9eb9-deda350e6a47 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:21:49.859115 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1405/2794] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:21:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:21:53.749195 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56988f95-7405-4ca4-a8a5-301d3cd8cb56 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:53.749663 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56988f95-7405-4ca4-a8a5-301d3cd8cb56 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:53.749810 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56988f95-7405-4ca4-a8a5-301d3cd8cb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:53.808533 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-56988f95-7405-4ca4-a8a5-301d3cd8cb56 None None] MFA Rules not processed for user `4de286b5650e4fa696ed7ee351ce5b27`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:21:53.809775 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-56988f95-7405-4ca4-a8a5-301d3cd8cb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:21:53.829670 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:21:53.885766 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1390/2795] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:21:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:21:53.890561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd6bb8-5713-4e87-9eb9-deda350e6a47 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:21:53.900975 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd6bb8-5713-4e87-9eb9-deda350e6a47 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:21:53.906734 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d9900-3c94-431b-834a-2c64e4fc2f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:21:53.907403 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d9900-3c94-431b-834a-2c64e4fc2f63 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:53.907693 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d9900-3c94-431b-834a-2c64e4fc2f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:53.910098 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d9900-3c94-431b-834a-2c64e4fc2f63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:53.911169 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d9900-3c94-431b-834a-2c64e4fc2f63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:21:53.913153 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d9900-3c94-431b-834a-2c64e4fc2f63 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:21:53.941748 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1406/2796] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:21:53 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:21:53.945976 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56988f95-7405-4ca4-a8a5-301d3cd8cb56 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:21:53.957070 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56988f95-7405-4ca4-a8a5-301d3cd8cb56 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:21:54.015862 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc1a31-2959-4798-8d9a-abda437d0d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:21:54.016561 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc1a31-2959-4798-8d9a-abda437d0d17 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:54.016854 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc1a31-2959-4798-8d9a-abda437d0d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:54.017155 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc1a31-2959-4798-8d9a-abda437d0d17 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:54.017848 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc1a31-2959-4798-8d9a-abda437d0d17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:21:54.019895 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc1a31-2959-4798-8d9a-abda437d0d17 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:21:54.041978 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1391/2797] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:21:53 2022] POST /identity/v3/users => generated 298 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:21:54.046323 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d9900-3c94-431b-834a-2c64e4fc2f63 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:21:54.057225 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d9900-3c94-431b-834a-2c64e4fc2f63 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:21:54.062465 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8f2ef-e28f-4fcc-b5c6-5f3f1f1b1239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:21:54.063228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8f2ef-e28f-4fcc-b5c6-5f3f1f1b1239 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:54.063524 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8f2ef-e28f-4fcc-b5c6-5f3f1f1b1239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:54.063812 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8f2ef-e28f-4fcc-b5c6-5f3f1f1b1239 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:54.064570 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b8f2ef-e28f-4fcc-b5c6-5f3f1f1b1239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:21:54.066339 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b8f2ef-e28f-4fcc-b5c6-5f3f1f1b1239 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:21:54.078476 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1407/2798] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:21:54.082830 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc1a31-2959-4798-8d9a-abda437d0d17 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:21:54.093330 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc1a31-2959-4798-8d9a-abda437d0d17 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:21:54.098970 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03614232-76a5-4ca1-bcb5-60f118c383e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:21:54.099918 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03614232-76a5-4ca1-bcb5-60f118c383e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:54.100204 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03614232-76a5-4ca1-bcb5-60f118c383e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:54.100486 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03614232-76a5-4ca1-bcb5-60f118c383e2 admin admin] PATH_INFO: `/v3/projects/b87601be359b4a1280e02c1c9ab2b2a3/users/494dce80730c4994934792f8a4cf7c43/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:54.118382 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03614232-76a5-4ca1-bcb5-60f118c383e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b87601be359b4a1280e02c1c9ab2b2a3, user_id=494dce80730c4994934792f8a4cf7c43, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:21:54.121070 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03614232-76a5-4ca1-bcb5-60f118c383e2 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:21:54.135029 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1392/2799] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:21:54 2022] PUT /identity/v3/projects/b87601be359b4a1280e02c1c9ab2b2a3/users/494dce80730c4994934792f8a4cf7c43/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:21:54.139616 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8f2ef-e28f-4fcc-b5c6-5f3f1f1b1239 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:21:54.150552 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8f2ef-e28f-4fcc-b5c6-5f3f1f1b1239 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:21:54.231758 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851be88-334f-4adb-beee-5605632d6c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:21:54.232441 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851be88-334f-4adb-beee-5605632d6c68 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:54.232728 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851be88-334f-4adb-beee-5605632d6c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:54.233009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851be88-334f-4adb-beee-5605632d6c68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:54.233751 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d851be88-334f-4adb-beee-5605632d6c68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:21:54.235447 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d851be88-334f-4adb-beee-5605632d6c68 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:21:54.245244 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1408/2800] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:21:54.249588 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03614232-76a5-4ca1-bcb5-60f118c383e2 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:21:54.263274 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03614232-76a5-4ca1-bcb5-60f118c383e2 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:21:54.268069 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f92ba-82b4-47c4-88a1-4d8b4c091768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:21:54.268997 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f92ba-82b4-47c4-88a1-4d8b4c091768 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:54.269283 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f92ba-82b4-47c4-88a1-4d8b4c091768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:54.269704 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f92ba-82b4-47c4-88a1-4d8b4c091768 admin admin] PATH_INFO: `/v3/projects/b87601be359b4a1280e02c1c9ab2b2a3/users/494dce80730c4994934792f8a4cf7c43/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:54.271793 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f92ba-82b4-47c4-88a1-4d8b4c091768 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b87601be359b4a1280e02c1c9ab2b2a3, user_id=494dce80730c4994934792f8a4cf7c43, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:21:54.274534 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f92ba-82b4-47c4-88a1-4d8b4c091768 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:21:54.286137 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1393/2801] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:21:54 2022] PUT /identity/v3/projects/b87601be359b4a1280e02c1c9ab2b2a3/users/494dce80730c4994934792f8a4cf7c43/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:21:58.762221 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a79a8-4c58-43fd-9326-774d0ca0a580 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:58.762757 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a79a8-4c58-43fd-9326-774d0ca0a580 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:58.762978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a79a8-4c58-43fd-9326-774d0ca0a580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:58.793082 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-285a79a8-4c58-43fd-9326-774d0ca0a580 None None] MFA Rules not processed for user `494dce80730c4994934792f8a4cf7c43`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:21:58.794463 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-285a79a8-4c58-43fd-9326-774d0ca0a580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:21:58.870047 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1409/2802] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:21:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:21:58.882084 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f92ba-82b4-47c4-88a1-4d8b4c091768 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:21:58.884179 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e71f92ba-82b4-47c4-88a1-4d8b4c091768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:21:58.944226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f92ba-82b4-47c4-88a1-4d8b4c091768 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:21:58.948384 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873a7e3-78c2-4248-801b-eb93cece8575 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e29ce1e3d64431bc7aa80d55787ae5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:21:58.949171 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873a7e3-78c2-4248-801b-eb93cece8575 service glance] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:58.949458 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873a7e3-78c2-4248-801b-eb93cece8575 service glance] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:58.949755 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873a7e3-78c2-4248-801b-eb93cece8575 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:58.978667 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:21:59.012884 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5873a7e3-78c2-4248-801b-eb93cece8575 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:21:59.014388 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5873a7e3-78c2-4248-801b-eb93cece8575 service glance] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:21:59.023683 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1394/2803] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:21:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:21:59.124090 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfd797-bc28-4a04-8f69-a99446e4fdc3 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:59.124421 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfd797-bc28-4a04-8f69-a99446e4fdc3 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:59.124714 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfd797-bc28-4a04-8f69-a99446e4fdc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:59.143329 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-e4bfd797-bc28-4a04-8f69-a99446e4fdc3 None None] MFA Rules not processed for user `03e7f908f0a7499792e59e31d497edb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:21:59.144845 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e4bfd797-bc28-4a04-8f69-a99446e4fdc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:21:59.150829 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:21:59.211980 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1410/2804] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Jul 4 04:21:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:21:59.225724 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873a7e3-78c2-4248-801b-eb93cece8575 service glance] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:21:59.227268 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5873a7e3-78c2-4248-801b-eb93cece8575 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:21:59.307691 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873a7e3-78c2-4248-801b-eb93cece8575 service glance] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:21:59.313167 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b53bd-b5f5-4afb-9392-c158facb6cc1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f93fdc98ff425791da3e2194b3a671', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:21:59.313841 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b53bd-b5f5-4afb-9392-c158facb6cc1 service swift] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:21:59.314132 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b53bd-b5f5-4afb-9392-c158facb6cc1 service swift] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:21:59.314448 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b53bd-b5f5-4afb-9392-c158facb6cc1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:21:59.323465 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b53bd-b5f5-4afb-9392-c158facb6cc1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:21:59.325117 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b53bd-b5f5-4afb-9392-c158facb6cc1 service swift] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:21:59.334137 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1395/2805] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Jul 4 04:21:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 04:22:07.886088 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9974f-6b40-402c-94d5-b8a696615da4 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:22:07.886687 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9974f-6b40-402c-94d5-b8a696615da4 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:22:07.886687 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9974f-6b40-402c-94d5-b8a696615da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:22:07.904848 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-c7a9974f-6b40-402c-94d5-b8a696615da4 None None] MFA Rules not processed for user `4de286b5650e4fa696ed7ee351ce5b27`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:22:07.906052 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c7a9974f-6b40-402c-94d5-b8a696615da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:22:07.913927 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1411/2806] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:22:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:22:08.405988 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b53bd-b5f5-4afb-9392-c158facb6cc1 service swift] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:22:08.407587 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-715b53bd-b5f5-4afb-9392-c158facb6cc1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:22:08.478671 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b53bd-b5f5-4afb-9392-c158facb6cc1 service swift] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:22:08.483571 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7c398-2bfb-4220-8bc7-262fb0db05de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:22:08.484266 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7c398-2bfb-4220-8bc7-262fb0db05de service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:22:08.484683 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7c398-2bfb-4220-8bc7-262fb0db05de service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:22:08.484879 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7c398-2bfb-4220-8bc7-262fb0db05de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:22:08.487483 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-eda7c398-2bfb-4220-8bc7-262fb0db05de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:22:08.498214 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda7c398-2bfb-4220-8bc7-262fb0db05de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:22:08.499966 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda7c398-2bfb-4220-8bc7-262fb0db05de service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:22:08.505528 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9974f-6b40-402c-94d5-b8a696615da4 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:22:08.506944 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c7a9974f-6b40-402c-94d5-b8a696615da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:22:08.517749 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1396/2807] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:22:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:22:08.582735 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9974f-6b40-402c-94d5-b8a696615da4 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:22:08.588086 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693d82a-340b-445e-8fb4-b8ae8b5b0d5b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a18591461343c3a0a1b0e317734ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:22:08.588745 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693d82a-340b-445e-8fb4-b8ae8b5b0d5b service placement] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:22:08.589028 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693d82a-340b-445e-8fb4-b8ae8b5b0d5b service placement] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:22:08.589301 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693d82a-340b-445e-8fb4-b8ae8b5b0d5b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:22:08.591073 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f693d82a-340b-445e-8fb4-b8ae8b5b0d5b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:22:08.606541 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f693d82a-340b-445e-8fb4-b8ae8b5b0d5b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:22:08.608185 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f693d82a-340b-445e-8fb4-b8ae8b5b0d5b service placement] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:22:08.618702 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1412/2808] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:22:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 04 04:22:09.972958 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7e64a-c685-4a17-a54c-b8cea66ab9ad None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:22:09.973513 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7e64a-c685-4a17-a54c-b8cea66ab9ad None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:22:09.973513 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7e64a-c685-4a17-a54c-b8cea66ab9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:22:09.995754 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-baf7e64a-c685-4a17-a54c-b8cea66ab9ad None None] MFA Rules not processed for user `03e7f908f0a7499792e59e31d497edb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:22:09.996986 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-baf7e64a-c685-4a17-a54c-b8cea66ab9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:22:10.005416 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1397/2809] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Jul 4 04:22:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:22:10.018507 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693d82a-340b-445e-8fb4-b8ae8b5b0d5b service placement] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:22:10.029891 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693d82a-340b-445e-8fb4-b8ae8b5b0d5b service placement] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:22:10.035252 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f86ff-8c4d-4506-ac29-437a140015d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f93fdc98ff425791da3e2194b3a671', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:22:10.035828 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f86ff-8c4d-4506-ac29-437a140015d6 service swift] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:22:10.036115 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f86ff-8c4d-4506-ac29-437a140015d6 service swift] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:22:10.036396 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f86ff-8c4d-4506-ac29-437a140015d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:22:10.044571 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f86ff-8c4d-4506-ac29-437a140015d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:22:10.046274 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f86ff-8c4d-4506-ac29-437a140015d6 service swift] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:22:10.055456 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1413/2810] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Jul 4 04:22:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 04:22:19.990410 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=77 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:22:20.051558 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=61 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:22:23.107385 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7e64a-c685-4a17-a54c-b8cea66ab9ad None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:22:23.109005 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-baf7e64a-c685-4a17-a54c-b8cea66ab9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:22:23.207267 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7e64a-c685-4a17-a54c-b8cea66ab9ad None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:22:23.213011 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb83bfe-4c37-43b5-8a0c-cb0e54e3f7f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:22:23.213692 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb83bfe-4c37-43b5-8a0c-cb0e54e3f7f2 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:22:23.213984 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb83bfe-4c37-43b5-8a0c-cb0e54e3f7f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:22:23.214305 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb83bfe-4c37-43b5-8a0c-cb0e54e3f7f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:22:23.216140 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-bfb83bfe-4c37-43b5-8a0c-cb0e54e3f7f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:22:23.229797 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb83bfe-4c37-43b5-8a0c-cb0e54e3f7f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:22:23.231518 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb83bfe-4c37-43b5-8a0c-cb0e54e3f7f2 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:22:23.242820 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1398/2811] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:22:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:22:29.985422 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f86ff-8c4d-4506-ac29-437a140015d6 service swift] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:22:29.999419 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f86ff-8c4d-4506-ac29-437a140015d6 service swift] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:22:30.005575 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874103d1-5fe9-4710-9da8-2cd6b2bbe500 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:22:30.006348 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874103d1-5fe9-4710-9da8-2cd6b2bbe500 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:22:30.006668 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874103d1-5fe9-4710-9da8-2cd6b2bbe500 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:22:30.006960 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874103d1-5fe9-4710-9da8-2cd6b2bbe500 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:22:30.008877 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-874103d1-5fe9-4710-9da8-2cd6b2bbe500 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:22:30.021474 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874103d1-5fe9-4710-9da8-2cd6b2bbe500 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:22:30.023164 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874103d1-5fe9-4710-9da8-2cd6b2bbe500 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:22:30.035292 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1414/2812] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:22:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:22:33.238131 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=34 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:22:38.301181 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb83bfe-4c37-43b5-8a0c-cb0e54e3f7f2 service nova] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:22:38.311052 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb83bfe-4c37-43b5-8a0c-cb0e54e3f7f2 service nova] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:22:38.315208 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878b826-aa18-404d-914c-abef3f9eedfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:22:38.315872 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878b826-aa18-404d-914c-abef3f9eedfb service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:22:38.316160 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878b826-aa18-404d-914c-abef3f9eedfb service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:22:38.316441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878b826-aa18-404d-914c-abef3f9eedfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:22:38.329035 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878b826-aa18-404d-914c-abef3f9eedfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:22:38.330566 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878b826-aa18-404d-914c-abef3f9eedfb service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:22:38.342358 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1399/2813] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:22:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:22:40.025858 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874103d1-5fe9-4710-9da8-2cd6b2bbe500 service nova] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:22:40.027331 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-874103d1-5fe9-4710-9da8-2cd6b2bbe500 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:22:40.031085 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=6 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:22:40.043993 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874103d1-5fe9-4710-9da8-2cd6b2bbe500 service nova] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:22:40.049763 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c3a33-04ee-4eed-b467-c2d36b3c67ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:22:40.050460 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c3a33-04ee-4eed-b467-c2d36b3c67ff service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:22:40.050751 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c3a33-04ee-4eed-b467-c2d36b3c67ff service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:22:40.051031 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c3a33-04ee-4eed-b467-c2d36b3c67ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:22:40.053285 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a43c3a33-04ee-4eed-b467-c2d36b3c67ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:22:40.066005 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c3a33-04ee-4eed-b467-c2d36b3c67ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:22:40.067755 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c3a33-04ee-4eed-b467-c2d36b3c67ff service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:22:40.079477 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1415/2814] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:22:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:22:48.337284 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=6 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:22:50.075653 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=6 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:24:15.613005 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878b826-aa18-404d-914c-abef3f9eedfb service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:24:15.678879 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878b826-aa18-404d-914c-abef3f9eedfb service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:24:15.684554 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d668336-c31c-4fec-ad01-05e48681db1b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a18591461343c3a0a1b0e317734ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:24:15.685213 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d668336-c31c-4fec-ad01-05e48681db1b service placement] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:24:15.685503 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d668336-c31c-4fec-ad01-05e48681db1b service placement] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:24:15.685811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d668336-c31c-4fec-ad01-05e48681db1b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:24:15.687836 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-8d668336-c31c-4fec-ad01-05e48681db1b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:24:15.724985 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d668336-c31c-4fec-ad01-05e48681db1b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:24:15.726629 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d668336-c31c-4fec-ad01-05e48681db1b service placement] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:24:15.737029 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1400/2815] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:24:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:24:25.732429 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=36 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:25:20.505145 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f402bf-7bb0-4bb3-9068-b71eb1e780e3 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:25:20.505705 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f402bf-7bb0-4bb3-9068-b71eb1e780e3 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:25:20.505705 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f402bf-7bb0-4bb3-9068-b71eb1e780e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:25:20.531236 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-f9f402bf-7bb0-4bb3-9068-b71eb1e780e3 None None] MFA Rules not processed for user `f0f79d337737404ead7a1417afaad862`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:25:20.532795 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f9f402bf-7bb0-4bb3-9068-b71eb1e780e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:25:20.592117 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1416/2816] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:25:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:25:20.915455 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d668336-c31c-4fec-ad01-05e48681db1b service placement] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:25:20.936006 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d668336-c31c-4fec-ad01-05e48681db1b service placement] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:25:20.939977 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9350f08-d161-4dd2-82eb-ced6c3f2e2ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:25:20.940878 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9350f08-d161-4dd2-82eb-ced6c3f2e2ae service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:25:20.941166 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9350f08-d161-4dd2-82eb-ced6c3f2e2ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:25:20.941443 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9350f08-d161-4dd2-82eb-ced6c3f2e2ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:25:20.943347 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c9350f08-d161-4dd2-82eb-ced6c3f2e2ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:25:20.968695 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9350f08-d161-4dd2-82eb-ced6c3f2e2ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:25:20.970115 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9350f08-d161-4dd2-82eb-ced6c3f2e2ae service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:25:20.979145 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1401/2817] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:25:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:25:23.607633 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274bab2-e253-4b0c-aaaf-9af27252b14e None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:25:23.608186 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274bab2-e253-4b0c-aaaf-9af27252b14e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:25:23.608806 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274bab2-e253-4b0c-aaaf-9af27252b14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:25:23.693263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-c274bab2-e253-4b0c-aaaf-9af27252b14e None None] MFA Rules not processed for user `03e7f908f0a7499792e59e31d497edb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:25:23.694736 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c274bab2-e253-4b0c-aaaf-9af27252b14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:25:23.730108 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1417/2818] 10.222.0.49 () {58 vars in 967 bytes} [Mon Jul 4 04:25:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:25:23.771145 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9350f08-d161-4dd2-82eb-ced6c3f2e2ae service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:25:23.792417 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9350f08-d161-4dd2-82eb-ced6c3f2e2ae service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:25:23.797326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba20f62-1e70-4692-9900-e4f9093ae3ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f93fdc98ff425791da3e2194b3a671', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:25:23.797975 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba20f62-1e70-4692-9900-e4f9093ae3ed service swift] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:25:23.798359 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba20f62-1e70-4692-9900-e4f9093ae3ed service swift] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:25:23.798837 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba20f62-1e70-4692-9900-e4f9093ae3ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:25:23.807473 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba20f62-1e70-4692-9900-e4f9093ae3ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:25:23.809106 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba20f62-1e70-4692-9900-e4f9093ae3ed service swift] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:25:23.817517 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1402/2819] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Jul 4 04:25:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 04:25:27.534191 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274bab2-e253-4b0c-aaaf-9af27252b14e None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:25:27.548786 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274bab2-e253-4b0c-aaaf-9af27252b14e None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:25:27.554945 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c8a2c-70a9-4ffd-bed7-a189a971f03f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a18591461343c3a0a1b0e317734ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:25:27.555618 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c8a2c-70a9-4ffd-bed7-a189a971f03f service placement] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:25:27.555907 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c8a2c-70a9-4ffd-bed7-a189a971f03f service placement] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:25:27.556193 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c8a2c-70a9-4ffd-bed7-a189a971f03f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:25:27.558009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f71c8a2c-70a9-4ffd-bed7-a189a971f03f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:25:27.570352 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c8a2c-70a9-4ffd-bed7-a189a971f03f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:25:27.571971 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c8a2c-70a9-4ffd-bed7-a189a971f03f service placement] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:25:27.582400 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1418/2820] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:25:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:25:30.917270 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba20f62-1e70-4692-9900-e4f9093ae3ed service swift] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:25:31.007532 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba20f62-1e70-4692-9900-e4f9093ae3ed service swift] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:25:31.012426 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754e79b-d563-47ff-b647-b36fd873334b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:25:31.013306 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754e79b-d563-47ff-b647-b36fd873334b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:25:31.013593 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754e79b-d563-47ff-b647-b36fd873334b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:25:31.013873 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754e79b-d563-47ff-b647-b36fd873334b admin admin] PATH_INFO: `/v3/users/4de286b5650e4fa696ed7ee351ce5b27` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:25:31.015107 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754e79b-d563-47ff-b647-b36fd873334b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4de286b5650e4fa696ed7ee351ce5b27)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:25:31.017044 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754e79b-d563-47ff-b647-b36fd873334b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:25:31.067476 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-9754e79b-d563-47ff-b647-b36fd873334b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4de286b5650e4fa696ed7ee351ce5b27'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:25:31.068133 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-9754e79b-d563-47ff-b647-b36fd873334b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4de286b5650e4fa696ed7ee351ce5b27'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:25:31.076753 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-9754e79b-d563-47ff-b647-b36fd873334b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4de286b5650e4fa696ed7ee351ce5b27'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:25:31.089640 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-9754e79b-d563-47ff-b647-b36fd873334b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4de286b5650e4fa696ed7ee351ce5b27'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:25:31.090363 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-9754e79b-d563-47ff-b647-b36fd873334b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4de286b5650e4fa696ed7ee351ce5b27'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:25:31.103709 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1403/2821] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:25:30 2022] DELETE /identity/v3/users/4de286b5650e4fa696ed7ee351ce5b27 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:25:31.368082 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c8a2c-70a9-4ffd-bed7-a189a971f03f service placement] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:25:31.382654 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c8a2c-70a9-4ffd-bed7-a189a971f03f service placement] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:25:31.445252 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab827bf0-4140-4f61-8116-cea0a46f5897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:25:31.446136 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab827bf0-4140-4f61-8116-cea0a46f5897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:25:31.446563 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab827bf0-4140-4f61-8116-cea0a46f5897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:25:31.446808 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab827bf0-4140-4f61-8116-cea0a46f5897 admin admin] PATH_INFO: `/v3/projects/df78f39513b645829427b1ae7aea03ba` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:25:31.448009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab827bf0-4140-4f61-8116-cea0a46f5897 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df78f39513b645829427b1ae7aea03ba)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:25:31.449945 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab827bf0-4140-4f61-8116-cea0a46f5897 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:25:31.495151 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:25:31.503961 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ab827bf0-4140-4f61-8116-cea0a46f5897 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df78f39513b645829427b1ae7aea03ba', 'request_id': 'req-ab827bf0-4140-4f61-8116-cea0a46f5897'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:25:31.510380 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ab827bf0-4140-4f61-8116-cea0a46f5897 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df78f39513b645829427b1ae7aea03ba', 'request_id': 'req-ab827bf0-4140-4f61-8116-cea0a46f5897'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:25:31.516264 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ab827bf0-4140-4f61-8116-cea0a46f5897 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df78f39513b645829427b1ae7aea03ba', 'request_id': 'req-ab827bf0-4140-4f61-8116-cea0a46f5897'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:25:31.544308 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ab827bf0-4140-4f61-8116-cea0a46f5897 admin admin] The token cache is being invalidate because project df78f39513b645829427b1ae7aea03ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:25:31.544604 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ab827bf0-4140-4f61-8116-cea0a46f5897 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:25:31.545257 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ab827bf0-4140-4f61-8116-cea0a46f5897 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:25:31.546912 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1419/2822] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:25:31 2022] DELETE /identity/v3/projects/df78f39513b645829427b1ae7aea03ba => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:25:31.551169 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754e79b-d563-47ff-b647-b36fd873334b admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:25:31.552785 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9754e79b-d563-47ff-b647-b36fd873334b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:25:31.566804 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754e79b-d563-47ff-b647-b36fd873334b admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:25:31.570670 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:25:31.635598 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc58984-9595-4a81-89a0-4f6995c9d5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:25:31.636663 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc58984-9595-4a81-89a0-4f6995c9d5c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:25:31.637015 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc58984-9595-4a81-89a0-4f6995c9d5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:25:31.637361 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc58984-9595-4a81-89a0-4f6995c9d5c0 admin admin] PATH_INFO: `/v3/users/494dce80730c4994934792f8a4cf7c43` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:25:31.638758 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc58984-9595-4a81-89a0-4f6995c9d5c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=494dce80730c4994934792f8a4cf7c43)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:25:31.641011 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc58984-9595-4a81-89a0-4f6995c9d5c0 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:25:31.707799 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-cdc58984-9595-4a81-89a0-4f6995c9d5c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '494dce80730c4994934792f8a4cf7c43'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:25:31.708509 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-cdc58984-9595-4a81-89a0-4f6995c9d5c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '494dce80730c4994934792f8a4cf7c43'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:25:31.720562 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-cdc58984-9595-4a81-89a0-4f6995c9d5c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '494dce80730c4994934792f8a4cf7c43'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:25:31.737187 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-cdc58984-9595-4a81-89a0-4f6995c9d5c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '494dce80730c4994934792f8a4cf7c43'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:25:31.737960 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-cdc58984-9595-4a81-89a0-4f6995c9d5c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '494dce80730c4994934792f8a4cf7c43'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:25:31.762590 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1404/2823] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:25:31 2022] DELETE /identity/v3/users/494dce80730c4994934792f8a4cf7c43 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:25:31.941904 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab827bf0-4140-4f61-8116-cea0a46f5897 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:25:31.943931 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ab827bf0-4140-4f61-8116-cea0a46f5897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:25:31.972288 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab827bf0-4140-4f61-8116-cea0a46f5897 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:25:32.031416 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972d093-43d1-46b1-8bd2-32dc1ef757b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:25:32.032216 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972d093-43d1-46b1-8bd2-32dc1ef757b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:25:32.032500 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972d093-43d1-46b1-8bd2-32dc1ef757b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:25:32.032923 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972d093-43d1-46b1-8bd2-32dc1ef757b9 admin admin] PATH_INFO: `/v3/projects/b87601be359b4a1280e02c1c9ab2b2a3` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:25:32.034204 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4972d093-43d1-46b1-8bd2-32dc1ef757b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b87601be359b4a1280e02c1c9ab2b2a3)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:25:32.036145 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4972d093-43d1-46b1-8bd2-32dc1ef757b9 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:25:32.085909 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4972d093-43d1-46b1-8bd2-32dc1ef757b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b87601be359b4a1280e02c1c9ab2b2a3', 'request_id': 'req-4972d093-43d1-46b1-8bd2-32dc1ef757b9'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:25:32.092085 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4972d093-43d1-46b1-8bd2-32dc1ef757b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b87601be359b4a1280e02c1c9ab2b2a3', 'request_id': 'req-4972d093-43d1-46b1-8bd2-32dc1ef757b9'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:25:32.097897 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4972d093-43d1-46b1-8bd2-32dc1ef757b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b87601be359b4a1280e02c1c9ab2b2a3', 'request_id': 'req-4972d093-43d1-46b1-8bd2-32dc1ef757b9'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:25:32.112563 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4972d093-43d1-46b1-8bd2-32dc1ef757b9 admin admin] The token cache is being invalidate because project b87601be359b4a1280e02c1c9ab2b2a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:25:32.112853 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4972d093-43d1-46b1-8bd2-32dc1ef757b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:25:32.113487 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4972d093-43d1-46b1-8bd2-32dc1ef757b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:25:32.115120 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1420/2824] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:25:31 2022] DELETE /identity/v3/projects/b87601be359b4a1280e02c1c9ab2b2a3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:25:41.749379 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=50,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:25:42.109345 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=66,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:26:47.934765 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc58984-9595-4a81-89a0-4f6995c9d5c0 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:26:47.936788 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-cdc58984-9595-4a81-89a0-4f6995c9d5c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:26:48.032983 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc58984-9595-4a81-89a0-4f6995c9d5c0 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:26:48.113603 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c031c-c646-4fd0-bb8e-c72facdecfc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:26:48.114290 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c031c-c646-4fd0-bb8e-c72facdecfc7 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:26:48.114584 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c031c-c646-4fd0-bb8e-c72facdecfc7 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:26:48.114868 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c031c-c646-4fd0-bb8e-c72facdecfc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:26:48.117086 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e29c031c-c646-4fd0-bb8e-c72facdecfc7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:26:48.182244 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c031c-c646-4fd0-bb8e-c72facdecfc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:26:48.183839 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c031c-c646-4fd0-bb8e-c72facdecfc7 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:26:48.193138 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1405/2825] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:26:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:26:49.631300 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972d093-43d1-46b1-8bd2-32dc1ef757b9 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:26:49.632757 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4972d093-43d1-46b1-8bd2-32dc1ef757b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:26:49.716440 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972d093-43d1-46b1-8bd2-32dc1ef757b9 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:26:49.720583 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627acb8f-1ae6-46fa-8618-2663aff2c434 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:26:49.721235 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627acb8f-1ae6-46fa-8618-2663aff2c434 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:26:49.721523 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627acb8f-1ae6-46fa-8618-2663aff2c434 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:26:49.721802 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627acb8f-1ae6-46fa-8618-2663aff2c434 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:26:49.723776 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-627acb8f-1ae6-46fa-8618-2663aff2c434 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:26:49.738286 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627acb8f-1ae6-46fa-8618-2663aff2c434 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:26:49.739744 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627acb8f-1ae6-46fa-8618-2663aff2c434 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:26:49.750867 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1421/2826] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:26:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:26:53.720380 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c031c-c646-4fd0-bb8e-c72facdecfc7 service nova] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:26:53.721829 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e29c031c-c646-4fd0-bb8e-c72facdecfc7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:26:53.733672 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c031c-c646-4fd0-bb8e-c72facdecfc7 service nova] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:26:53.737653 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc96372-0832-4705-be91-ef0c69156882 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:26:53.738326 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc96372-0832-4705-be91-ef0c69156882 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:26:53.738615 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc96372-0832-4705-be91-ef0c69156882 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:26:53.738899 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc96372-0832-4705-be91-ef0c69156882 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:26:53.740716 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-bdc96372-0832-4705-be91-ef0c69156882 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:26:53.754942 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc96372-0832-4705-be91-ef0c69156882 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:26:53.756444 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc96372-0832-4705-be91-ef0c69156882 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:26:53.767811 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1406/2827] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:26:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:26:59.745824 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=35 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:27:03.762546 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:27:08.516120 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627acb8f-1ae6-46fa-8618-2663aff2c434 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:08.517639 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-627acb8f-1ae6-46fa-8618-2663aff2c434 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:08.582863 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627acb8f-1ae6-46fa-8618-2663aff2c434 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:08.587848 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb84f1b-5551-4d02-a739-b0ae4035e341 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:08.588490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb84f1b-5551-4d02-a739-b0ae4035e341 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:08.588911 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb84f1b-5551-4d02-a739-b0ae4035e341 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:08.589189 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb84f1b-5551-4d02-a739-b0ae4035e341 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:08.591735 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-8cb84f1b-5551-4d02-a739-b0ae4035e341 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:08.663125 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb84f1b-5551-4d02-a739-b0ae4035e341 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:08.664498 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb84f1b-5551-4d02-a739-b0ae4035e341 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:08.674857 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1422/2828] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:27:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:27:11.631211 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc96372-0832-4705-be91-ef0c69156882 service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:11.632866 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-bdc96372-0832-4705-be91-ef0c69156882 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:11.649397 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc96372-0832-4705-be91-ef0c69156882 service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:11.654492 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71972a9a-eba0-4324-9fc9-9ebcc77481a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:11.655384 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71972a9a-eba0-4324-9fc9-9ebcc77481a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:11.655665 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71972a9a-eba0-4324-9fc9-9ebcc77481a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:11.655941 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71972a9a-eba0-4324-9fc9-9ebcc77481a2 admin admin] PATH_INFO: `/v3/users/f0f79d337737404ead7a1417afaad862` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:11.657227 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71972a9a-eba0-4324-9fc9-9ebcc77481a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0f79d337737404ead7a1417afaad862)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:11.659257 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71972a9a-eba0-4324-9fc9-9ebcc77481a2 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:11.721856 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-71972a9a-eba0-4324-9fc9-9ebcc77481a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0f79d337737404ead7a1417afaad862'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:11.722791 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-71972a9a-eba0-4324-9fc9-9ebcc77481a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0f79d337737404ead7a1417afaad862'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:11.731526 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-71972a9a-eba0-4324-9fc9-9ebcc77481a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0f79d337737404ead7a1417afaad862'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:11.747987 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-71972a9a-eba0-4324-9fc9-9ebcc77481a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0f79d337737404ead7a1417afaad862'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:11.748927 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-71972a9a-eba0-4324-9fc9-9ebcc77481a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0f79d337737404ead7a1417afaad862'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:11.765358 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1407/2829] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:27:11 2022] DELETE /identity/v3/users/f0f79d337737404ead7a1417afaad862 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:27:11.967480 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb84f1b-5551-4d02-a739-b0ae4035e341 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:11.978449 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb84f1b-5551-4d02-a739-b0ae4035e341 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:12.036644 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9dfb1-c098-44e1-b7b3-b63268efb289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:12.037519 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9dfb1-c098-44e1-b7b3-b63268efb289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:12.037805 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9dfb1-c098-44e1-b7b3-b63268efb289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:12.038083 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9dfb1-c098-44e1-b7b3-b63268efb289 admin admin] PATH_INFO: `/v3/projects/bf13398674c9433188e62926fb0bfd61` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:12.039322 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9dfb1-c098-44e1-b7b3-b63268efb289 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf13398674c9433188e62926fb0bfd61)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:12.041243 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9dfb1-c098-44e1-b7b3-b63268efb289 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:12.090980 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-60c9dfb1-c098-44e1-b7b3-b63268efb289 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf13398674c9433188e62926fb0bfd61', 'request_id': 'req-60c9dfb1-c098-44e1-b7b3-b63268efb289'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:12.092885 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:27:12.097528 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-60c9dfb1-c098-44e1-b7b3-b63268efb289 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf13398674c9433188e62926fb0bfd61', 'request_id': 'req-60c9dfb1-c098-44e1-b7b3-b63268efb289'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:12.103910 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-60c9dfb1-c098-44e1-b7b3-b63268efb289 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf13398674c9433188e62926fb0bfd61', 'request_id': 'req-60c9dfb1-c098-44e1-b7b3-b63268efb289'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:12.117363 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-60c9dfb1-c098-44e1-b7b3-b63268efb289 admin admin] The token cache is being invalidate because project bf13398674c9433188e62926fb0bfd61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:27:12.117653 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-60c9dfb1-c098-44e1-b7b3-b63268efb289 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:12.118310 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-60c9dfb1-c098-44e1-b7b3-b63268efb289 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:12.119843 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1423/2830] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:27:11 2022] DELETE /identity/v3/projects/bf13398674c9433188e62926fb0bfd61 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:27:12.125747 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c6e58-eb63-4240-a0fa-14023b8d2220 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:12.125981 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c6e58-eb63-4240-a0fa-14023b8d2220 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:12.126303 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c6e58-eb63-4240-a0fa-14023b8d2220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:12.184000 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-a60c6e58-eb63-4240-a0fa-14023b8d2220 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:27:12.185297 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a60c6e58-eb63-4240-a0fa-14023b8d2220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:12.253669 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1408/2831] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:27:12.262193 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd64410-3b00-4ab3-9aaf-4b0acf818cfc None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:12.262501 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd64410-3b00-4ab3-9aaf-4b0acf818cfc None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:12.262781 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd64410-3b00-4ab3-9aaf-4b0acf818cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:12.282009 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-6fd64410-3b00-4ab3-9aaf-4b0acf818cfc None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:27:12.283307 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6fd64410-3b00-4ab3-9aaf-4b0acf818cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:12.291847 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1424/2832] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:27:12.296826 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c6e58-eb63-4240-a0fa-14023b8d2220 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:12.307549 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c6e58-eb63-4240-a0fa-14023b8d2220 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:12.313198 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b85ac-d5db-48c6-a9d6-2976018789eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:12.313867 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b85ac-d5db-48c6-a9d6-2976018789eb admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:12.314190 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b85ac-d5db-48c6-a9d6-2976018789eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:12.314458 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b85ac-d5db-48c6-a9d6-2976018789eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:12.315201 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b85ac-d5db-48c6-a9d6-2976018789eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:27:12.315515 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b85ac-d5db-48c6-a9d6-2976018789eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:12.317156 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b85ac-d5db-48c6-a9d6-2976018789eb admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:12.332871 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1409/2833] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:27:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:27:12.340423 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd64410-3b00-4ab3-9aaf-4b0acf818cfc None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:12.350747 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd64410-3b00-4ab3-9aaf-4b0acf818cfc None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:12.356676 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272be40-a225-4b8f-a8c7-f1c93188eb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:12.357337 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272be40-a225-4b8f-a8c7-f1c93188eb6d admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:12.357621 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272be40-a225-4b8f-a8c7-f1c93188eb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:12.357901 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272be40-a225-4b8f-a8c7-f1c93188eb6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:12.358635 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272be40-a225-4b8f-a8c7-f1c93188eb6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:12.360566 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272be40-a225-4b8f-a8c7-f1c93188eb6d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:12.394732 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1425/2834] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:27:12 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:27:12.400662 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b85ac-d5db-48c6-a9d6-2976018789eb admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:12.411855 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b85ac-d5db-48c6-a9d6-2976018789eb admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:12.439262 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:27:12.473925 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb72169-fd1c-4186-b5cb-45d892b400e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:12.474635 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb72169-fd1c-4186-b5cb-45d892b400e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:12.474925 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb72169-fd1c-4186-b5cb-45d892b400e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:12.475180 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb72169-fd1c-4186-b5cb-45d892b400e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:12.475944 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb72169-fd1c-4186-b5cb-45d892b400e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:12.478034 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb72169-fd1c-4186-b5cb-45d892b400e8 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:12.498712 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1410/2835] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:27:12 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:27:12.502873 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272be40-a225-4b8f-a8c7-f1c93188eb6d admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:12.513516 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272be40-a225-4b8f-a8c7-f1c93188eb6d admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:12.519077 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d952f-69c6-4050-9c5d-2e830896adba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:12.519750 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d952f-69c6-4050-9c5d-2e830896adba admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:12.520042 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d952f-69c6-4050-9c5d-2e830896adba admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:12.520325 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d952f-69c6-4050-9c5d-2e830896adba admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:12.521064 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d952f-69c6-4050-9c5d-2e830896adba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:12.522760 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d952f-69c6-4050-9c5d-2e830896adba admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:12.534501 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1426/2836] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:27:12.538503 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb72169-fd1c-4186-b5cb-45d892b400e8 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:12.552939 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb72169-fd1c-4186-b5cb-45d892b400e8 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:12.560874 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a9a4f-f21f-4f6c-8ddb-15b3536faabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:12.561544 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a9a4f-f21f-4f6c-8ddb-15b3536faabb admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:12.561837 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a9a4f-f21f-4f6c-8ddb-15b3536faabb admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:12.562114 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a9a4f-f21f-4f6c-8ddb-15b3536faabb admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:12.562887 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285a9a4f-f21f-4f6c-8ddb-15b3536faabb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:12.564523 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285a9a4f-f21f-4f6c-8ddb-15b3536faabb admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:12.576685 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1411/2837] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:27:12.581520 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d952f-69c6-4050-9c5d-2e830896adba admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:12.592749 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d952f-69c6-4050-9c5d-2e830896adba admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:12.598211 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7ceff-5869-49dd-9e3a-f69acaf9ebd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:12.599205 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7ceff-5869-49dd-9e3a-f69acaf9ebd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:12.599521 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7ceff-5869-49dd-9e3a-f69acaf9ebd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:12.599806 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7ceff-5869-49dd-9e3a-f69acaf9ebd7 admin admin] PATH_INFO: `/v3/projects/c3dd31625bb74197a73304053924e367/users/471ae233a5654224af891dfae6cfde27/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:12.616307 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7ceff-5869-49dd-9e3a-f69acaf9ebd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3dd31625bb74197a73304053924e367, user_id=471ae233a5654224af891dfae6cfde27, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:12.619388 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7ceff-5869-49dd-9e3a-f69acaf9ebd7 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:12.635032 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1427/2838] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:27:12 2022] PUT /identity/v3/projects/c3dd31625bb74197a73304053924e367/users/471ae233a5654224af891dfae6cfde27/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:27:12.647563 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462ba04-d3d9-41ec-9603-37a1c7b89fa1 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:12.648102 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462ba04-d3d9-41ec-9603-37a1c7b89fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:12.648102 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462ba04-d3d9-41ec-9603-37a1c7b89fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:12.679716 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-8462ba04-d3d9-41ec-9603-37a1c7b89fa1 None None] MFA Rules not processed for user `471ae233a5654224af891dfae6cfde27`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:27:12.680977 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-8462ba04-d3d9-41ec-9603-37a1c7b89fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:12.752477 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1412/2839] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:27:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:27:12.757107 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7ceff-5869-49dd-9e3a-f69acaf9ebd7 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:12.823884 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7ceff-5869-49dd-9e3a-f69acaf9ebd7 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:12.830593 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ca9c7-fa2d-43bb-8c64-b94eec515902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:12.831263 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ca9c7-fa2d-43bb-8c64-b94eec515902 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:12.831551 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ca9c7-fa2d-43bb-8c64-b94eec515902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:12.831831 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ca9c7-fa2d-43bb-8c64-b94eec515902 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:12.832568 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ca9c7-fa2d-43bb-8c64-b94eec515902 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:12.834561 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ca9c7-fa2d-43bb-8c64-b94eec515902 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:12.863650 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1428/2840] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:27:12 2022] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:27:12.867823 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462ba04-d3d9-41ec-9603-37a1c7b89fa1 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:12.879175 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462ba04-d3d9-41ec-9603-37a1c7b89fa1 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:12.951395 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e5f50-acce-4fd5-bace-c32463d05033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:12.952077 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e5f50-acce-4fd5-bace-c32463d05033 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:12.952362 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e5f50-acce-4fd5-bace-c32463d05033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:12.952638 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e5f50-acce-4fd5-bace-c32463d05033 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:12.953327 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e5f50-acce-4fd5-bace-c32463d05033 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:12.955647 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e5f50-acce-4fd5-bace-c32463d05033 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:12.980374 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1413/2841] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:27:12 2022] POST /identity/v3/users => generated 300 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:27:12.984505 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ca9c7-fa2d-43bb-8c64-b94eec515902 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:12.995387 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ca9c7-fa2d-43bb-8c64-b94eec515902 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:13.000973 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66c82d-bb1a-49f0-863e-262fc5d70c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:13.001631 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66c82d-bb1a-49f0-863e-262fc5d70c94 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:13.001913 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66c82d-bb1a-49f0-863e-262fc5d70c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:13.002246 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66c82d-bb1a-49f0-863e-262fc5d70c94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:13.002982 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db66c82d-bb1a-49f0-863e-262fc5d70c94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:13.004617 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db66c82d-bb1a-49f0-863e-262fc5d70c94 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:13.015618 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1429/2842] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:27:13.019772 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e5f50-acce-4fd5-bace-c32463d05033 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:13.030419 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e5f50-acce-4fd5-bace-c32463d05033 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:13.036092 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fbbe97-1cc9-4bf3-8a3c-41fb12d839f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:13.036980 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbbe97-1cc9-4bf3-8a3c-41fb12d839f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:13.037265 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbbe97-1cc9-4bf3-8a3c-41fb12d839f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:13.037542 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbbe97-1cc9-4bf3-8a3c-41fb12d839f8 admin admin] PATH_INFO: `/v3/projects/85ee0f0cad794b4d84a2ee1f33cd0567/users/35e881e86c074ff1ba239fdb539f3453/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:13.053507 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fbbe97-1cc9-4bf3-8a3c-41fb12d839f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85ee0f0cad794b4d84a2ee1f33cd0567, user_id=35e881e86c074ff1ba239fdb539f3453, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:13.056222 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fbbe97-1cc9-4bf3-8a3c-41fb12d839f8 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:13.074648 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1414/2843] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:27:13 2022] PUT /identity/v3/projects/85ee0f0cad794b4d84a2ee1f33cd0567/users/35e881e86c074ff1ba239fdb539f3453/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:27:13.078775 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66c82d-bb1a-49f0-863e-262fc5d70c94 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:13.089488 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66c82d-bb1a-49f0-863e-262fc5d70c94 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:13.149301 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:27:13.162273 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ecda6c-635d-4b01-a820-7b8c14d4ecf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:13.162950 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecda6c-635d-4b01-a820-7b8c14d4ecf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:13.163240 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecda6c-635d-4b01-a820-7b8c14d4ecf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:13.163504 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecda6c-635d-4b01-a820-7b8c14d4ecf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:13.164248 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ecda6c-635d-4b01-a820-7b8c14d4ecf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:13.165946 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ecda6c-635d-4b01-a820-7b8c14d4ecf8 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:13.176158 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1430/2844] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:27:13.180556 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fbbe97-1cc9-4bf3-8a3c-41fb12d839f8 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:13.186192 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:27:13.192930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fbbe97-1cc9-4bf3-8a3c-41fb12d839f8 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:13.198376 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd6bded-7a2f-4c61-880a-37d86fe317bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:13.199267 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6bded-7a2f-4c61-880a-37d86fe317bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:13.199557 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6bded-7a2f-4c61-880a-37d86fe317bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:13.199839 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6bded-7a2f-4c61-880a-37d86fe317bf admin admin] PATH_INFO: `/v3/projects/85ee0f0cad794b4d84a2ee1f33cd0567/users/35e881e86c074ff1ba239fdb539f3453/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:13.201935 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd6bded-7a2f-4c61-880a-37d86fe317bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=85ee0f0cad794b4d84a2ee1f33cd0567, user_id=35e881e86c074ff1ba239fdb539f3453, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:13.204608 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd6bded-7a2f-4c61-880a-37d86fe317bf admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:13.215916 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1415/2845] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:27:13 2022] PUT /identity/v3/projects/85ee0f0cad794b4d84a2ee1f33cd0567/users/35e881e86c074ff1ba239fdb539f3453/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:27:13.225976 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483201c9-7a57-405b-9d4f-fe3e327a067d None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:13.226313 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483201c9-7a57-405b-9d4f-fe3e327a067d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:13.226597 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483201c9-7a57-405b-9d4f-fe3e327a067d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:13.260243 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-483201c9-7a57-405b-9d4f-fe3e327a067d None None] MFA Rules not processed for user `35e881e86c074ff1ba239fdb539f3453`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:27:13.262115 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-483201c9-7a57-405b-9d4f-fe3e327a067d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:13.336680 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1431/2846] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:27:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:27:13.348281 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd6bded-7a2f-4c61-880a-37d86fe317bf admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:13.350358 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9fd6bded-7a2f-4c61-880a-37d86fe317bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:13.409175 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd6bded-7a2f-4c61-880a-37d86fe317bf admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:13.413649 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3f7c3-db54-463b-b1dc-e44683e0e8aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:13.414344 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3f7c3-db54-463b-b1dc-e44683e0e8aa service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:13.414627 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3f7c3-db54-463b-b1dc-e44683e0e8aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:13.414922 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3f7c3-db54-463b-b1dc-e44683e0e8aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:13.424996 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3f7c3-db54-463b-b1dc-e44683e0e8aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:13.426507 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3f7c3-db54-463b-b1dc-e44683e0e8aa service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:13.436733 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1416/2847] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:27:13 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:27:13.464894 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483201c9-7a57-405b-9d4f-fe3e327a067d None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:13.534049 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483201c9-7a57-405b-9d4f-fe3e327a067d None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:13.540074 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d351554-abd0-467f-9916-cd63a219f1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:13.540961 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d351554-abd0-467f-9916-cd63a219f1cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:13.541253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d351554-abd0-467f-9916-cd63a219f1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:13.541552 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d351554-abd0-467f-9916-cd63a219f1cc admin admin] PATH_INFO: `/v3/users/471ae233a5654224af891dfae6cfde27` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:13.542876 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d351554-abd0-467f-9916-cd63a219f1cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=471ae233a5654224af891dfae6cfde27)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:13.544881 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d351554-abd0-467f-9916-cd63a219f1cc admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:13.597259 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1d351554-abd0-467f-9916-cd63a219f1cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '471ae233a5654224af891dfae6cfde27'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:13.605711 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1d351554-abd0-467f-9916-cd63a219f1cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '471ae233a5654224af891dfae6cfde27'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:13.606432 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1d351554-abd0-467f-9916-cd63a219f1cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '471ae233a5654224af891dfae6cfde27'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:13.620899 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1d351554-abd0-467f-9916-cd63a219f1cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '471ae233a5654224af891dfae6cfde27'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:13.621926 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1d351554-abd0-467f-9916-cd63a219f1cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '471ae233a5654224af891dfae6cfde27'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:13.624798 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:27:13.638677 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1432/2848] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:27:13 2022] DELETE /identity/v3/users/471ae233a5654224af891dfae6cfde27 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:27:13.643372 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7511283-c4b6-4dd1-88cc-2d37fee36da6 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:13.643698 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7511283-c4b6-4dd1-88cc-2d37fee36da6 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:13.643959 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7511283-c4b6-4dd1-88cc-2d37fee36da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:13.661896 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-d7511283-c4b6-4dd1-88cc-2d37fee36da6 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:27:13.663111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d7511283-c4b6-4dd1-88cc-2d37fee36da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:13.724081 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1417/2849] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:27:13.733962 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d351554-abd0-467f-9916-cd63a219f1cc admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:13.735573 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1d351554-abd0-467f-9916-cd63a219f1cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:13.795819 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d351554-abd0-467f-9916-cd63a219f1cc admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:13.799916 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470655e4-7446-4a16-9e6d-1593969ed5be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:13.800564 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470655e4-7446-4a16-9e6d-1593969ed5be service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:13.800862 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470655e4-7446-4a16-9e6d-1593969ed5be service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:13.801148 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470655e4-7446-4a16-9e6d-1593969ed5be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:13.810681 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470655e4-7446-4a16-9e6d-1593969ed5be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:13.812143 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470655e4-7446-4a16-9e6d-1593969ed5be service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:13.821749 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1433/2850] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:27:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:27:14.107553 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7511283-c4b6-4dd1-88cc-2d37fee36da6 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:14.109058 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d7511283-c4b6-4dd1-88cc-2d37fee36da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:14.123650 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7511283-c4b6-4dd1-88cc-2d37fee36da6 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:14.129299 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58acd83-4ce1-4969-80b6-20fd99fbfa8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:14.130403 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58acd83-4ce1-4969-80b6-20fd99fbfa8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:14.130689 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58acd83-4ce1-4969-80b6-20fd99fbfa8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:14.130968 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58acd83-4ce1-4969-80b6-20fd99fbfa8c admin admin] PATH_INFO: `/v3/projects/c3dd31625bb74197a73304053924e367` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:14.132152 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58acd83-4ce1-4969-80b6-20fd99fbfa8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3dd31625bb74197a73304053924e367)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:14.134058 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58acd83-4ce1-4969-80b6-20fd99fbfa8c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:14.182874 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d58acd83-4ce1-4969-80b6-20fd99fbfa8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3dd31625bb74197a73304053924e367', 'request_id': 'req-d58acd83-4ce1-4969-80b6-20fd99fbfa8c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:14.188794 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d58acd83-4ce1-4969-80b6-20fd99fbfa8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3dd31625bb74197a73304053924e367', 'request_id': 'req-d58acd83-4ce1-4969-80b6-20fd99fbfa8c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:14.195284 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d58acd83-4ce1-4969-80b6-20fd99fbfa8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3dd31625bb74197a73304053924e367', 'request_id': 'req-d58acd83-4ce1-4969-80b6-20fd99fbfa8c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:14.209547 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d58acd83-4ce1-4969-80b6-20fd99fbfa8c admin admin] The token cache is being invalidate because project c3dd31625bb74197a73304053924e367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:27:14.209843 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d58acd83-4ce1-4969-80b6-20fd99fbfa8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:14.210470 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d58acd83-4ce1-4969-80b6-20fd99fbfa8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:14.212032 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1418/2851] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:27:14 2022] DELETE /identity/v3/projects/c3dd31625bb74197a73304053924e367 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:27:14.216195 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470655e4-7446-4a16-9e6d-1593969ed5be service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:14.225865 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470655e4-7446-4a16-9e6d-1593969ed5be service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:14.292589 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aad127-0617-4a17-b0e6-130dabf1702f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:14.293814 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aad127-0617-4a17-b0e6-130dabf1702f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:14.294284 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aad127-0617-4a17-b0e6-130dabf1702f admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:14.294736 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aad127-0617-4a17-b0e6-130dabf1702f admin admin] PATH_INFO: `/v3/users/35e881e86c074ff1ba239fdb539f3453` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:14.296179 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aad127-0617-4a17-b0e6-130dabf1702f admin admin] RBAC: Authorizing `identity:delete_user(user_id=35e881e86c074ff1ba239fdb539f3453)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:14.298106 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aad127-0617-4a17-b0e6-130dabf1702f admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:14.347361 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f0aad127-0617-4a17-b0e6-130dabf1702f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35e881e86c074ff1ba239fdb539f3453'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:14.357256 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f0aad127-0617-4a17-b0e6-130dabf1702f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35e881e86c074ff1ba239fdb539f3453'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:14.357941 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f0aad127-0617-4a17-b0e6-130dabf1702f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35e881e86c074ff1ba239fdb539f3453'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:14.371453 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f0aad127-0617-4a17-b0e6-130dabf1702f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35e881e86c074ff1ba239fdb539f3453'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:14.372273 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f0aad127-0617-4a17-b0e6-130dabf1702f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35e881e86c074ff1ba239fdb539f3453'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:14.388485 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1434/2852] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:27:14 2022] DELETE /identity/v3/users/35e881e86c074ff1ba239fdb539f3453 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:27:14.681357 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58acd83-4ce1-4969-80b6-20fd99fbfa8c admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:14.682969 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d58acd83-4ce1-4969-80b6-20fd99fbfa8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:14.696843 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58acd83-4ce1-4969-80b6-20fd99fbfa8c admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:14.710066 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:27:14.769357 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96313dcf-a623-4530-9cbb-71ef2b2310e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:14.770278 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96313dcf-a623-4530-9cbb-71ef2b2310e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:14.770570 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96313dcf-a623-4530-9cbb-71ef2b2310e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:14.770855 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96313dcf-a623-4530-9cbb-71ef2b2310e3 admin admin] PATH_INFO: `/v3/projects/85ee0f0cad794b4d84a2ee1f33cd0567` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:14.772555 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96313dcf-a623-4530-9cbb-71ef2b2310e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85ee0f0cad794b4d84a2ee1f33cd0567)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:14.775622 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96313dcf-a623-4530-9cbb-71ef2b2310e3 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:14.831277 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-96313dcf-a623-4530-9cbb-71ef2b2310e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85ee0f0cad794b4d84a2ee1f33cd0567', 'request_id': 'req-96313dcf-a623-4530-9cbb-71ef2b2310e3'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:14.838047 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-96313dcf-a623-4530-9cbb-71ef2b2310e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85ee0f0cad794b4d84a2ee1f33cd0567', 'request_id': 'req-96313dcf-a623-4530-9cbb-71ef2b2310e3'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:14.846129 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-96313dcf-a623-4530-9cbb-71ef2b2310e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85ee0f0cad794b4d84a2ee1f33cd0567', 'request_id': 'req-96313dcf-a623-4530-9cbb-71ef2b2310e3'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:14.860125 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-96313dcf-a623-4530-9cbb-71ef2b2310e3 admin admin] The token cache is being invalidate because project 85ee0f0cad794b4d84a2ee1f33cd0567 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:27:14.860410 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-96313dcf-a623-4530-9cbb-71ef2b2310e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:14.861035 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-96313dcf-a623-4530-9cbb-71ef2b2310e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:14.862657 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1419/2853] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:27:14 2022] DELETE /identity/v3/projects/85ee0f0cad794b4d84a2ee1f33cd0567 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:27:14.867861 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec75ae-69e3-453f-a5fa-331d644995b0 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:14.868152 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec75ae-69e3-453f-a5fa-331d644995b0 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:14.868449 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec75ae-69e3-453f-a5fa-331d644995b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:14.888663 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-95ec75ae-69e3-453f-a5fa-331d644995b0 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:27:14.889922 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-95ec75ae-69e3-453f-a5fa-331d644995b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:14.899600 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:27:14.964670 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1435/2854] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:27:14.972695 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf8595-d79c-44e6-b629-479ca0552b2e None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:14.973009 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf8595-d79c-44e6-b629-479ca0552b2e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:14.973286 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf8595-d79c-44e6-b629-479ca0552b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:14.992382 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-6adf8595-d79c-44e6-b629-479ca0552b2e None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:27:14.993564 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6adf8595-d79c-44e6-b629-479ca0552b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:15.002087 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1420/2855] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:27:15.006576 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec75ae-69e3-453f-a5fa-331d644995b0 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:15.016918 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec75ae-69e3-453f-a5fa-331d644995b0 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:15.023110 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf852b9-c80a-4f0a-888a-368e19652202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:15.023770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf852b9-c80a-4f0a-888a-368e19652202 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:15.024052 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf852b9-c80a-4f0a-888a-368e19652202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:15.024358 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf852b9-c80a-4f0a-888a-368e19652202 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:15.025095 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf852b9-c80a-4f0a-888a-368e19652202 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:27:15.025403 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf852b9-c80a-4f0a-888a-368e19652202 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:15.027047 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf852b9-c80a-4f0a-888a-368e19652202 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:15.039260 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1436/2856] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:27:15.043789 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf8595-d79c-44e6-b629-479ca0552b2e None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:15.053610 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf8595-d79c-44e6-b629-479ca0552b2e None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:15.059663 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5dcfba-f862-49a2-8a96-9bf638ddd5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:15.060313 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5dcfba-f862-49a2-8a96-9bf638ddd5a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:15.060596 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5dcfba-f862-49a2-8a96-9bf638ddd5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:15.060867 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5dcfba-f862-49a2-8a96-9bf638ddd5a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:15.061554 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5dcfba-f862-49a2-8a96-9bf638ddd5a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:15.063539 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5dcfba-f862-49a2-8a96-9bf638ddd5a9 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:15.092138 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1421/2857] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:27:15 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:27:15.096299 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf852b9-c80a-4f0a-888a-368e19652202 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:15.109641 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf852b9-c80a-4f0a-888a-368e19652202 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:15.178363 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64388101-e790-4f5a-beff-a1c5c5edc27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:15.179120 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64388101-e790-4f5a-beff-a1c5c5edc27e admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:15.179398 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64388101-e790-4f5a-beff-a1c5c5edc27e admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:15.179713 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64388101-e790-4f5a-beff-a1c5c5edc27e admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:15.180499 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64388101-e790-4f5a-beff-a1c5c5edc27e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:15.182541 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64388101-e790-4f5a-beff-a1c5c5edc27e admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:15.204688 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1437/2858] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:27:15 2022] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 04 04:27:15.209408 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5dcfba-f862-49a2-8a96-9bf638ddd5a9 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:15.220718 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5dcfba-f862-49a2-8a96-9bf638ddd5a9 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:15.227252 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a5095-2577-4b15-bfbe-22a4d2def908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:15.227955 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a5095-2577-4b15-bfbe-22a4d2def908 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:15.228243 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a5095-2577-4b15-bfbe-22a4d2def908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:15.228531 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a5095-2577-4b15-bfbe-22a4d2def908 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:15.229319 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a5095-2577-4b15-bfbe-22a4d2def908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:15.231197 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a5095-2577-4b15-bfbe-22a4d2def908 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:15.242451 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1422/2859] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:27:15.246728 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64388101-e790-4f5a-beff-a1c5c5edc27e admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:15.257717 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64388101-e790-4f5a-beff-a1c5c5edc27e admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:15.263904 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26129727-f3bd-4337-b366-16bbf1105021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:15.264568 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26129727-f3bd-4337-b366-16bbf1105021 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:15.264854 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26129727-f3bd-4337-b366-16bbf1105021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:15.265154 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26129727-f3bd-4337-b366-16bbf1105021 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:15.265895 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26129727-f3bd-4337-b366-16bbf1105021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:15.267548 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26129727-f3bd-4337-b366-16bbf1105021 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:15.278805 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1438/2860] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 04:27:15.283287 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a5095-2577-4b15-bfbe-22a4d2def908 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:15.293818 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a5095-2577-4b15-bfbe-22a4d2def908 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:15.299190 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d62641-726e-41c9-a0fe-d97dc9fa5c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:15.300080 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d62641-726e-41c9-a0fe-d97dc9fa5c88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:15.300361 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d62641-726e-41c9-a0fe-d97dc9fa5c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:15.300638 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d62641-726e-41c9-a0fe-d97dc9fa5c88 admin admin] PATH_INFO: `/v3/projects/2643881833284e7496e1ee28844de7c1/users/a64057cdaf2245ac9c4df4ea2ebaaf9e/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:15.315554 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d62641-726e-41c9-a0fe-d97dc9fa5c88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2643881833284e7496e1ee28844de7c1, user_id=a64057cdaf2245ac9c4df4ea2ebaaf9e, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:15.318206 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d62641-726e-41c9-a0fe-d97dc9fa5c88 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:15.333657 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1423/2861] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:27:15 2022] PUT /identity/v3/projects/2643881833284e7496e1ee28844de7c1/users/a64057cdaf2245ac9c4df4ea2ebaaf9e/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:27:15.345302 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ccd15-0106-467e-8b08-3492a0cdeec9 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:15.345483 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ccd15-0106-467e-8b08-3492a0cdeec9 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:15.345796 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ccd15-0106-467e-8b08-3492a0cdeec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:15.374789 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-da0ccd15-0106-467e-8b08-3492a0cdeec9 None None] MFA Rules not processed for user `a64057cdaf2245ac9c4df4ea2ebaaf9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:27:15.376031 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-da0ccd15-0106-467e-8b08-3492a0cdeec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:15.445656 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1439/2862] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:27:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:27:15.452223 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d62641-726e-41c9-a0fe-d97dc9fa5c88 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:15.506476 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:27:15.534483 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d62641-726e-41c9-a0fe-d97dc9fa5c88 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:15.539702 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ac39d-6860-4466-8cc1-393e50fa5867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:15.540365 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ac39d-6860-4466-8cc1-393e50fa5867 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:15.540651 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ac39d-6860-4466-8cc1-393e50fa5867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:15.540954 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ac39d-6860-4466-8cc1-393e50fa5867 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:15.541651 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ac39d-6860-4466-8cc1-393e50fa5867 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:15.543626 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ac39d-6860-4466-8cc1-393e50fa5867 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:15.572052 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1424/2863] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:27:15 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:27:15.576350 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ccd15-0106-467e-8b08-3492a0cdeec9 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:15.588247 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ccd15-0106-467e-8b08-3492a0cdeec9 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:15.593151 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:27:15.646622 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9e556-46de-4792-a637-070924fdf030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:15.647220 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9e556-46de-4792-a637-070924fdf030 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:15.647504 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9e556-46de-4792-a637-070924fdf030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:15.647779 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9e556-46de-4792-a637-070924fdf030 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:15.648473 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9e556-46de-4792-a637-070924fdf030 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:15.650437 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9e556-46de-4792-a637-070924fdf030 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:15.672549 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1440/2864] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:27:15 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:27:15.676292 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ac39d-6860-4466-8cc1-393e50fa5867 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:15.687020 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ac39d-6860-4466-8cc1-393e50fa5867 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:15.692031 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95488628-6169-4fed-8132-5dafcc97e9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:15.692696 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95488628-6169-4fed-8132-5dafcc97e9af admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:15.692987 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95488628-6169-4fed-8132-5dafcc97e9af admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:15.693271 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95488628-6169-4fed-8132-5dafcc97e9af admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:15.694016 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95488628-6169-4fed-8132-5dafcc97e9af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:15.695802 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95488628-6169-4fed-8132-5dafcc97e9af admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:15.707072 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1425/2865] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:27:15.711465 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9e556-46de-4792-a637-070924fdf030 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:15.722870 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9e556-46de-4792-a637-070924fdf030 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:15.728419 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae76f6-89af-4b2a-9e82-9db921573e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:15.729398 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae76f6-89af-4b2a-9e82-9db921573e8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:15.729719 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae76f6-89af-4b2a-9e82-9db921573e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:15.730038 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae76f6-89af-4b2a-9e82-9db921573e8a admin admin] PATH_INFO: `/v3/projects/e02109e1d3784f799329cb360d285e62/users/d80d513cb644467e86bc39717093a127/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:15.746497 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae76f6-89af-4b2a-9e82-9db921573e8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e02109e1d3784f799329cb360d285e62, user_id=d80d513cb644467e86bc39717093a127, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:15.749370 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae76f6-89af-4b2a-9e82-9db921573e8a admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:15.773131 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1441/2866] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:27:15 2022] PUT /identity/v3/projects/e02109e1d3784f799329cb360d285e62/users/d80d513cb644467e86bc39717093a127/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:27:15.777407 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95488628-6169-4fed-8132-5dafcc97e9af admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:15.789208 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95488628-6169-4fed-8132-5dafcc97e9af admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:15.848526 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a08b7ef-d995-44d7-aa18-097a56269524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:15.849261 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08b7ef-d995-44d7-aa18-097a56269524 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:15.849552 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08b7ef-d995-44d7-aa18-097a56269524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:15.849837 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08b7ef-d995-44d7-aa18-097a56269524 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:15.850607 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a08b7ef-d995-44d7-aa18-097a56269524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:15.852262 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a08b7ef-d995-44d7-aa18-097a56269524 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:15.863205 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1426/2867] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:27:15.867923 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae76f6-89af-4b2a-9e82-9db921573e8a admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:15.878860 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae76f6-89af-4b2a-9e82-9db921573e8a admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:15.883664 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134b423-4fb5-4d3c-b3b1-5cbfb17d9f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:15.884579 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134b423-4fb5-4d3c-b3b1-5cbfb17d9f92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:15.884869 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134b423-4fb5-4d3c-b3b1-5cbfb17d9f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:15.885152 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134b423-4fb5-4d3c-b3b1-5cbfb17d9f92 admin admin] PATH_INFO: `/v3/projects/e02109e1d3784f799329cb360d285e62/users/d80d513cb644467e86bc39717093a127/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:15.887510 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134b423-4fb5-4d3c-b3b1-5cbfb17d9f92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e02109e1d3784f799329cb360d285e62, user_id=d80d513cb644467e86bc39717093a127, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:15.891597 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134b423-4fb5-4d3c-b3b1-5cbfb17d9f92 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:15.904774 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1442/2868] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:27:15 2022] PUT /identity/v3/projects/e02109e1d3784f799329cb360d285e62/users/d80d513cb644467e86bc39717093a127/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:27:15.918798 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ade662-ec80-41fc-b4f1-b51f32ba0b28 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:15.919126 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ade662-ec80-41fc-b4f1-b51f32ba0b28 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:15.919431 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ade662-ec80-41fc-b4f1-b51f32ba0b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:15.951553 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-f9ade662-ec80-41fc-b4f1-b51f32ba0b28 None None] MFA Rules not processed for user `d80d513cb644467e86bc39717093a127`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:27:15.952767 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f9ade662-ec80-41fc-b4f1-b51f32ba0b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:16.028329 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1427/2869] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:27:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:27:16.040785 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134b423-4fb5-4d3c-b3b1-5cbfb17d9f92 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:16.043596 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-5134b423-4fb5-4d3c-b3b1-5cbfb17d9f92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:16.110138 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134b423-4fb5-4d3c-b3b1-5cbfb17d9f92 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:16.117043 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db6d6f-c758-41c5-81de-dff97c358da2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:16.117844 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db6d6f-c758-41c5-81de-dff97c358da2 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:16.118137 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db6d6f-c758-41c5-81de-dff97c358da2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:16.118493 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db6d6f-c758-41c5-81de-dff97c358da2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:16.128829 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db6d6f-c758-41c5-81de-dff97c358da2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:16.130325 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db6d6f-c758-41c5-81de-dff97c358da2 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:16.140833 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1443/2870] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:27:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:27:16.229605 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ade662-ec80-41fc-b4f1-b51f32ba0b28 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:16.246441 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ade662-ec80-41fc-b4f1-b51f32ba0b28 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:16.251279 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b94e7-38b8-4f48-a0ac-528c481901ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:16.251931 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b94e7-38b8-4f48-a0ac-528c481901ff service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:16.252223 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b94e7-38b8-4f48-a0ac-528c481901ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:16.252507 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b94e7-38b8-4f48-a0ac-528c481901ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:16.289465 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:27:16.315002 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b94e7-38b8-4f48-a0ac-528c481901ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:16.316501 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b94e7-38b8-4f48-a0ac-528c481901ff service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:16.325563 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1428/2871] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:27:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:27:16.601107 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db6d6f-c758-41c5-81de-dff97c358da2 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:16.666756 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db6d6f-c758-41c5-81de-dff97c358da2 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:16.672011 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0186f2a-2d27-4a18-9e18-c455ec3796f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:16.672883 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0186f2a-2d27-4a18-9e18-c455ec3796f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:16.673160 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0186f2a-2d27-4a18-9e18-c455ec3796f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:16.673493 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0186f2a-2d27-4a18-9e18-c455ec3796f7 admin admin] PATH_INFO: `/v3/users/a64057cdaf2245ac9c4df4ea2ebaaf9e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:16.674943 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0186f2a-2d27-4a18-9e18-c455ec3796f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a64057cdaf2245ac9c4df4ea2ebaaf9e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:16.676825 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0186f2a-2d27-4a18-9e18-c455ec3796f7 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:16.681887 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:27:16.729761 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a0186f2a-2d27-4a18-9e18-c455ec3796f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a64057cdaf2245ac9c4df4ea2ebaaf9e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:16.739077 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a0186f2a-2d27-4a18-9e18-c455ec3796f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a64057cdaf2245ac9c4df4ea2ebaaf9e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:16.739877 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a0186f2a-2d27-4a18-9e18-c455ec3796f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a64057cdaf2245ac9c4df4ea2ebaaf9e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:16.752446 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a0186f2a-2d27-4a18-9e18-c455ec3796f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a64057cdaf2245ac9c4df4ea2ebaaf9e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:16.753108 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a0186f2a-2d27-4a18-9e18-c455ec3796f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a64057cdaf2245ac9c4df4ea2ebaaf9e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:16.765649 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1444/2872] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:27:16 2022] DELETE /identity/v3/users/a64057cdaf2245ac9c4df4ea2ebaaf9e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:27:16.770820 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f0f64-b177-48cd-bf1e-4728cd47d4e4 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:16.771338 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f0f64-b177-48cd-bf1e-4728cd47d4e4 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:16.771338 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f0f64-b177-48cd-bf1e-4728cd47d4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:16.789988 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-f30f0f64-b177-48cd-bf1e-4728cd47d4e4 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:27:16.791216 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f30f0f64-b177-48cd-bf1e-4728cd47d4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:16.856038 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1429/2873] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:27:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:27:16.865848 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0186f2a-2d27-4a18-9e18-c455ec3796f7 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:16.867338 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a0186f2a-2d27-4a18-9e18-c455ec3796f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:16.925645 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0186f2a-2d27-4a18-9e18-c455ec3796f7 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:16.929442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f21fb8-ef96-4cd6-882f-be8c136380da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:16.930128 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f21fb8-ef96-4cd6-882f-be8c136380da service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:16.930442 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f21fb8-ef96-4cd6-882f-be8c136380da service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:16.930723 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f21fb8-ef96-4cd6-882f-be8c136380da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:16.940094 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f21fb8-ef96-4cd6-882f-be8c136380da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:16.941560 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f21fb8-ef96-4cd6-882f-be8c136380da service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:16.951825 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1445/2874] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:27:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:27:17.230021 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f0f64-b177-48cd-bf1e-4728cd47d4e4 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:17.231752 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f30f0f64-b177-48cd-bf1e-4728cd47d4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:17.247295 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f0f64-b177-48cd-bf1e-4728cd47d4e4 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:17.252545 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c9899-7b5b-4f46-a94c-aeb38a6a68d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:17.253561 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c9899-7b5b-4f46-a94c-aeb38a6a68d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:17.253842 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c9899-7b5b-4f46-a94c-aeb38a6a68d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:17.254122 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c9899-7b5b-4f46-a94c-aeb38a6a68d4 admin admin] PATH_INFO: `/v3/projects/2643881833284e7496e1ee28844de7c1` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:17.255407 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8c9899-7b5b-4f46-a94c-aeb38a6a68d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2643881833284e7496e1ee28844de7c1)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:17.257262 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8c9899-7b5b-4f46-a94c-aeb38a6a68d4 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:17.307220 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ed8c9899-7b5b-4f46-a94c-aeb38a6a68d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2643881833284e7496e1ee28844de7c1', 'request_id': 'req-ed8c9899-7b5b-4f46-a94c-aeb38a6a68d4'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:17.313750 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ed8c9899-7b5b-4f46-a94c-aeb38a6a68d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2643881833284e7496e1ee28844de7c1', 'request_id': 'req-ed8c9899-7b5b-4f46-a94c-aeb38a6a68d4'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:17.321367 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ed8c9899-7b5b-4f46-a94c-aeb38a6a68d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2643881833284e7496e1ee28844de7c1', 'request_id': 'req-ed8c9899-7b5b-4f46-a94c-aeb38a6a68d4'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:17.336071 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ed8c9899-7b5b-4f46-a94c-aeb38a6a68d4 admin admin] The token cache is being invalidate because project 2643881833284e7496e1ee28844de7c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:27:17.336341 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ed8c9899-7b5b-4f46-a94c-aeb38a6a68d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:17.337053 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ed8c9899-7b5b-4f46-a94c-aeb38a6a68d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:17.338765 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1430/2875] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:27:17 2022] DELETE /identity/v3/projects/2643881833284e7496e1ee28844de7c1 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:27:17.342964 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f21fb8-ef96-4cd6-882f-be8c136380da service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:17.353985 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f21fb8-ef96-4cd6-882f-be8c136380da service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:17.416537 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308034e-2b00-4e08-a4cc-1100de7e3b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:17.417420 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308034e-2b00-4e08-a4cc-1100de7e3b4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:17.417709 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308034e-2b00-4e08-a4cc-1100de7e3b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:17.418032 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308034e-2b00-4e08-a4cc-1100de7e3b4b admin admin] PATH_INFO: `/v3/users/d80d513cb644467e86bc39717093a127` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:17.419288 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7308034e-2b00-4e08-a4cc-1100de7e3b4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d80d513cb644467e86bc39717093a127)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:17.421246 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7308034e-2b00-4e08-a4cc-1100de7e3b4b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:17.451069 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:27:17.472941 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7308034e-2b00-4e08-a4cc-1100de7e3b4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd80d513cb644467e86bc39717093a127'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:17.480598 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7308034e-2b00-4e08-a4cc-1100de7e3b4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd80d513cb644467e86bc39717093a127'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:17.481261 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7308034e-2b00-4e08-a4cc-1100de7e3b4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd80d513cb644467e86bc39717093a127'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:17.493342 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7308034e-2b00-4e08-a4cc-1100de7e3b4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd80d513cb644467e86bc39717093a127'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:17.493963 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7308034e-2b00-4e08-a4cc-1100de7e3b4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd80d513cb644467e86bc39717093a127'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:17.507012 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1446/2876] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:27:17 2022] DELETE /identity/v3/users/d80d513cb644467e86bc39717093a127 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:27:17.803388 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c9899-7b5b-4f46-a94c-aeb38a6a68d4 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:17.804945 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ed8c9899-7b5b-4f46-a94c-aeb38a6a68d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:17.818605 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c9899-7b5b-4f46-a94c-aeb38a6a68d4 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:17.879993 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f93419-eef0-4919-a5b1-19711bcdcf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:17.880876 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f93419-eef0-4919-a5b1-19711bcdcf9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:17.881166 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f93419-eef0-4919-a5b1-19711bcdcf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:17.881449 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f93419-eef0-4919-a5b1-19711bcdcf9d admin admin] PATH_INFO: `/v3/projects/e02109e1d3784f799329cb360d285e62` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:17.882699 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f93419-eef0-4919-a5b1-19711bcdcf9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e02109e1d3784f799329cb360d285e62)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:17.884682 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f93419-eef0-4919-a5b1-19711bcdcf9d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:17.887210 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:27:17.942567 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e7f93419-eef0-4919-a5b1-19711bcdcf9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e02109e1d3784f799329cb360d285e62', 'request_id': 'req-e7f93419-eef0-4919-a5b1-19711bcdcf9d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:17.950799 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e7f93419-eef0-4919-a5b1-19711bcdcf9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e02109e1d3784f799329cb360d285e62', 'request_id': 'req-e7f93419-eef0-4919-a5b1-19711bcdcf9d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:17.960607 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e7f93419-eef0-4919-a5b1-19711bcdcf9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e02109e1d3784f799329cb360d285e62', 'request_id': 'req-e7f93419-eef0-4919-a5b1-19711bcdcf9d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:17.975949 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e7f93419-eef0-4919-a5b1-19711bcdcf9d admin admin] The token cache is being invalidate because project e02109e1d3784f799329cb360d285e62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:27:17.976248 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e7f93419-eef0-4919-a5b1-19711bcdcf9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:17.976907 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e7f93419-eef0-4919-a5b1-19711bcdcf9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:17.978548 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1431/2877] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:27:17 2022] DELETE /identity/v3/projects/e02109e1d3784f799329cb360d285e62 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:27:17.983908 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c3d5f-02a3-4d28-b166-7ec85b0ad3ab None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:17.984348 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c3d5f-02a3-4d28-b166-7ec85b0ad3ab None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:17.984554 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c3d5f-02a3-4d28-b166-7ec85b0ad3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:18.003304 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-4e9c3d5f-02a3-4d28-b166-7ec85b0ad3ab None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:27:18.004454 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4e9c3d5f-02a3-4d28-b166-7ec85b0ad3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:18.073595 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1447/2878] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:27:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:27:18.081861 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20083d08-e023-4d35-8f00-ec9b9d0a070b None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:18.082192 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20083d08-e023-4d35-8f00-ec9b9d0a070b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:18.082458 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20083d08-e023-4d35-8f00-ec9b9d0a070b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:18.102805 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-20083d08-e023-4d35-8f00-ec9b9d0a070b None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:27:18.104016 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-20083d08-e023-4d35-8f00-ec9b9d0a070b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:18.113724 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1432/2879] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:27:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:27:18.118133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c3d5f-02a3-4d28-b166-7ec85b0ad3ab None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:18.128136 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c3d5f-02a3-4d28-b166-7ec85b0ad3ab None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:18.133163 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7db49-3feb-4159-8bb9-a38fc22147d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:18.133819 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7db49-3feb-4159-8bb9-a38fc22147d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:18.134109 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7db49-3feb-4159-8bb9-a38fc22147d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:18.134490 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7db49-3feb-4159-8bb9-a38fc22147d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:18.135225 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7db49-3feb-4159-8bb9-a38fc22147d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:27:18.135544 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7db49-3feb-4159-8bb9-a38fc22147d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:18.137174 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7db49-3feb-4159-8bb9-a38fc22147d7 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:18.149618 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1448/2880] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 04 04:27:18.154731 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20083d08-e023-4d35-8f00-ec9b9d0a070b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:18.168209 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20083d08-e023-4d35-8f00-ec9b9d0a070b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:18.174479 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313ed10-86ea-4eea-b004-fd3b48cd7ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:18.175171 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313ed10-86ea-4eea-b004-fd3b48cd7ebb admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:18.175452 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313ed10-86ea-4eea-b004-fd3b48cd7ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:18.175728 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313ed10-86ea-4eea-b004-fd3b48cd7ebb admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:18.176435 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9313ed10-86ea-4eea-b004-fd3b48cd7ebb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:18.178409 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9313ed10-86ea-4eea-b004-fd3b48cd7ebb admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:18.212301 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1433/2881] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:27:18 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:27:18.216823 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7db49-3feb-4159-8bb9-a38fc22147d7 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:18.227421 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7db49-3feb-4159-8bb9-a38fc22147d7 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:18.285509 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed8952-b214-49b0-a48b-62c7b223eef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:18.286094 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed8952-b214-49b0-a48b-62c7b223eef4 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:18.286412 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed8952-b214-49b0-a48b-62c7b223eef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:18.286694 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed8952-b214-49b0-a48b-62c7b223eef4 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:18.287380 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed8952-b214-49b0-a48b-62c7b223eef4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:18.289322 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed8952-b214-49b0-a48b-62c7b223eef4 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:18.313528 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1449/2882] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:27:18 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:27:18.317776 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313ed10-86ea-4eea-b004-fd3b48cd7ebb admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:18.329122 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313ed10-86ea-4eea-b004-fd3b48cd7ebb admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:18.335360 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7b673-9b97-40de-bcd5-d9c514d69ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:18.336072 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7b673-9b97-40de-bcd5-d9c514d69ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:18.336359 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7b673-9b97-40de-bcd5-d9c514d69ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:18.337171 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7b673-9b97-40de-bcd5-d9c514d69ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:18.337351 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd7b673-9b97-40de-bcd5-d9c514d69ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:18.339033 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd7b673-9b97-40de-bcd5-d9c514d69ba4 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:18.350545 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1434/2883] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:27:18.354278 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed8952-b214-49b0-a48b-62c7b223eef4 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:18.365372 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed8952-b214-49b0-a48b-62c7b223eef4 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:18.370948 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67c8e6-374c-4e66-8b2f-53ff0a21dfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:18.371612 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67c8e6-374c-4e66-8b2f-53ff0a21dfc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:18.371899 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67c8e6-374c-4e66-8b2f-53ff0a21dfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:18.372275 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67c8e6-374c-4e66-8b2f-53ff0a21dfc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:18.373140 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67c8e6-374c-4e66-8b2f-53ff0a21dfc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:18.374800 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67c8e6-374c-4e66-8b2f-53ff0a21dfc8 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:18.385575 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1450/2884] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:27:18.389986 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7b673-9b97-40de-bcd5-d9c514d69ba4 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:18.400537 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7b673-9b97-40de-bcd5-d9c514d69ba4 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:18.405704 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c244c8b-7b14-4fba-a761-1d1ce342af04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:18.406621 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c244c8b-7b14-4fba-a761-1d1ce342af04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:18.406907 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c244c8b-7b14-4fba-a761-1d1ce342af04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:18.407202 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c244c8b-7b14-4fba-a761-1d1ce342af04 admin admin] PATH_INFO: `/v3/projects/d56856622db2454a9e97b678376cf25a/users/b90c7c75347342d882eb97ef03a011bb/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:18.424178 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c244c8b-7b14-4fba-a761-1d1ce342af04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d56856622db2454a9e97b678376cf25a, user_id=b90c7c75347342d882eb97ef03a011bb, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:18.426675 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c244c8b-7b14-4fba-a761-1d1ce342af04 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:18.440197 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1435/2885] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:27:18 2022] PUT /identity/v3/projects/d56856622db2454a9e97b678376cf25a/users/b90c7c75347342d882eb97ef03a011bb/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:27:18.445306 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75673a-3cce-4d86-b3d8-25a8dda23e19 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:18.445646 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75673a-3cce-4d86-b3d8-25a8dda23e19 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:18.445930 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75673a-3cce-4d86-b3d8-25a8dda23e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:18.464922 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-9f75673a-3cce-4d86-b3d8-25a8dda23e19 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:27:18.466175 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9f75673a-3cce-4d86-b3d8-25a8dda23e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:18.472035 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:27:18.536756 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1451/2886] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:27:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:27:18.546751 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c244c8b-7b14-4fba-a761-1d1ce342af04 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:18.548760 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6c244c8b-7b14-4fba-a761-1d1ce342af04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:18.611500 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c244c8b-7b14-4fba-a761-1d1ce342af04 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:18.615986 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956a762-9bfe-435d-81cc-b0eaa2857c56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:18.616644 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956a762-9bfe-435d-81cc-b0eaa2857c56 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:18.616929 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956a762-9bfe-435d-81cc-b0eaa2857c56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:18.617230 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956a762-9bfe-435d-81cc-b0eaa2857c56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:18.627416 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956a762-9bfe-435d-81cc-b0eaa2857c56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:18.628880 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956a762-9bfe-435d-81cc-b0eaa2857c56 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:18.638693 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1436/2887] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:27:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:27:19.283127 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6689cdc-3a68-4179-85c3-0e94e629a3e9 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:19.283629 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6689cdc-3a68-4179-85c3-0e94e629a3e9 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:19.283770 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6689cdc-3a68-4179-85c3-0e94e629a3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:19.310228 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-a6689cdc-3a68-4179-85c3-0e94e629a3e9 None None] MFA Rules not processed for user `b90c7c75347342d882eb97ef03a011bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:27:19.311530 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a6689cdc-3a68-4179-85c3-0e94e629a3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:19.379099 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1452/2888] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:27:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:27:19.383648 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956a762-9bfe-435d-81cc-b0eaa2857c56 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:19.393550 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956a762-9bfe-435d-81cc-b0eaa2857c56 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:19.398930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa2e73a-469a-48b6-ae4d-320240feba9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:19.399595 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2e73a-469a-48b6-ae4d-320240feba9d admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:19.399878 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2e73a-469a-48b6-ae4d-320240feba9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:19.400154 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2e73a-469a-48b6-ae4d-320240feba9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:19.400863 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa2e73a-469a-48b6-ae4d-320240feba9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:19.402832 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa2e73a-469a-48b6-ae4d-320240feba9d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:19.431965 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1437/2889] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:27:19 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:27:19.436126 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6689cdc-3a68-4179-85c3-0e94e629a3e9 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:19.447958 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6689cdc-3a68-4179-85c3-0e94e629a3e9 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:19.508025 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c4e1a-6599-4ab1-bfba-c7599ec256f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:19.508714 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c4e1a-6599-4ab1-bfba-c7599ec256f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:19.509005 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c4e1a-6599-4ab1-bfba-c7599ec256f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:19.509295 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c4e1a-6599-4ab1-bfba-c7599ec256f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:19.510019 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c4e1a-6599-4ab1-bfba-c7599ec256f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:19.512208 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c4e1a-6599-4ab1-bfba-c7599ec256f7 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:19.538556 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1453/2890] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:27:19 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:27:19.542577 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa2e73a-469a-48b6-ae4d-320240feba9d admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:19.553218 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa2e73a-469a-48b6-ae4d-320240feba9d admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:19.559165 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3b789-58a3-4094-b46b-12db38af6278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:19.559829 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3b789-58a3-4094-b46b-12db38af6278 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:19.560143 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3b789-58a3-4094-b46b-12db38af6278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:19.560436 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3b789-58a3-4094-b46b-12db38af6278 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:19.561172 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a3b789-58a3-4094-b46b-12db38af6278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:19.562844 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a3b789-58a3-4094-b46b-12db38af6278 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:19.564121 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:27:19.575947 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1438/2891] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:27:19.580675 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c4e1a-6599-4ab1-bfba-c7599ec256f7 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:19.590974 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c4e1a-6599-4ab1-bfba-c7599ec256f7 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:19.597037 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ee35f-40c0-476f-a1ac-ded28f093ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:19.597933 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ee35f-40c0-476f-a1ac-ded28f093ce5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:19.598246 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ee35f-40c0-476f-a1ac-ded28f093ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:19.598523 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ee35f-40c0-476f-a1ac-ded28f093ce5 admin admin] PATH_INFO: `/v3/projects/43e5142cf49f4ff98410e38106fbd1c4/users/a3d2dbe50e3744eca547bccbbcdddb03/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:19.613668 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ee35f-40c0-476f-a1ac-ded28f093ce5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43e5142cf49f4ff98410e38106fbd1c4, user_id=a3d2dbe50e3744eca547bccbbcdddb03, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:19.616387 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ee35f-40c0-476f-a1ac-ded28f093ce5 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:19.630660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1454/2892] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:27:19 2022] PUT /identity/v3/projects/43e5142cf49f4ff98410e38106fbd1c4/users/a3d2dbe50e3744eca547bccbbcdddb03/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:27:19.634613 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3b789-58a3-4094-b46b-12db38af6278 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:19.645436 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3b789-58a3-4094-b46b-12db38af6278 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:19.702253 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e0d1a-2e5b-4f09-b53f-30fb6b30ea60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:19.702933 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e0d1a-2e5b-4f09-b53f-30fb6b30ea60 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:19.703226 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e0d1a-2e5b-4f09-b53f-30fb6b30ea60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:19.703514 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e0d1a-2e5b-4f09-b53f-30fb6b30ea60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:19.704234 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50e0d1a-2e5b-4f09-b53f-30fb6b30ea60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:19.706180 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50e0d1a-2e5b-4f09-b53f-30fb6b30ea60 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:19.716558 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1439/2893] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:27:19.720848 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ee35f-40c0-476f-a1ac-ded28f093ce5 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:19.731572 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ee35f-40c0-476f-a1ac-ded28f093ce5 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:19.736766 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd1989-7789-478f-a11b-7833e56bf850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:19.737660 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd1989-7789-478f-a11b-7833e56bf850 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:19.737947 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd1989-7789-478f-a11b-7833e56bf850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:19.738253 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd1989-7789-478f-a11b-7833e56bf850 admin admin] PATH_INFO: `/v3/projects/43e5142cf49f4ff98410e38106fbd1c4/users/a3d2dbe50e3744eca547bccbbcdddb03/roles/2eee98054d42475bb7e22a8487ab235e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:19.740445 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd1989-7789-478f-a11b-7833e56bf850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43e5142cf49f4ff98410e38106fbd1c4, user_id=a3d2dbe50e3744eca547bccbbcdddb03, role_id=2eee98054d42475bb7e22a8487ab235e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:19.743133 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd1989-7789-478f-a11b-7833e56bf850 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:19.745359 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:27:19.755936 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1455/2894] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:27:19 2022] PUT /identity/v3/projects/43e5142cf49f4ff98410e38106fbd1c4/users/a3d2dbe50e3744eca547bccbbcdddb03/roles/2eee98054d42475bb7e22a8487ab235e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 04 04:27:20.393948 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9644c9e-7064-4083-ba90-3a62c6ee222f None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:20.394492 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9644c9e-7064-4083-ba90-3a62c6ee222f None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:20.394604 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9644c9e-7064-4083-ba90-3a62c6ee222f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:20.422650 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e9644c9e-7064-4083-ba90-3a62c6ee222f None None] MFA Rules not processed for user `a3d2dbe50e3744eca547bccbbcdddb03`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:27:20.423814 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e9644c9e-7064-4083-ba90-3a62c6ee222f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:20.495570 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1440/2895] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:27:20 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:27:20.507588 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40472b92-0c63-49f5-86ff-71af14ff1f20 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:20.508143 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40472b92-0c63-49f5-86ff-71af14ff1f20 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:20.508143 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40472b92-0c63-49f5-86ff-71af14ff1f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:20.526329 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-40472b92-0c63-49f5-86ff-71af14ff1f20 None None] MFA Rules not processed for user `b90c7c75347342d882eb97ef03a011bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:27:20.527585 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-40472b92-0c63-49f5-86ff-71af14ff1f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:20.584317 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1456/2896] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:27:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:27:20.597665 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9644c9e-7064-4083-ba90-3a62c6ee222f None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:20.599572 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e9644c9e-7064-4083-ba90-3a62c6ee222f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:20.671578 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9644c9e-7064-4083-ba90-3a62c6ee222f None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:20.677272 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab364737-e1e2-45ee-a9b2-d63117fbdf3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:20.677867 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab364737-e1e2-45ee-a9b2-d63117fbdf3f service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:20.678169 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab364737-e1e2-45ee-a9b2-d63117fbdf3f service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:20.678462 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab364737-e1e2-45ee-a9b2-d63117fbdf3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:20.686662 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab364737-e1e2-45ee-a9b2-d63117fbdf3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:20.688275 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab364737-e1e2-45ee-a9b2-d63117fbdf3f service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:20.697349 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1441/2897] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:27:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:27:21.244123 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40472b92-0c63-49f5-86ff-71af14ff1f20 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:21.245692 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-40472b92-0c63-49f5-86ff-71af14ff1f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:21.321504 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40472b92-0c63-49f5-86ff-71af14ff1f20 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:21.326687 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe9a0d-a8f1-4480-b2fa-b5d5deeb86ca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a18591461343c3a0a1b0e317734ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:21.327347 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe9a0d-a8f1-4480-b2fa-b5d5deeb86ca service placement] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:21.327633 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe9a0d-a8f1-4480-b2fa-b5d5deeb86ca service placement] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:21.327917 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe9a0d-a8f1-4480-b2fa-b5d5deeb86ca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:21.330052 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1fbe9a0d-a8f1-4480-b2fa-b5d5deeb86ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:21.342147 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe9a0d-a8f1-4480-b2fa-b5d5deeb86ca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:21.343783 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe9a0d-a8f1-4480-b2fa-b5d5deeb86ca service placement] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:21.353745 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1457/2898] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:27:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:27:23.310784 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab364737-e1e2-45ee-a9b2-d63117fbdf3f service nova] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:23.312478 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ab364737-e1e2-45ee-a9b2-d63117fbdf3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:23.318765 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:27:23.375398 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab364737-e1e2-45ee-a9b2-d63117fbdf3f service nova] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:23.379429 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c25e4b-340d-4305-8647-5f20e81f4dd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:23.380080 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c25e4b-340d-4305-8647-5f20e81f4dd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:23.380367 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c25e4b-340d-4305-8647-5f20e81f4dd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:23.380657 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c25e4b-340d-4305-8647-5f20e81f4dd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:23.382676 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c6c25e4b-340d-4305-8647-5f20e81f4dd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:23.392731 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c25e4b-340d-4305-8647-5f20e81f4dd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:23.394195 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c25e4b-340d-4305-8647-5f20e81f4dd1 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:23.402306 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1442/2899] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:27:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:27:29.656988 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe9a0d-a8f1-4480-b2fa-b5d5deeb86ca service placement] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:29.671973 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe9a0d-a8f1-4480-b2fa-b5d5deeb86ca service placement] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:29.677979 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e34f11-f894-4616-b950-8aadb7087fbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:29.678683 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e34f11-f894-4616-b950-8aadb7087fbb service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:29.692863 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e34f11-f894-4616-b950-8aadb7087fbb service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:29.693280 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e34f11-f894-4616-b950-8aadb7087fbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:29.695560 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-61e34f11-f894-4616-b950-8aadb7087fbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:29.709715 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e34f11-f894-4616-b950-8aadb7087fbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:29.711431 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e34f11-f894-4616-b950-8aadb7087fbb service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:29.723884 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1458/2900] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:27:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:27:33.398714 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=25 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:27:33.784444 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c25e4b-340d-4305-8647-5f20e81f4dd1 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:33.787083 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c6c25e4b-340d-4305-8647-5f20e81f4dd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:33.850969 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c25e4b-340d-4305-8647-5f20e81f4dd1 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:33.854918 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07acde-1a80-4aed-9389-6970469c0452 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:33.855554 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07acde-1a80-4aed-9389-6970469c0452 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:33.855834 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07acde-1a80-4aed-9389-6970469c0452 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:33.856112 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07acde-1a80-4aed-9389-6970469c0452 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:33.865501 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07acde-1a80-4aed-9389-6970469c0452 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:33.866973 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07acde-1a80-4aed-9389-6970469c0452 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:33.876547 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1443/2901] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:27:33 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:27:39.719072 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:INSERT=1,keystone:SELECT=65 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:27:43.872574 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=26 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:27:53.135955 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e34f11-f894-4616-b950-8aadb7087fbb service nova] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:53.137615 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-61e34f11-f894-4616-b950-8aadb7087fbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:53.152112 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e34f11-f894-4616-b950-8aadb7087fbb service nova] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:53.158183 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576669a-a1d0-4e04-91a4-1bc869dd2bc9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a18591461343c3a0a1b0e317734ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:53.158903 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576669a-a1d0-4e04-91a4-1bc869dd2bc9 service placement] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:53.159323 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576669a-a1d0-4e04-91a4-1bc869dd2bc9 service placement] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:53.159606 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576669a-a1d0-4e04-91a4-1bc869dd2bc9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:53.161742 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f576669a-a1d0-4e04-91a4-1bc869dd2bc9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:53.174978 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f576669a-a1d0-4e04-91a4-1bc869dd2bc9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:53.176606 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f576669a-a1d0-4e04-91a4-1bc869dd2bc9 service placement] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:53.188516 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1459/2902] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:27:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:27:53.709907 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07acde-1a80-4aed-9389-6970469c0452 service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:53.787510 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07acde-1a80-4aed-9389-6970469c0452 service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:53.793497 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34db96d-896d-4719-8ed0-de010f05d5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:53.794428 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34db96d-896d-4719-8ed0-de010f05d5ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:53.794718 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34db96d-896d-4719-8ed0-de010f05d5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:53.795000 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34db96d-896d-4719-8ed0-de010f05d5ba admin admin] PATH_INFO: `/v3/users/b90c7c75347342d882eb97ef03a011bb` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:53.796347 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34db96d-896d-4719-8ed0-de010f05d5ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=b90c7c75347342d882eb97ef03a011bb)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:53.798363 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34db96d-896d-4719-8ed0-de010f05d5ba admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:53.849843 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f34db96d-896d-4719-8ed0-de010f05d5ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b90c7c75347342d882eb97ef03a011bb'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:53.850556 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f34db96d-896d-4719-8ed0-de010f05d5ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b90c7c75347342d882eb97ef03a011bb'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:53.858749 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f34db96d-896d-4719-8ed0-de010f05d5ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b90c7c75347342d882eb97ef03a011bb'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:53.870669 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f34db96d-896d-4719-8ed0-de010f05d5ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b90c7c75347342d882eb97ef03a011bb'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:53.871315 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f34db96d-896d-4719-8ed0-de010f05d5ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b90c7c75347342d882eb97ef03a011bb'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:53.883396 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1444/2903] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:27:53 2022] DELETE /identity/v3/users/b90c7c75347342d882eb97ef03a011bb => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:27:54.068040 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576669a-a1d0-4e04-91a4-1bc869dd2bc9 service placement] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:54.079674 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576669a-a1d0-4e04-91a4-1bc869dd2bc9 service placement] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:54.137848 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2baf177-7464-492b-9a65-52fd6dac2c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:54.139005 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2baf177-7464-492b-9a65-52fd6dac2c0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:54.139304 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2baf177-7464-492b-9a65-52fd6dac2c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:54.139583 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2baf177-7464-492b-9a65-52fd6dac2c0c admin admin] PATH_INFO: `/v3/projects/d56856622db2454a9e97b678376cf25a` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:54.140904 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2baf177-7464-492b-9a65-52fd6dac2c0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d56856622db2454a9e97b678376cf25a)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:54.142967 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2baf177-7464-492b-9a65-52fd6dac2c0c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:54.193303 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e2baf177-7464-492b-9a65-52fd6dac2c0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd56856622db2454a9e97b678376cf25a', 'request_id': 'req-e2baf177-7464-492b-9a65-52fd6dac2c0c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:54.199427 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e2baf177-7464-492b-9a65-52fd6dac2c0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd56856622db2454a9e97b678376cf25a', 'request_id': 'req-e2baf177-7464-492b-9a65-52fd6dac2c0c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:54.205783 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e2baf177-7464-492b-9a65-52fd6dac2c0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd56856622db2454a9e97b678376cf25a', 'request_id': 'req-e2baf177-7464-492b-9a65-52fd6dac2c0c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:54.220555 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e2baf177-7464-492b-9a65-52fd6dac2c0c admin admin] The token cache is being invalidate because project d56856622db2454a9e97b678376cf25a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:27:54.220862 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e2baf177-7464-492b-9a65-52fd6dac2c0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:54.221499 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e2baf177-7464-492b-9a65-52fd6dac2c0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:54.223611 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1460/2904] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:27:54 2022] DELETE /identity/v3/projects/d56856622db2454a9e97b678376cf25a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:27:54.227518 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34db96d-896d-4719-8ed0-de010f05d5ba admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:54.228992 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f34db96d-896d-4719-8ed0-de010f05d5ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:54.242658 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34db96d-896d-4719-8ed0-de010f05d5ba admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:54.301209 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad43490-d1e7-48eb-8f54-f3cc0021ea49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:54.302086 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad43490-d1e7-48eb-8f54-f3cc0021ea49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:54.302411 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad43490-d1e7-48eb-8f54-f3cc0021ea49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:54.302694 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad43490-d1e7-48eb-8f54-f3cc0021ea49 admin admin] PATH_INFO: `/v3/users/a3d2dbe50e3744eca547bccbbcdddb03` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:54.303945 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad43490-d1e7-48eb-8f54-f3cc0021ea49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3d2dbe50e3744eca547bccbbcdddb03)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:54.305900 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad43490-d1e7-48eb-8f54-f3cc0021ea49 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:54.331781 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:27:54.358706 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5ad43490-d1e7-48eb-8f54-f3cc0021ea49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3d2dbe50e3744eca547bccbbcdddb03'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:54.359375 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5ad43490-d1e7-48eb-8f54-f3cc0021ea49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3d2dbe50e3744eca547bccbbcdddb03'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:54.367764 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5ad43490-d1e7-48eb-8f54-f3cc0021ea49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3d2dbe50e3744eca547bccbbcdddb03'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:54.380599 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5ad43490-d1e7-48eb-8f54-f3cc0021ea49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3d2dbe50e3744eca547bccbbcdddb03'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:54.381283 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5ad43490-d1e7-48eb-8f54-f3cc0021ea49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3d2dbe50e3744eca547bccbbcdddb03'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:54.393944 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1445/2905] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:27:54 2022] DELETE /identity/v3/users/a3d2dbe50e3744eca547bccbbcdddb03 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:27:54.575355 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2baf177-7464-492b-9a65-52fd6dac2c0c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:54.576950 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e2baf177-7464-492b-9a65-52fd6dac2c0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:54.591293 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2baf177-7464-492b-9a65-52fd6dac2c0c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:54.657828 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b2f534-cf5c-46f4-a1e2-fdbb14de428c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:54.658713 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b2f534-cf5c-46f4-a1e2-fdbb14de428c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:54.659002 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b2f534-cf5c-46f4-a1e2-fdbb14de428c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:54.659279 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b2f534-cf5c-46f4-a1e2-fdbb14de428c admin admin] PATH_INFO: `/v3/projects/43e5142cf49f4ff98410e38106fbd1c4` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:54.660502 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b2f534-cf5c-46f4-a1e2-fdbb14de428c admin admin] RBAC: Authorizing `identity:delete_project(project_id=43e5142cf49f4ff98410e38106fbd1c4)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:54.662525 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b2f534-cf5c-46f4-a1e2-fdbb14de428c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:54.685638 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:27:54.721883 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b2b2f534-cf5c-46f4-a1e2-fdbb14de428c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43e5142cf49f4ff98410e38106fbd1c4', 'request_id': 'req-b2b2f534-cf5c-46f4-a1e2-fdbb14de428c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:54.728601 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b2b2f534-cf5c-46f4-a1e2-fdbb14de428c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43e5142cf49f4ff98410e38106fbd1c4', 'request_id': 'req-b2b2f534-cf5c-46f4-a1e2-fdbb14de428c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:54.734271 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b2b2f534-cf5c-46f4-a1e2-fdbb14de428c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43e5142cf49f4ff98410e38106fbd1c4', 'request_id': 'req-b2b2f534-cf5c-46f4-a1e2-fdbb14de428c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:54.748379 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b2b2f534-cf5c-46f4-a1e2-fdbb14de428c admin admin] The token cache is being invalidate because project 43e5142cf49f4ff98410e38106fbd1c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:27:54.748600 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b2b2f534-cf5c-46f4-a1e2-fdbb14de428c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:54.749218 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b2b2f534-cf5c-46f4-a1e2-fdbb14de428c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:27:54.750796 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1461/2906] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:27:54 2022] DELETE /identity/v3/projects/43e5142cf49f4ff98410e38106fbd1c4 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:27:54.756822 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71126b3-834b-4467-afaf-436f41323a2e None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:54.757324 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71126b3-834b-4467-afaf-436f41323a2e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:54.757324 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71126b3-834b-4467-afaf-436f41323a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:54.779543 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-f71126b3-834b-4467-afaf-436f41323a2e None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:27:54.781592 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f71126b3-834b-4467-afaf-436f41323a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:54.847755 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1446/2907] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:27:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:27:54.855877 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfd2f9-af8a-4b2a-93af-9af7e5cc7fa3 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:54.856189 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfd2f9-af8a-4b2a-93af-9af7e5cc7fa3 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:54.856451 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfd2f9-af8a-4b2a-93af-9af7e5cc7fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:54.875037 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-94dfd2f9-af8a-4b2a-93af-9af7e5cc7fa3 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:27:54.876237 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-94dfd2f9-af8a-4b2a-93af-9af7e5cc7fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:54.884953 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1462/2908] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:27:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:27:54.889787 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71126b3-834b-4467-afaf-436f41323a2e None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:54.903101 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71126b3-834b-4467-afaf-436f41323a2e None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:54.909056 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dced013-36a5-4de0-b1f7-6fdc0d2b322c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:54.909725 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dced013-36a5-4de0-b1f7-6fdc0d2b322c admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:54.909984 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dced013-36a5-4de0-b1f7-6fdc0d2b322c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:54.910312 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dced013-36a5-4de0-b1f7-6fdc0d2b322c admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:54.911048 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dced013-36a5-4de0-b1f7-6fdc0d2b322c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 04 04:27:54.911382 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dced013-36a5-4de0-b1f7-6fdc0d2b322c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:54.913076 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dced013-36a5-4de0-b1f7-6fdc0d2b322c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:54.925392 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1447/2909] 10.222.0.49 () {58 vars in 1152 bytes} [Mon Jul 4 04:27:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 04 04:27:54.929801 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfd2f9-af8a-4b2a-93af-9af7e5cc7fa3 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:54.939642 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfd2f9-af8a-4b2a-93af-9af7e5cc7fa3 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:54.944917 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84379b3d-1228-4cc3-8698-6c57a846ef0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:54.945611 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84379b3d-1228-4cc3-8698-6c57a846ef0a admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:54.945920 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84379b3d-1228-4cc3-8698-6c57a846ef0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:54.946180 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84379b3d-1228-4cc3-8698-6c57a846ef0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:54.946949 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84379b3d-1228-4cc3-8698-6c57a846ef0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:54.948910 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84379b3d-1228-4cc3-8698-6c57a846ef0a admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:54.990225 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1463/2910] 10.222.0.49 () {60 vars in 1152 bytes} [Mon Jul 4 04:27:54 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:27:54.995393 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dced013-36a5-4de0-b1f7-6fdc0d2b322c admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:55.012122 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dced013-36a5-4de0-b1f7-6fdc0d2b322c admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:55.086377 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52268c11-0020-4092-895c-8317c07a28ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:55.087442 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52268c11-0020-4092-895c-8317c07a28ac admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:55.087882 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52268c11-0020-4092-895c-8317c07a28ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:55.088335 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52268c11-0020-4092-895c-8317c07a28ac admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:55.089136 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52268c11-0020-4092-895c-8317c07a28ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:55.092237 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52268c11-0020-4092-895c-8317c07a28ac admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:55.123572 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1448/2911] 10.222.0.49 () {60 vars in 1143 bytes} [Mon Jul 4 04:27:54 2022] POST /identity/v3/users => generated 287 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 04 04:27:55.128630 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84379b3d-1228-4cc3-8698-6c57a846ef0a admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:55.140781 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84379b3d-1228-4cc3-8698-6c57a846ef0a admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:55.146568 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0fb996-b9a2-4a6e-83ed-d94be7758e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:55.147234 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fb996-b9a2-4a6e-83ed-d94be7758e8c admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:55.147515 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fb996-b9a2-4a6e-83ed-d94be7758e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:55.147790 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fb996-b9a2-4a6e-83ed-d94be7758e8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:55.148509 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0fb996-b9a2-4a6e-83ed-d94be7758e8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:55.150142 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0fb996-b9a2-4a6e-83ed-d94be7758e8c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:55.162764 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1464/2912] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 04 04:27:55.168706 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52268c11-0020-4092-895c-8317c07a28ac admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:55.179629 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52268c11-0020-4092-895c-8317c07a28ac admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:55.185752 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfad054-66da-4c63-b4de-874945d0011c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:55.186812 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfad054-66da-4c63-b4de-874945d0011c admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:55.187297 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfad054-66da-4c63-b4de-874945d0011c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:55.187773 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfad054-66da-4c63-b4de-874945d0011c admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:55.188851 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfad054-66da-4c63-b4de-874945d0011c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:55.191494 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfad054-66da-4c63-b4de-874945d0011c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:55.204913 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1449/2913] 10.222.0.49 () {58 vars in 1121 bytes} [Mon Jul 4 04:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 04 04:27:55.209237 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0fb996-b9a2-4a6e-83ed-d94be7758e8c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:55.220154 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0fb996-b9a2-4a6e-83ed-d94be7758e8c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:55.226481 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8513f-d270-48bb-86ae-85a554dd8726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:55.227367 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8513f-d270-48bb-86ae-85a554dd8726 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:55.227645 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8513f-d270-48bb-86ae-85a554dd8726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:55.227918 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8513f-d270-48bb-86ae-85a554dd8726 admin admin] PATH_INFO: `/v3/projects/0882ddc8deed4c0f9817bec13caef676/users/0dd790198b984a148c630a794316556f/roles/8d92e2d53a9441a9b6ddaaad264ac4c9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:55.244906 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8513f-d270-48bb-86ae-85a554dd8726 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0882ddc8deed4c0f9817bec13caef676, user_id=0dd790198b984a148c630a794316556f, role_id=8d92e2d53a9441a9b6ddaaad264ac4c9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:55.247738 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8513f-d270-48bb-86ae-85a554dd8726 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:55.263206 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1465/2914] 10.222.0.49 () {60 vars in 1482 bytes} [Mon Jul 4 04:27:55 2022] PUT /identity/v3/projects/0882ddc8deed4c0f9817bec13caef676/users/0dd790198b984a148c630a794316556f/roles/8d92e2d53a9441a9b6ddaaad264ac4c9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:27:55.273068 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d54fe-acd8-41fc-b01b-0c1d65951259 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:55.273397 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d54fe-acd8-41fc-b01b-0c1d65951259 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:55.273686 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d54fe-acd8-41fc-b01b-0c1d65951259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:55.280691 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:27:55.302339 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c87d54fe-acd8-41fc-b01b-0c1d65951259 None None] MFA Rules not processed for user `0dd790198b984a148c630a794316556f`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:27:55.303590 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c87d54fe-acd8-41fc-b01b-0c1d65951259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:55.382548 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1450/2915] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:27:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:27:55.396822 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8513f-d270-48bb-86ae-85a554dd8726 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:27:55.398719 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-29e8513f-d270-48bb-86ae-85a554dd8726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:55.458142 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8513f-d270-48bb-86ae-85a554dd8726 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:27:55.462319 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd170d1-d918-4a56-92cb-6394078df475 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20ab1d200447c098d32ebfa130c5de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:27:55.462990 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd170d1-d918-4a56-92cb-6394078df475 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:55.463269 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd170d1-d918-4a56-92cb-6394078df475 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:55.463552 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd170d1-d918-4a56-92cb-6394078df475 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:55.472234 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd170d1-d918-4a56-92cb-6394078df475 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:27:55.473709 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd170d1-d918-4a56-92cb-6394078df475 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:27:55.482532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1466/2916] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:27:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:27:56.840314 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4031d-0ffe-4375-b3bf-8c0c3a7dd731 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:27:56.840848 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4031d-0ffe-4375-b3bf-8c0c3a7dd731 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:27:56.840848 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4031d-0ffe-4375-b3bf-8c0c3a7dd731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:27:56.860498 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-05a4031d-0ffe-4375-b3bf-8c0c3a7dd731 None None] MFA Rules not processed for user `0dd790198b984a148c630a794316556f`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:27:56.861719 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-05a4031d-0ffe-4375-b3bf-8c0c3a7dd731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:27:56.869924 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1451/2917] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:27:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:28:04.353578 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd170d1-d918-4a56-92cb-6394078df475 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:28:04.355328 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4dd170d1-d918-4a56-92cb-6394078df475 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:28:04.406310 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:28:04.444690 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd170d1-d918-4a56-92cb-6394078df475 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:28:04.451657 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd9423-8efc-4055-b417-a5be91e41078 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8334e75253f843a980b01c6f0cda6015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:28:04.452437 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd9423-8efc-4055-b417-a5be91e41078 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:28:04.453170 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd9423-8efc-4055-b417-a5be91e41078 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:28:04.453673 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd9423-8efc-4055-b417-a5be91e41078 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:28:04.455590 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b8cd9423-8efc-4055-b417-a5be91e41078 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:28:04.469718 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd9423-8efc-4055-b417-a5be91e41078 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:28:04.471477 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd9423-8efc-4055-b417-a5be91e41078 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:28:04.484027 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1467/2918] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:28:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:28:06.854644 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=33 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:28:14.478844 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=17 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:28:16.390918 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca494e8-abf3-4781-9911-da97d0327a24 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:28:16.391399 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca494e8-abf3-4781-9911-da97d0327a24 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:28:16.391508 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca494e8-abf3-4781-9911-da97d0327a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:28:16.409406 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-eca494e8-abf3-4781-9911-da97d0327a24 None None] MFA Rules not processed for user `03e7f908f0a7499792e59e31d497edb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:28:16.410640 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-eca494e8-abf3-4781-9911-da97d0327a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:28:16.474943 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1452/2919] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Jul 4 04:28:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:28:16.533520 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd9423-8efc-4055-b417-a5be91e41078 service nova] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:28:16.535219 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b8cd9423-8efc-4055-b417-a5be91e41078 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:28:16.617663 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd9423-8efc-4055-b417-a5be91e41078 service nova] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:28:16.623428 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da30c95-7155-4a0b-b07c-f49d74482093 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f93fdc98ff425791da3e2194b3a671', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:28:16.624081 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da30c95-7155-4a0b-b07c-f49d74482093 service swift] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:28:16.624368 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da30c95-7155-4a0b-b07c-f49d74482093 service swift] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:28:16.624670 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da30c95-7155-4a0b-b07c-f49d74482093 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:28:16.632993 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da30c95-7155-4a0b-b07c-f49d74482093 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:28:16.634625 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da30c95-7155-4a0b-b07c-f49d74482093 service swift] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:28:16.642825 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1468/2920] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Jul 4 04:28:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 04 04:28:17.172165 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953a595-deb9-4e03-a7ae-fa542a462f11 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:28:17.172484 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953a595-deb9-4e03-a7ae-fa542a462f11 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:28:17.172770 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953a595-deb9-4e03-a7ae-fa542a462f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:28:17.191930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-5953a595-deb9-4e03-a7ae-fa542a462f11 None None] MFA Rules not processed for user `03e7f908f0a7499792e59e31d497edb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:28:17.193165 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5953a595-deb9-4e03-a7ae-fa542a462f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:28:17.201418 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1453/2921] 10.222.0.49 () {58 vars in 967 bytes} [Mon Jul 4 04:28:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:28:17.217604 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da30c95-7155-4a0b-b07c-f49d74482093 service swift] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:28:17.228686 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da30c95-7155-4a0b-b07c-f49d74482093 service swift] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:28:17.235225 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb362fc-3148-4592-bffd-e066276b08b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f93fdc98ff425791da3e2194b3a671', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:28:17.235875 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb362fc-3148-4592-bffd-e066276b08b0 service swift] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:28:17.236162 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb362fc-3148-4592-bffd-e066276b08b0 service swift] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:28:17.236439 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb362fc-3148-4592-bffd-e066276b08b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:28:17.244532 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb362fc-3148-4592-bffd-e066276b08b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:28:17.246256 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb362fc-3148-4592-bffd-e066276b08b0 service swift] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:28:17.254671 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1469/2922] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Jul 4 04:28:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 04:28:17.468882 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044a91c-d8d7-4f8c-a203-e894e56d97d2 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:28:17.469374 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044a91c-d8d7-4f8c-a203-e894e56d97d2 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:28:17.469471 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044a91c-d8d7-4f8c-a203-e894e56d97d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:28:17.487958 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-9044a91c-d8d7-4f8c-a203-e894e56d97d2 None None] MFA Rules not processed for user `03e7f908f0a7499792e59e31d497edb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:28:17.489181 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9044a91c-d8d7-4f8c-a203-e894e56d97d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:28:17.497875 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1454/2923] 10.222.0.49 () {58 vars in 1009 bytes} [Mon Jul 4 04:28:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:28:17.510224 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb362fc-3148-4592-bffd-e066276b08b0 service swift] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:28:17.522799 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb362fc-3148-4592-bffd-e066276b08b0 service swift] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:28:17.529902 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ed26e-55aa-4ad4-964f-4aa7e8047c16 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f93fdc98ff425791da3e2194b3a671', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:28:17.530582 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ed26e-55aa-4ad4-964f-4aa7e8047c16 service swift] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:28:17.530868 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ed26e-55aa-4ad4-964f-4aa7e8047c16 service swift] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:28:17.531140 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ed26e-55aa-4ad4-964f-4aa7e8047c16 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:28:17.543949 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ed26e-55aa-4ad4-964f-4aa7e8047c16 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:28:17.546812 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ed26e-55aa-4ad4-964f-4aa7e8047c16 service swift] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:28:17.557482 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1470/2924] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Jul 4 04:28:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 04:28:17.898405 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1d3b5-b29a-4c80-acc9-727abb6c027b None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:28:17.898700 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1d3b5-b29a-4c80-acc9-727abb6c027b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:28:17.898986 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1d3b5-b29a-4c80-acc9-727abb6c027b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:28:17.917888 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-5ba1d3b5-b29a-4c80-acc9-727abb6c027b None None] MFA Rules not processed for user `03e7f908f0a7499792e59e31d497edb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:28:17.919223 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5ba1d3b5-b29a-4c80-acc9-727abb6c027b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:28:17.927353 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1455/2925] 10.222.0.49 () {58 vars in 967 bytes} [Mon Jul 4 04:28:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 04 04:28:17.940752 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ed26e-55aa-4ad4-964f-4aa7e8047c16 service swift] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:28:17.952351 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ed26e-55aa-4ad4-964f-4aa7e8047c16 service swift] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:28:17.958815 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265bbad-edab-463b-93b7-bf92162d3fbe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f93fdc98ff425791da3e2194b3a671', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:28:17.959480 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265bbad-edab-463b-93b7-bf92162d3fbe service swift] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:28:17.959740 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265bbad-edab-463b-93b7-bf92162d3fbe service swift] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:28:17.960028 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265bbad-edab-463b-93b7-bf92162d3fbe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:28:17.968752 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f265bbad-edab-463b-93b7-bf92162d3fbe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:28:17.970411 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f265bbad-edab-463b-93b7-bf92162d3fbe service swift] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:28:17.979067 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1471/2926] 10.222.0.49 () {60 vars in 1384 bytes} [Mon Jul 4 04:28:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 04 04:28:19.210285 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1d3b5-b29a-4c80-acc9-727abb6c027b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:28:19.279348 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1d3b5-b29a-4c80-acc9-727abb6c027b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:28:19.284042 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffafa01-7a45-4e26-a2e8-7ce56e71eda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:28:19.284930 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffafa01-7a45-4e26-a2e8-7ce56e71eda8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:28:19.285222 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffafa01-7a45-4e26-a2e8-7ce56e71eda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:28:19.285499 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffafa01-7a45-4e26-a2e8-7ce56e71eda8 admin admin] PATH_INFO: `/v3/users/0dd790198b984a148c630a794316556f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:28:19.286787 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffafa01-7a45-4e26-a2e8-7ce56e71eda8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dd790198b984a148c630a794316556f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:28:19.288731 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffafa01-7a45-4e26-a2e8-7ce56e71eda8 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:28:19.343006 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-bffafa01-7a45-4e26-a2e8-7ce56e71eda8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dd790198b984a148c630a794316556f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:28:19.343671 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-bffafa01-7a45-4e26-a2e8-7ce56e71eda8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dd790198b984a148c630a794316556f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:28:19.353927 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-bffafa01-7a45-4e26-a2e8-7ce56e71eda8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dd790198b984a148c630a794316556f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:28:19.368130 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-bffafa01-7a45-4e26-a2e8-7ce56e71eda8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dd790198b984a148c630a794316556f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:28:19.368773 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-bffafa01-7a45-4e26-a2e8-7ce56e71eda8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dd790198b984a148c630a794316556f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:28:19.381109 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1456/2927] 10.222.0.49 () {58 vars in 1223 bytes} [Mon Jul 4 04:28:19 2022] DELETE /identity/v3/users/0dd790198b984a148c630a794316556f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:28:19.385905 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548c445-f62a-4be1-a6a9-865bb8ecebb0 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:28:19.386433 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548c445-f62a-4be1-a6a9-865bb8ecebb0 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:28:19.386649 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548c445-f62a-4be1-a6a9-865bb8ecebb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:28:19.407826 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-8548c445-f62a-4be1-a6a9-865bb8ecebb0 None None] MFA Rules not processed for user `e4dc423a8fa8454bad29c9624cf55962`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 04 04:28:19.409040 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-8548c445-f62a-4be1-a6a9-865bb8ecebb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:28:19.471126 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1472/2928] 10.222.0.49 () {58 vars in 957 bytes} [Mon Jul 4 04:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 04 04:28:19.480983 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffafa01-7a45-4e26-a2e8-7ce56e71eda8 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:28:19.482683 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-bffafa01-7a45-4e26-a2e8-7ce56e71eda8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:28:19.489680 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:28:19.545777 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffafa01-7a45-4e26-a2e8-7ce56e71eda8 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:28:19.550111 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a41cef9-fd3d-479e-add7-761fedbc1aaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b36a8402144c458fa98f80d7e3516127', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:28:19.550829 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41cef9-fd3d-479e-add7-761fedbc1aaa service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:28:19.551117 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41cef9-fd3d-479e-add7-761fedbc1aaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:28:19.551399 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41cef9-fd3d-479e-add7-761fedbc1aaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:28:19.562415 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a41cef9-fd3d-479e-add7-761fedbc1aaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:28:19.563917 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a41cef9-fd3d-479e-add7-761fedbc1aaa service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:28:19.574596 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1457/2929] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:28:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:28:19.760169 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548c445-f62a-4be1-a6a9-865bb8ecebb0 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:28:19.761821 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-8548c445-f62a-4be1-a6a9-865bb8ecebb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:28:19.784177 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548c445-f62a-4be1-a6a9-865bb8ecebb0 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:28:19.790518 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7fd0ee-b837-46f7-9181-ee37f4a00e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4dc423a8fa8454bad29c9624cf55962', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a178190dbd1b4a75a7550013812afce1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:28:19.791595 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fd0ee-b837-46f7-9181-ee37f4a00e9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:28:19.791956 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fd0ee-b837-46f7-9181-ee37f4a00e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:28:19.792217 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fd0ee-b837-46f7-9181-ee37f4a00e9a admin admin] PATH_INFO: `/v3/projects/0882ddc8deed4c0f9817bec13caef676` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:28:19.793973 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7fd0ee-b837-46f7-9181-ee37f4a00e9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0882ddc8deed4c0f9817bec13caef676)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:28:19.796169 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7fd0ee-b837-46f7-9181-ee37f4a00e9a admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:28:19.836687 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:28:19.846573 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5b7fd0ee-b837-46f7-9181-ee37f4a00e9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0882ddc8deed4c0f9817bec13caef676', 'request_id': 'req-5b7fd0ee-b837-46f7-9181-ee37f4a00e9a'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:28:19.852649 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5b7fd0ee-b837-46f7-9181-ee37f4a00e9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0882ddc8deed4c0f9817bec13caef676', 'request_id': 'req-5b7fd0ee-b837-46f7-9181-ee37f4a00e9a'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:28:19.858177 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5b7fd0ee-b837-46f7-9181-ee37f4a00e9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0882ddc8deed4c0f9817bec13caef676', 'request_id': 'req-5b7fd0ee-b837-46f7-9181-ee37f4a00e9a'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:28:19.874966 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5b7fd0ee-b837-46f7-9181-ee37f4a00e9a admin admin] The token cache is being invalidate because project 0882ddc8deed4c0f9817bec13caef676 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 04 04:28:19.875317 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5b7fd0ee-b837-46f7-9181-ee37f4a00e9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:28:19.876166 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5b7fd0ee-b837-46f7-9181-ee37f4a00e9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 04 04:28:19.877956 dv-cinder-742162-5-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1473/2930] 10.222.0.49 () {58 vars in 1232 bytes} [Mon Jul 4 04:28:19 2022] DELETE /identity/v3/projects/0882ddc8deed4c0f9817bec13caef676 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 04 04:28:29.569638 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=24 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:28:29.869926 dv-cinder-742162-5-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:DELETE=5,keystone:SELECT=11,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 04:29:20.687743 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a41cef9-fd3d-479e-add7-761fedbc1aaa service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 04 04:29:20.690582 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3a41cef9-fd3d-479e-add7-761fedbc1aaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:29:20.770468 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a41cef9-fd3d-479e-add7-761fedbc1aaa service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 04 04:29:20.833030 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3f682-acce-482a-bbf0-3275d48a7401 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2a18591461343c3a0a1b0e317734ba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '424a145a22434ef7a14b6108e6118ccb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 04 04:29:20.833684 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3f682-acce-482a-bbf0-3275d48a7401 service placement] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 04 04:29:20.833976 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3f682-acce-482a-bbf0-3275d48a7401 service placement] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 04 04:29:20.834285 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3f682-acce-482a-bbf0-3275d48a7401 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 04 04:29:20.836248 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-94b3f682-acce-482a-bbf0-3275d48a7401 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 04 04:29:20.848394 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b3f682-acce-482a-bbf0-3275d48a7401 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 04 04:29:20.850036 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b3f682-acce-482a-bbf0-3275d48a7401 service placement] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 04 04:29:20.860029 dv-cinder-742162-5-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1458/2931] 10.222.0.49 () {60 vars in 1365 bytes} [Mon Jul 4 04:29:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 04 04:29:30.855925 dv-cinder-742162-5-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=58 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}